-- Logs begin at Mon 2022-05-23 14:54:47 UTC, end at Mon 2022-05-23 16:13:29 UTC. -- May 23 15:34:31.559237 dv-cinder-842119-2-smb systemd[1]: Starting Devstack devstack@keystone.service... May 23 15:34:31.567200 dv-cinder-842119-2-smb devstack@keystone.service[87184]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 23 15:34:31.571796 dv-cinder-842119-2-smb devstack@keystone.service[87184]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 23 15:34:31 2022] *** May 23 15:34:31.571796 dv-cinder-842119-2-smb devstack@keystone.service[87184]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 23 15:34:31.571796 dv-cinder-842119-2-smb devstack@keystone.service[87184]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 23 15:34:31.571796 dv-cinder-842119-2-smb devstack@keystone.service[87184]: nodename: dv-cinder-842119-2-smb May 23 15:34:31.571796 dv-cinder-842119-2-smb devstack@keystone.service[87184]: machine: x86_64 May 23 15:34:31.571796 dv-cinder-842119-2-smb devstack@keystone.service[87184]: clock source: unix May 23 15:34:31.571796 dv-cinder-842119-2-smb devstack@keystone.service[87184]: pcre jit disabled May 23 15:34:31.571796 dv-cinder-842119-2-smb devstack@keystone.service[87184]: detected number of CPU cores: 4 May 23 15:34:31.571796 dv-cinder-842119-2-smb devstack@keystone.service[87184]: current working directory: / May 23 15:34:31.571796 dv-cinder-842119-2-smb devstack@keystone.service[87184]: detected binary path: /usr/bin/uwsgi-core May 23 15:34:31.571796 dv-cinder-842119-2-smb devstack@keystone.service[87184]: your processes number limit is 47680 May 23 15:34:31.571796 dv-cinder-842119-2-smb devstack@keystone.service[87184]: your memory page size is 4096 bytes May 23 15:34:31.571796 dv-cinder-842119-2-smb devstack@keystone.service[87184]: detected max file descriptor number: 2048 May 23 15:34:31.571796 dv-cinder-842119-2-smb devstack@keystone.service[87184]: lock engine: pthread robust mutexes May 23 15:34:31.571796 dv-cinder-842119-2-smb devstack@keystone.service[87184]: thunder lock: enabled May 23 15:34:31.571796 dv-cinder-842119-2-smb devstack@keystone.service[87184]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 23 15:34:31.571796 dv-cinder-842119-2-smb devstack@keystone.service[87184]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 23 15:34:31.615270 dv-cinder-842119-2-smb devstack@keystone.service[87184]: Python main interpreter initialized at 0x562d67ba59c0 May 23 15:34:31.615270 dv-cinder-842119-2-smb devstack@keystone.service[87184]: python threads support enabled May 23 15:34:31.615270 dv-cinder-842119-2-smb devstack@keystone.service[87184]: your server socket listen backlog is limited to 100 connections May 23 15:34:31.615270 dv-cinder-842119-2-smb devstack@keystone.service[87184]: your mercy for graceful operations on workers is 90 seconds May 23 15:34:31.615588 dv-cinder-842119-2-smb devstack@keystone.service[87184]: mapped 403077 bytes (393 KB) for 2 cores May 23 15:34:31.615696 dv-cinder-842119-2-smb devstack@keystone.service[87184]: *** Operational MODE: preforking *** May 23 15:34:31.615972 dv-cinder-842119-2-smb devstack@keystone.service[87184]: *** uWSGI is running in multiple interpreter mode *** May 23 15:34:31.615972 dv-cinder-842119-2-smb devstack@keystone.service[87184]: spawned uWSGI master process (pid: 87184) May 23 15:34:31.616172 dv-cinder-842119-2-smb systemd[1]: Started Devstack devstack@keystone.service. May 23 15:34:31.617254 dv-cinder-842119-2-smb devstack@keystone.service[87184]: spawned uWSGI worker 1 (pid: 87191, cores: 1) May 23 15:34:31.617254 dv-cinder-842119-2-smb devstack@keystone.service[87184]: spawned uWSGI worker 2 (pid: 87192, cores: 1) May 23 15:34:31.617254 dv-cinder-842119-2-smb devstack@keystone.service[87184]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 23 15:34:37.216719 dv-cinder-842119-2-smb devstack@keystone.service[87191]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 15:34:37.216719 dv-cinder-842119-2-smb devstack@keystone.service[87191]: from cryptography.utils import int_from_bytes May 23 15:34:37.217439 dv-cinder-842119-2-smb devstack@keystone.service[87191]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 15:34:37.217439 dv-cinder-842119-2-smb devstack@keystone.service[87191]: from cryptography.utils import int_from_bytes May 23 15:34:37.263395 dv-cinder-842119-2-smb devstack@keystone.service[87192]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 15:34:37.263395 dv-cinder-842119-2-smb devstack@keystone.service[87192]: from cryptography.utils import int_from_bytes May 23 15:34:37.263971 dv-cinder-842119-2-smb devstack@keystone.service[87192]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 15:34:37.263971 dv-cinder-842119-2-smb devstack@keystone.service[87192]: from cryptography.utils import int_from_bytes May 23 15:34:37.266912 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 15:34:37.267105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 15:34:37.267294 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] command line args: [] {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 15:34:37.267564 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 15:34:37.267766 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ================================================================================ {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 15:34:37.268021 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] admin_token = **** {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.268267 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] config_dir = [] {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.268452 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.268631 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] config_source = [] {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.268808 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] debug = True {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.269002 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.269497 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.269592 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.270390 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.270390 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.270390 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] list_limit = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.270390 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] log_config_append = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.270631 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.270743 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] log_dir = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.270917 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] log_file = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.271149 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.271393 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.271669 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.271918 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.272094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.272269 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.272511 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.272755 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.272987 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.273217 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.273446 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.273675 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.273918 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.274162 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.274436 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.274920 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.275102 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] publish_errors = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.275332 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.275562 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.275762 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.276007 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.276239 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.276474 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] standard_threads = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.276703 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.276949 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.277124 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.277298 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] use_journal = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.277471 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] use_json = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.277643 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] use_stderr = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.277815 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] use_syslog = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.278043 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.278297 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.278534 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.278791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.279028 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.279276 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.279511 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.279786 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.280022 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.280973 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.281296 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.281554 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.281793 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.282043 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.282279 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.282526 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.282772 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.283008 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.283262 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.283513 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.283778 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.284016 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.284268 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.284526 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.284776 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.285024 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.285253 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.285482 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.285709 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.285943 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.286188 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.286434 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.286663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.286889 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.287131 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.287380 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.287626 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.287880 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.288109 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.288343 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.288574 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.288800 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.289027 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.289254 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.289481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.289712 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.289956 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.290183 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.290415 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.290641 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.290872 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.291103 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.291348 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.291575 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.291829 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.292061 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.292292 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.292524 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.292756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.292983 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.293228 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.293460 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.293695 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.293922 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.294178 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.294413 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.294645 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.294878 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.295111 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.295375 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.295636 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.296622 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.297058 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.297311 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.297561 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.297804 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.298057 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.298298 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.298537 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.298781 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.299017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.299254 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.299489 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.299748 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.299986 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.300245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.300481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.300722 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.300958 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.301198 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.301435 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.301669 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.301903 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.302131 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.302361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.302589 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.302823 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.303053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.303289 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.303522 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.303791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.304026 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.304279 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.304536 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.304775 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.305005 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] auth.external = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.305233 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.305526 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.305757 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.305986 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] auth.password = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.306215 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] auth.token = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.306450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.306684 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.306928 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.307156 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.307404 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.307668 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.307901 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.308136 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] credential.caching = True {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.308382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.308629 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.308875 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.309111 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.309351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.309584 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.309844 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.310097 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.310331 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.310591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.310862 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.311105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.311212 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 15:34:37.311319 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 15:34:37.311547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.311702 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] command line args: [] {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 15:34:37.311812 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.311890 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 15:34:37.312071 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.312159 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ================================================================================ {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 15:34:37.312306 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] federation.caching = True {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.312436 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] admin_token = **** {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.312541 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.312620 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] config_dir = [] {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.312736 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.312819 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.312923 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] config_source = [] {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.313053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.313138 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] debug = True {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.313220 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.313334 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.313493 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.313572 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.313687 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.313809 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.313939 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.314014 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.314170 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.314249 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.314408 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] list_limit = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.314487 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.314603 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] log_config_append = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.314679 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.314803 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.314891 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.314964 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] log_dir = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.315079 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] log_file = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.315153 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] identity.caching = True {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.315306 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.315397 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.315554 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.315654 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.315813 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.315891 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.316081 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.316174 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.316253 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.316391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.316477 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.316655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.316745 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.316900 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.316981 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.317134 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.317212 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.317367 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.317521 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.317641 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.317717 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.317817 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.317929 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.318055 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.318145 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.318297 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.318376 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.318543 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.318622 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.318788 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.319042 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.319134 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.319239 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] publish_errors = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.319323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.319472 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.319553 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.319729 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.319809 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.319907 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.320034 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.320155 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.320248 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.320388 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.320467 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.320623 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] standard_threads = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.320708 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.320858 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.320948 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.321102 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.321181 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.321279 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.321358 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.321456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] use_journal = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.321586 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.321667 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] use_json = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.321812 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] use_stderr = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.321892 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.321964 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] use_syslog = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.322058 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.322188 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:34:37.322304 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.322446 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.322524 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.322686 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.322770 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.322948 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.323034 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.323189 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.323268 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.323436 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.323519 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.323688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.323769 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.323925 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.324013 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.324159 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.324239 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.324399 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.324479 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.324633 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.324711 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.324868 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.324947 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.325111 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.325190 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.325355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.325433 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.325586 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.325670 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.325816 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.325897 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.326063 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.326142 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.326298 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.326376 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.326532 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.326612 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.326766 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.326916 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.327074 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.327156 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.327377 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.user = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.327529 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.327717 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.327842 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.327981 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.328062 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.328211 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.328301 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.328459 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.328540 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.328704 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.328784 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.328949 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.329038 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.329183 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.329268 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.329411 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.329490 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.329644 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.329732 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.329876 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.329963 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.330107 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.330186 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.330332 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.330423 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.330575 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.330660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.330818 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.330903 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.331056 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.331208 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.331284 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.331365 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.331526 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.331653 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.331775 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.331863 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.332012 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.332091 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.332243 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.332322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.332474 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.332560 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.332704 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.332783 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.332935 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.333014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.333173 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.333260 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.333426 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.333507 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.333649 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.333727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.333888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.333976 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.334113 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.334191 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.334348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.334427 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.334579 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.334665 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.334821 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.334902 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.335052 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.335130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.335291 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.335379 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.335530 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.335627 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.335784 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.335865 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.336018 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.336106 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.336254 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.336333 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] resource.caching = True {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.336485 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.336566 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.336734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.336822 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.336967 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.337046 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.337204 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.337322 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.337437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.337573 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.337698 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.337808 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.337938 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.338055 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.338172 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.338291 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.338408 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.338527 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.338645 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.338761 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] role.caching = True {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.338913 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.339000 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] role.driver = sql {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.339150 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.339230 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.339399 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.339481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.339664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.339759 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.339904 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.339985 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.340141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.340220 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.340378 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.340466 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.340627 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.340706 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.340863 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.340943 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.341100 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.341187 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.341341 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.341421 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.341578 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.341657 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.341821 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.341908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.342057 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.342135 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.342294 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.342374 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.342531 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.343240 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.343344 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.343474 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.343554 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.343759 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.343934 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.344017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.344175 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.344254 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.344419 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.344499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.344657 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.344739 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.344894 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.344973 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.345130 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.345211 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.345368 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.345449 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.345598 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.345677 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.345825 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.345904 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.346054 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.346136 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.346282 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.346361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.346524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.346603 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.346761 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.346843 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.346993 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.347072 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.347225 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.347304 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.347452 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.347534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.347753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.347835 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] token.caching = True {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.347998 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.348089 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.348229 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] auth.external = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.348310 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.348459 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.348539 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.348710 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.348788 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.348955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.349037 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.349187 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.349267 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] auth.password = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.349416 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] auth.token = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.349495 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.349653 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.349733 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.349887 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.349966 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.350117 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.350196 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.350351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.350432 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.350582 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.350661 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.350823 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.350902 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.351052 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.351133 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.351282 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.351361 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] credential.caching = True {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.351520 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.351642 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.351793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.351874 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.352043 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.352124 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] database.connection = **** {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.352280 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.352437 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.352514 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.352594 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.352804 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.352895 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.352995 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.353074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.353229 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.353318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.353464 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.353544 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.353696 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.353776 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.353930 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.354018 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.354172 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.354253 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.354416 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.354496 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.354658 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.354745 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.354893 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.355017 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.355138 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.355302 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] federation.caching = True {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.355381 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.355545 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.355644 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.355837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.355926 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.356073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.356153 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.356305 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.356386 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.356457 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 15:34:37.356730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.357072 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.357442 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.357708 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.358080 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.359229 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.359589 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.359952 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] identity.caching = True {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.360306 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.360656 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.360996 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.361332 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.361685 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.361997 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.362335 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.362689 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.363044 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.363356 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.363692 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.364006 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.364630 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.364906 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.365268 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.365552 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.365915 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.366216 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.366555 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.366892 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.367204 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.367540 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.367874 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.368210 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.368562 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.368926 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.369274 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.369584 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.369934 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.370282 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.370615 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.370964 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.371311 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.371645 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.371978 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.372288 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.372621 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.372955 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.373292 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.373626 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.374069 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.374434 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.374790 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.375102 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.375415 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.375810 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.376133 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.376377 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.376619 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.376860 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.377094 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.user = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.377346 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.377612 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.377848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.378099 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.378350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.378600 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.378838 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.379069 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.379307 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.379543 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.379808 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.380143 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.380399 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.380653 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.380904 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.381153 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.381401 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.381635 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.381883 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.382124 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.382363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.382600 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.382837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.383084 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.383333 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.383573 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.383854 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.384086 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.384331 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.384568 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.384805 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.385042 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.385292 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.385534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.385766 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.386009 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.386250 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] resource.caching = True {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.386502 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.386754 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.386991 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.387239 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.387489 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.387631 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.387753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.387834 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.388003 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.388085 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.388241 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.388479 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.388717 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] role.caching = True {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.388966 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] role.driver = sql {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.389197 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.389444 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.389718 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.389972 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.390254 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.390504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.390751 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.390999 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.391247 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.391481 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.391753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.392002 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.392250 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.392498 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.392913 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.393150 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.393400 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.393651 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.393910 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.394160 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.394396 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.394651 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.394903 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.395141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.395372 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.395635 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.395860 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.396117 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.396373 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.396621 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.396859 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.397094 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.397325 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.397560 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] token.caching = True {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.397797 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.398045 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.398282 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.398363 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.398538 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.398785 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.399022 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.399265 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.399506 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.399780 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.400019 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.400256 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.400492 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.400737 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.400984 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.401213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.401455 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.401746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.402006 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] database.connection = **** {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.402257 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.402506 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.402744 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.402985 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.403220 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.403456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.403713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.403951 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.404195 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.404431 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.404676 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.404913 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.405680 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.405918 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.406161 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.406394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.406634 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.406869 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:34:37.407040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 15:34:37.427303 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.427529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.432260 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.432496 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.432718 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.443349 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.462736 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.462975 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.480667 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.504739 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.532197 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.532419 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.542536 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.542769 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.597974 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.598179 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.598269 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.598405 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.598489 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.598625 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.598706 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.598844 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.598935 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.599063 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.599145 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.599273 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.622511 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.622620 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.622773 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.622869 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.622972 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.623072 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.623191 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.623275 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.623405 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.623557 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.623676 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.623755 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.623873 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.623990 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.635133 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.635371 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.648037 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.648264 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.648393 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.648478 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.648626 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.648727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.648851 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.648935 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.649068 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.649151 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.649280 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.649365 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.649489 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.649699 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:34:37.667216 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.667429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 15:34:37.667530 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.667754 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 15:34:37.667838 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.667993 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 15:34:37.668075 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.668267 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.668351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 15:34:37.668526 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.668608 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.668778 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.668859 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.669030 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.669112 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.669281 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.680904 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.681175 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.681438 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.681711 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.682503 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.682778 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.683043 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.683318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.690026 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.691649 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.693324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.693599 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.693873 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.694146 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.694419 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.694672 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.694929 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.695045 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.695208 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.695315 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.695484 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.695565 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.695786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.695881 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.696064 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.696145 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.696320 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.696695 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.697409 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.697409 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.697628 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.697757 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.723139 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.724798 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.724906 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.725092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.726525 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.726801 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.730326 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.730603 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.730879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.732106 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.732383 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.732659 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.738708 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.738985 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.740961 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.741242 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.743722 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.744118 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.744396 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.744670 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.744936 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.745203 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.745466 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.745723 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.745810 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.746122 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.746404 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.746680 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.746949 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.747218 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.747484 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.747773 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.765164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.765432 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.770108 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.770421 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.770708 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.774355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.774649 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.776589 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.780029 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.780841 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.781134 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.784221 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.786287 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.787961 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.788257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.788543 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.788826 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.789103 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.789376 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.790126 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.795856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.796926 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.797215 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.798258 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.798544 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.798838 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.808452 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.808731 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.808991 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.809248 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.817278 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.818016 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.818298 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.818564 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.818824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.818982 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.819253 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.822292 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.822586 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.822862 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.823138 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.823409 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.826850 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.829097 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.829378 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.832456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.832735 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.833012 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.833295 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.833566 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.837356 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.837633 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.837916 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.838192 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.838466 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.838739 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.839012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.847625 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.847907 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.848185 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.848471 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.848749 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.849020 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.849298 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.858864 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.861032 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.864618 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.866214 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.867810 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.867914 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.868133 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.868410 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.871063 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.874997 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.876499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.876642 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.878089 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.878266 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.878550 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.878837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.881314 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.881608 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.881886 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.882158 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.886279 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.887921 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.891740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.891880 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.892027 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.892158 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.892309 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.892533 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.892617 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.900412 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.900695 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.900971 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.901239 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.901502 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.901723 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.901807 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.902008 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.902093 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.902282 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.902389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.902553 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.902821 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.903086 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.903347 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.903633 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.903896 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.910370 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:34:37.910646 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.910924 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.911198 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.911469 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.911766 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.912049 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.912330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.912599 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.912878 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.913152 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.913418 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.913681 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.913949 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:34:37.943323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562d67ba59c0 pid: 87191 (default app) May 23 15:34:37.946548 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e84e68-610a-4c81-95ed-d5a32bb18373 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:37.946839 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e84e68-610a-4c81-95ed-d5a32bb18373 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:37.947113 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e84e68-610a-4c81-95ed-d5a32bb18373 None None] PATH_INFO: `/v3` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:37.951378 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 791 bytes} [Mon May 23 15:34:37 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:34:37.953474 dv-cinder-842119-2-smb devstack@keystone.service[87192]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562d67ba59c0 pid: 87192 (default app) May 23 15:34:46.685926 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230e960-d0f1-4bd2-a9c9-a38a6f95c266 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:46.686503 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230e960-d0f1-4bd2-a9c9-a38a6f95c266 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:46.686503 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230e960-d0f1-4bd2-a9c9-a38a6f95c266 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:46.687831 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 2/2] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:34:46.696671 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9eb9f1-4022-4ba0-93a4-c8cdee5b4056 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:46.697098 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9eb9f1-4022-4ba0-93a4-c8cdee5b4056 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:46.697242 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9eb9f1-4022-4ba0-93a4-c8cdee5b4056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:46.774085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: INFO dbcounter [None req-6f9eb9f1-4022-4ba0-93a4-c8cdee5b4056 None None] Registered counter for database keystone May 23 15:34:46.796546 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG oslo_db.sqlalchemy.engines [None req-6f9eb9f1-4022-4ba0-93a4-c8cdee5b4056 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87192) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:34:46.803576 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writer thread running {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:34:47.009926 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG passlib.handlers.bcrypt [None req-6f9eb9f1-4022-4ba0-93a4-c8cdee5b4056 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87192) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 23 15:34:47.010274 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG passlib.handlers.bcrypt [None req-6f9eb9f1-4022-4ba0-93a4-c8cdee5b4056 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87192) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 23 15:34:47.067784 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-6f9eb9f1-4022-4ba0-93a4-c8cdee5b4056 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:34:47.069370 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-6f9eb9f1-4022-4ba0-93a4-c8cdee5b4056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:34:47.212934 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1/3] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:34:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 520 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 23 15:34:47.367997 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230e960-d0f1-4bd2-a9c9-a38a6f95c266 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:47.437317 dv-cinder-842119-2-smb devstack@keystone.service[87191]: INFO dbcounter [None req-a230e960-d0f1-4bd2-a9c9-a38a6f95c266 None None] Registered counter for database keystone May 23 15:34:47.457579 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG oslo_db.sqlalchemy.engines [None req-a230e960-d0f1-4bd2-a9c9-a38a6f95c266 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87191) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:34:47.464015 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writer thread running {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:34:47.585609 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230e960-d0f1-4bd2-a9c9-a38a6f95c266 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:47.590018 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d040b92-1ab6-45e8-b1e7-61ebad8cd877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:47.590687 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d040b92-1ab6-45e8-b1e7-61ebad8cd877 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:47.590970 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d040b92-1ab6-45e8-b1e7-61ebad8cd877 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:47.591246 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d040b92-1ab6-45e8-b1e7-61ebad8cd877 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:47.600356 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d040b92-1ab6-45e8-b1e7-61ebad8cd877 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:47.652468 dv-cinder-842119-2-smb devstack@keystone.service[87191]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1d040b92-1ab6-45e8-b1e7-61ebad8cd877 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 23 15:34:47.652745 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d040b92-1ab6-45e8-b1e7-61ebad8cd877 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:47.663081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 3/4] 10.222.0.39 () {58 vars in 1324 bytes} [Mon May 23 15:34:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 15:34:47.669065 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9eb9f1-4022-4ba0-93a4-c8cdee5b4056 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:47.684270 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9eb9f1-4022-4ba0-93a4-c8cdee5b4056 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:47.688789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85432192-1ec5-4c15-af07-2def30c1d34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:47.690061 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85432192-1ec5-4c15-af07-2def30c1d34d admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:47.690329 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85432192-1ec5-4c15-af07-2def30c1d34d admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:47.690602 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85432192-1ec5-4c15-af07-2def30c1d34d admin admin] PATH_INFO: `/v3/projects/c760023a56dc4c499f942685a1652dbf` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:47.692217 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85432192-1ec5-4c15-af07-2def30c1d34d admin admin] RBAC: Authorizing `identity:get_project(project_id=c760023a56dc4c499f942685a1652dbf)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:47.746191 dv-cinder-842119-2-smb devstack@keystone.service[87192]: WARNING keystone.common.rbac_enforcer.enforcer [None req-85432192-1ec5-4c15-af07-2def30c1d34d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 23 15:34:47.746744 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85432192-1ec5-4c15-af07-2def30c1d34d admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:47.751182 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 2/5] 10.222.0.39 () {56 vars in 1207 bytes} [Mon May 23 15:34:47 2022] GET /identity/v3/projects/c760023a56dc4c499f942685a1652dbf => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:34:49.904546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1181a-bb4a-4889-9b25-dccd8feb5b81 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:49.905092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1181a-bb4a-4889-9b25-dccd8feb5b81 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:49.905092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1181a-bb4a-4889-9b25-dccd8feb5b81 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:49.909676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 4/6] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:34:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:34:49.915053 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd750a56-d9d6-4c2e-9f3c-1b21ba0b625e None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:49.915431 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd750a56-d9d6-4c2e-9f3c-1b21ba0b625e None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:49.915628 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd750a56-d9d6-4c2e-9f3c-1b21ba0b625e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:49.934444 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-fd750a56-d9d6-4c2e-9f3c-1b21ba0b625e None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:34:49.935957 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-fd750a56-d9d6-4c2e-9f3c-1b21ba0b625e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:34:49.943809 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 3/7] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:34:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 23 15:34:49.965747 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1181a-bb4a-4889-9b25-dccd8feb5b81 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:49.978179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1181a-bb4a-4889-9b25-dccd8feb5b81 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:49.982362 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6d219-a3d7-4a0a-9c47-f7c6ae48bd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:49.982987 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6d219-a3d7-4a0a-9c47-f7c6ae48bd23 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:49.983272 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6d219-a3d7-4a0a-9c47-f7c6ae48bd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:49.983551 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6d219-a3d7-4a0a-9c47-f7c6ae48bd23 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:49.992045 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6d219-a3d7-4a0a-9c47-f7c6ae48bd23 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:49.993816 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6d219-a3d7-4a0a-9c47-f7c6ae48bd23 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:50.002547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 5/8] 10.222.0.39 () {58 vars in 1324 bytes} [Mon May 23 15:34:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 15:34:50.007812 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd750a56-d9d6-4c2e-9f3c-1b21ba0b625e None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:50.016715 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd750a56-d9d6-4c2e-9f3c-1b21ba0b625e None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:50.021033 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be21e43-238f-40b8-982d-b9c5956d433e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:50.021886 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be21e43-238f-40b8-982d-b9c5956d433e admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:50.022167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be21e43-238f-40b8-982d-b9c5956d433e admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:50.022441 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be21e43-238f-40b8-982d-b9c5956d433e admin admin] PATH_INFO: `/v3/users/e5936312ffff4fbfb32882db5724bdca` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:50.023842 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be21e43-238f-40b8-982d-b9c5956d433e admin admin] RBAC: Authorizing `identity:get_user(user_id=e5936312ffff4fbfb32882db5724bdca)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:50.025644 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be21e43-238f-40b8-982d-b9c5956d433e admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:50.027165 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 4/9] 10.222.0.39 () {56 vars in 1198 bytes} [Mon May 23 15:34:50 2022] GET /identity/v3/users/e5936312ffff4fbfb32882db5724bdca => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:34:52.313696 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa56de8-b5ba-4476-a159-e3b50ecad9ce None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:52.314221 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa56de8-b5ba-4476-a159-e3b50ecad9ce None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:52.314305 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa56de8-b5ba-4476-a159-e3b50ecad9ce None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:52.315639 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 6/10] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:34:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:34:52.320820 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bd972-6fc4-4095-bd70-39656ef746cb None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:52.321227 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bd972-6fc4-4095-bd70-39656ef746cb None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:52.321375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bd972-6fc4-4095-bd70-39656ef746cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:52.338380 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-c89bd972-6fc4-4095-bd70-39656ef746cb None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:34:52.339556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-c89bd972-6fc4-4095-bd70-39656ef746cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:34:52.377806 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56bdce-760d-4d96-b230-0424adde7407 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:52.378198 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56bdce-760d-4d96-b230-0424adde7407 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:52.378577 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56bdce-760d-4d96-b230-0424adde7407 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:52.380249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 7/11] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:34:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:34:52.386178 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429d9ce-e499-4448-aef5-aacfdc49edb8 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:52.386470 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429d9ce-e499-4448-aef5-aacfdc49edb8 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:52.386751 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429d9ce-e499-4448-aef5-aacfdc49edb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:52.419657 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 5/12] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:34:52.428755 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG passlib.handlers.bcrypt [None req-b429d9ce-e499-4448-aef5-aacfdc49edb8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87191) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 23 15:34:52.429186 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG passlib.handlers.bcrypt [None req-b429d9ce-e499-4448-aef5-aacfdc49edb8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87191) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 23 15:34:52.442918 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bd972-6fc4-4095-bd70-39656ef746cb None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:52.465298 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:52.475837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-b429d9ce-e499-4448-aef5-aacfdc49edb8 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:34:52.477434 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-b429d9ce-e499-4448-aef5-aacfdc49edb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:34:52.554214 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bd972-6fc4-4095-bd70-39656ef746cb None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:52.583641 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 8/13] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:34:52.587364 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924bbb5-c29d-4028-b1a3-f115fac4534f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:52.588185 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924bbb5-c29d-4028-b1a3-f115fac4534f None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:52.588464 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924bbb5-c29d-4028-b1a3-f115fac4534f None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:52.588732 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924bbb5-c29d-4028-b1a3-f115fac4534f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:52.599752 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924bbb5-c29d-4028-b1a3-f115fac4534f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:34:52.605688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429d9ce-e499-4448-aef5-aacfdc49edb8 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:52.611444 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-8924bbb5-c29d-4028-b1a3-f115fac4534f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:34:52.611444 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:34:52.611444 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:34:52.611444 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:34:52.611444 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:34:52.611444 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:34:52.611444 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:34:52.611444 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:34:52.611444 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:34:52.611444 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:34:52.611444 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:34:52.611444 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:34:52.611444 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:34:52.611444 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:34:52.611444 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:34:52.611444 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:34:52.612648 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:34:52.612648 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:34:52.612648 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:34:52.612648 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:34:52.612648 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:34:52.612648 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:34:52.612648 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:34:52.612648 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:34:52.612648 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:34:52.612648 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:34:52.612648 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:34:52.612648 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:34:52.612648 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:34:52.612648 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:34:52.612648 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:34:52.612648 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:34:52.613740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:34:52.613740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:34:52.613740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:34:52.613740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:34:52.613740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:34:52.613740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:34:52.613740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:34:52.613740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:34:52.613740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:34:52.613740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:34:52.613740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:34:52.613740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:34:52.613740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 6/14] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:34:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:34:52.618576 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924bbb5-c29d-4028-b1a3-f115fac4534f None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:52.817327 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:52.822589 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429d9ce-e499-4448-aef5-aacfdc49edb8 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:52.824942 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:52.836121 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924bbb5-c29d-4028-b1a3-f115fac4534f None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:52.861104 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df369b24-e6b1-45d1-858b-2dd49ffdb9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:52.867677 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df369b24-e6b1-45d1-858b-2dd49ffdb9e4 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:52.867677 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df369b24-e6b1-45d1-858b-2dd49ffdb9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:52.867677 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df369b24-e6b1-45d1-858b-2dd49ffdb9e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:52.869518 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d509b-bd09-4b89-b33a-b5aa2a2cb20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:52.870189 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d509b-bd09-4b89-b33a-b5aa2a2cb20f None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:52.870474 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d509b-bd09-4b89-b33a-b5aa2a2cb20f None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:52.870752 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d509b-bd09-4b89-b33a-b5aa2a2cb20f None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:52.871505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d509b-bd09-4b89-b33a-b5aa2a2cb20f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:34:52.871835 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d509b-bd09-4b89-b33a-b5aa2a2cb20f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:52.873249 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d509b-bd09-4b89-b33a-b5aa2a2cb20f None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:52.885802 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 7/15] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:34:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:34:52.892145 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d509b-bd09-4b89-b33a-b5aa2a2cb20f None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:52.934229 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df369b24-e6b1-45d1-858b-2dd49ffdb9e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:52.935781 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df369b24-e6b1-45d1-858b-2dd49ffdb9e4 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:52.990558 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d509b-bd09-4b89-b33a-b5aa2a2cb20f None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:53.023813 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e05d4-f63f-4772-9a66-1bbf7e292091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:53.024666 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e05d4-f63f-4772-9a66-1bbf7e292091 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:53.024947 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e05d4-f63f-4772-9a66-1bbf7e292091 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:53.025221 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e05d4-f63f-4772-9a66-1bbf7e292091 None admin] PATH_INFO: `/v3/users/e5936312ffff4fbfb32882db5724bdca` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:53.026404 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e05d4-f63f-4772-9a66-1bbf7e292091 None admin] RBAC: Authorizing `identity:get_user(user_id=e5936312ffff4fbfb32882db5724bdca)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:53.027876 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e05d4-f63f-4772-9a66-1bbf7e292091 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:53.029479 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 8/16] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:34:52 2022] GET /identity/v3/users/e5936312ffff4fbfb32882db5724bdca => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:34:53.033333 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 9/17] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:34:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 15:34:53.035227 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e05d4-f63f-4772-9a66-1bbf7e292091 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:53.038671 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df369b24-e6b1-45d1-858b-2dd49ffdb9e4 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:53.041359 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:53.049609 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:53.134430 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e05d4-f63f-4772-9a66-1bbf7e292091 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:53.136863 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df369b24-e6b1-45d1-858b-2dd49ffdb9e4 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:53.168187 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f46b7-9a67-4c09-836b-35d8aba14ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:53.168973 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f46b7-9a67-4c09-836b-35d8aba14ff8 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:53.169258 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f46b7-9a67-4c09-836b-35d8aba14ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:53.169533 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f46b7-9a67-4c09-836b-35d8aba14ff8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:53.170695 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f46b7-9a67-4c09-836b-35d8aba14ff8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:53.171176 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa91177-2835-4307-841d-0c5ccf103eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:53.172507 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa91177-2835-4307-841d-0c5ccf103eff None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:53.172789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f46b7-9a67-4c09-836b-35d8aba14ff8 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:53.172888 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa91177-2835-4307-841d-0c5ccf103eff None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:53.173301 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa91177-2835-4307-841d-0c5ccf103eff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:53.174395 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 9/18] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:34:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:34:53.180219 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f46b7-9a67-4c09-836b-35d8aba14ff8 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:53.197880 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa91177-2835-4307-841d-0c5ccf103eff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:53.199497 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa91177-2835-4307-841d-0c5ccf103eff None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:53.220897 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-faa91177-2835-4307-841d-0c5ccf103eff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:34:53.220897 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:34:53.220897 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:34:53.220897 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:34:53.220897 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:34:53.220897 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:34:53.220897 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:34:53.220897 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:34:53.220897 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:34:53.220897 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:34:53.220897 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:34:53.220897 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:34:53.220897 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:34:53.220897 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:34:53.220897 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:34:53.221969 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:34:53.221969 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:34:53.221969 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:34:53.221969 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:34:53.221969 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:34:53.221969 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:34:53.221969 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:34:53.221969 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:34:53.221969 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:34:53.221969 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:34:53.221969 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:34:53.221969 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:34:53.221969 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:34:53.221969 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:34:53.221969 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:34:53.221969 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:34:53.221969 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:34:53.222868 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:34:53.222868 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:34:53.222868 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:34:53.222868 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:34:53.222868 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 10/19] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:34:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:34:53.227831 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa91177-2835-4307-841d-0c5ccf103eff None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:53.270700 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:53.284492 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:53.289812 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f46b7-9a67-4c09-836b-35d8aba14ff8 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:53.324743 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d503a3-5017-490c-b1d4-9dabb9ac78b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:53.325486 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d503a3-5017-490c-b1d4-9dabb9ac78b5 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:53.325772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d503a3-5017-490c-b1d4-9dabb9ac78b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:53.326050 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d503a3-5017-490c-b1d4-9dabb9ac78b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:53.326881 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d503a3-5017-490c-b1d4-9dabb9ac78b5 None admin] RBAC: Adding query filter params (role.id=3ab888f5f68740bd8f9df4447f4f5a7a, scope.domain.id=default, user.id=e5936312ffff4fbfb32882db5724bdca) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:34:53.327193 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d503a3-5017-490c-b1d4-9dabb9ac78b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:53.328733 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d503a3-5017-490c-b1d4-9dabb9ac78b5 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:53.329389 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa91177-2835-4307-841d-0c5ccf103eff None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:53.335493 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 10/20] 10.222.0.39 () {56 vars in 1322 bytes} [Mon May 23 15:34:53 2022] GET /identity/v3/role_assignments?user.id=e5936312ffff4fbfb32882db5724bdca&scope.domain.id=default&role.id=3ab888f5f68740bd8f9df4447f4f5a7a => generated 233 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:34:53.365911 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf95fd-b455-4acc-8b26-fe6ebce1ab4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:53.366668 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf95fd-b455-4acc-8b26-fe6ebce1ab4e None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:53.366958 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf95fd-b455-4acc-8b26-fe6ebce1ab4e None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:53.367234 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf95fd-b455-4acc-8b26-fe6ebce1ab4e None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:53.368018 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf95fd-b455-4acc-8b26-fe6ebce1ab4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:34:53.368330 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf95fd-b455-4acc-8b26-fe6ebce1ab4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:53.369759 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf95fd-b455-4acc-8b26-fe6ebce1ab4e None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:53.389895 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 11/21] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:34:55.941466 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64196276-6524-46d9-ae01-3f007e9738ac None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:55.942511 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64196276-6524-46d9-ae01-3f007e9738ac None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:55.942994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64196276-6524-46d9-ae01-3f007e9738ac None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:55.944855 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 11/22] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:34:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:34:55.950192 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba0e52-b811-49fa-b008-d64a25ef7cb5 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:55.951132 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba0e52-b811-49fa-b008-d64a25ef7cb5 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:55.951636 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba0e52-b811-49fa-b008-d64a25ef7cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:55.976981 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-0bba0e52-b811-49fa-b008-d64a25ef7cb5 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:34:55.978496 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-0bba0e52-b811-49fa-b008-d64a25ef7cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:34:56.061801 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 12/23] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:34:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:34:56.100862 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64196276-6524-46d9-ae01-3f007e9738ac None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:56.248490 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64196276-6524-46d9-ae01-3f007e9738ac None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:56.300515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a708ee-03c6-4d8c-9e53-700e267e502d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:56.301336 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a708ee-03c6-4d8c-9e53-700e267e502d None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:56.301623 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a708ee-03c6-4d8c-9e53-700e267e502d None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:56.301904 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a708ee-03c6-4d8c-9e53-700e267e502d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:56.304809 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34790e43-0cf5-40e2-892c-b774f03ca911 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:56.305377 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34790e43-0cf5-40e2-892c-b774f03ca911 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:56.305847 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34790e43-0cf5-40e2-892c-b774f03ca911 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:56.311770 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 13/24] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:34:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:34:56.313507 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51253f-dadb-4eca-84aa-969f9e115f30 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:56.313996 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51253f-dadb-4eca-84aa-969f9e115f30 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:56.314462 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51253f-dadb-4eca-84aa-969f9e115f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:56.315834 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a708ee-03c6-4d8c-9e53-700e267e502d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:56.323620 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a708ee-03c6-4d8c-9e53-700e267e502d None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:56.326513 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:56.347974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-70a708ee-03c6-4d8c-9e53-700e267e502d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:34:56.347974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:34:56.347974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:34:56.347974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:34:56.347974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:34:56.347974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:34:56.347974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:34:56.347974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:34:56.347974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:34:56.347974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:34:56.347974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:34:56.347974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:34:56.347974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:34:56.347974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:34:56.347974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:34:56.349068 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:34:56.349068 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:34:56.349068 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:34:56.349068 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:34:56.349068 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:34:56.349068 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:34:56.349068 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:34:56.349068 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:34:56.349068 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:34:56.349068 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:34:56.349068 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:34:56.349068 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:34:56.349068 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:34:56.349068 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:34:56.349068 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:34:56.349068 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:34:56.349068 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:34:56.349862 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:34:56.349862 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:34:56.349862 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:34:56.349862 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:34:56.349862 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 12/25] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:34:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:34:56.358989 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a708ee-03c6-4d8c-9e53-700e267e502d None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:56.360877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-dc51253f-dadb-4eca-84aa-969f9e115f30 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:34:56.362090 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-dc51253f-dadb-4eca-84aa-969f9e115f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:34:56.471769 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:56.500579 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 14/26] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:34:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:34:56.502307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a285edd-c2b4-408f-b937-5af5bb47f5dc None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:56.502798 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a285edd-c2b4-408f-b937-5af5bb47f5dc None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:56.503336 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a285edd-c2b4-408f-b937-5af5bb47f5dc None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:56.505155 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 15/27] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:34:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:34:56.506471 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f28fcc-8eb8-456f-9d66-d27d3335cd15 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:56.507038 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f28fcc-8eb8-456f-9d66-d27d3335cd15 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:56.507631 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f28fcc-8eb8-456f-9d66-d27d3335cd15 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:56.509056 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 16/28] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:34:56.510498 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c48dfb-8139-43df-9de6-2c4c80d4b070 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:56.511101 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c48dfb-8139-43df-9de6-2c4c80d4b070 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:56.511628 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c48dfb-8139-43df-9de6-2c4c80d4b070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:56.519660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a708ee-03c6-4d8c-9e53-700e267e502d None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:56.530816 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-f3c48dfb-8139-43df-9de6-2c4c80d4b070 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:34:56.532370 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-f3c48dfb-8139-43df-9de6-2c4c80d4b070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:34:56.555579 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2545db-6562-40fe-bbc0-58547fa35620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:56.556272 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2545db-6562-40fe-bbc0-58547fa35620 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:56.556561 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2545db-6562-40fe-bbc0-58547fa35620 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:56.556833 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2545db-6562-40fe-bbc0-58547fa35620 None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:56.557722 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2545db-6562-40fe-bbc0-58547fa35620 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:34:56.558174 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2545db-6562-40fe-bbc0-58547fa35620 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:56.559922 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2545db-6562-40fe-bbc0-58547fa35620 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:56.579310 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 13/29] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:34:56.581118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c801787-b902-4f1c-9cbe-245e753e1342 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:56.581552 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c801787-b902-4f1c-9cbe-245e753e1342 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:56.582071 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c801787-b902-4f1c-9cbe-245e753e1342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:56.600006 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-2c801787-b902-4f1c-9cbe-245e753e1342 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:34:56.601468 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-2c801787-b902-4f1c-9cbe-245e753e1342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:34:56.608343 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 17/30] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:34:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:34:56.609613 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c48dfb-8139-43df-9de6-2c4c80d4b070 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:56.663294 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:56.685625 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 14/31] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:34:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:34:56.688732 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c801787-b902-4f1c-9cbe-245e753e1342 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:56.744663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c48dfb-8139-43df-9de6-2c4c80d4b070 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:56.753618 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:56.781930 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95531c4d-725e-47ab-8dcc-ea4d766883fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:56.783031 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95531c4d-725e-47ab-8dcc-ea4d766883fa None admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:56.783523 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95531c4d-725e-47ab-8dcc-ea4d766883fa None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:56.784015 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95531c4d-725e-47ab-8dcc-ea4d766883fa None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:56.785068 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95531c4d-725e-47ab-8dcc-ea4d766883fa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:56.787094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95531c4d-725e-47ab-8dcc-ea4d766883fa None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:56.822164 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c801787-b902-4f1c-9cbe-245e753e1342 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:56.858960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ec844-a1c7-445c-8297-23b91103655f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:56.859806 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ec844-a1c7-445c-8297-23b91103655f None admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:56.860096 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ec844-a1c7-445c-8297-23b91103655f None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:56.860395 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ec844-a1c7-445c-8297-23b91103655f None admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:56.861141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ec844-a1c7-445c-8297-23b91103655f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:56.862783 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ec844-a1c7-445c-8297-23b91103655f None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:56.996051 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 18/32] 10.222.0.39 () {60 vars in 1131 bytes} [Mon May 23 15:34:56 2022] POST /identity/v3/roles => generated 219 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:34:56.997739 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95531c4d-725e-47ab-8dcc-ea4d766883fa None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:57.078793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 15/33] 10.222.0.39 () {60 vars in 1141 bytes} [Mon May 23 15:34:56 2022] POST /identity/v3/projects => generated 301 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:34:57.083650 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ec844-a1c7-445c-8297-23b91103655f None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:57.183981 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:57.254076 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95531c4d-725e-47ab-8dcc-ea4d766883fa None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:57.280197 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ec844-a1c7-445c-8297-23b91103655f None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:57.323806 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b32c6-241d-41dd-bc03-056a7182e8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:57.324852 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b32c6-241d-41dd-bc03-056a7182e8a4 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:57.325149 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b32c6-241d-41dd-bc03-056a7182e8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:57.325431 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b32c6-241d-41dd-bc03-056a7182e8a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:57.340505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b32c6-241d-41dd-bc03-056a7182e8a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:34:57.344474 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca638624-a044-4337-b783-5095c1aa7ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:57.345517 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca638624-a044-4337-b783-5095c1aa7ee8 None admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:57.345808 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca638624-a044-4337-b783-5095c1aa7ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:57.346092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca638624-a044-4337-b783-5095c1aa7ee8 None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:57.346872 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca638624-a044-4337-b783-5095c1aa7ee8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:57.348463 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca638624-a044-4337-b783-5095c1aa7ee8 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:57.349048 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-9a7b32c6-241d-41dd-bc03-056a7182e8a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:34:57.349048 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:34:57.349048 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:34:57.349048 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:34:57.349048 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:34:57.349048 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:34:57.349048 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:34:57.349048 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:34:57.349048 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:34:57.349048 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:34:57.349048 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:34:57.349048 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:34:57.349048 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:34:57.349048 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:34:57.349048 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:34:57.349048 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:34:57.349863 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:34:57.349863 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:34:57.349863 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:34:57.349863 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:34:57.349863 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:34:57.349863 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:34:57.349863 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:34:57.349863 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:34:57.349863 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:34:57.349863 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:34:57.349863 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:34:57.349863 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:34:57.349863 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:34:57.349863 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:34:57.349863 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:34:57.349863 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:34:57.350713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:34:57.350713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:34:57.350713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:34:57.350713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:34:57.350713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:34:57.350713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:34:57.350713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:34:57.350713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:34:57.350713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:34:57.350713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:34:57.350713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:34:57.350713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:34:57.350713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 16/34] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:34:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:34:57.360426 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b32c6-241d-41dd-bc03-056a7182e8a4 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:57.440557 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 19/35] 10.222.0.39 () {60 vars in 1131 bytes} [Mon May 23 15:34:56 2022] POST /identity/v3/roles => generated 225 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:34:57.498919 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:57.504644 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b32c6-241d-41dd-bc03-056a7182e8a4 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:57.535180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebb014-1fc2-47dc-99e3-81410ecc829e None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:57.535482 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebb014-1fc2-47dc-99e3-81410ecc829e None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:57.535783 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebb014-1fc2-47dc-99e3-81410ecc829e None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:57.537342 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 20/36] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:34:57.547981 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9213ec-2271-4697-95d7-e0a43b0f9992 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:57.548315 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9213ec-2271-4697-95d7-e0a43b0f9992 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:57.548551 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9213ec-2271-4697-95d7-e0a43b0f9992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:57.553409 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2bdf4-16b8-47d1-8276-5ba9e57c4aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:57.554106 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2bdf4-16b8-47d1-8276-5ba9e57c4aa5 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:57.554388 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2bdf4-16b8-47d1-8276-5ba9e57c4aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:57.554665 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2bdf4-16b8-47d1-8276-5ba9e57c4aa5 None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:57.555441 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2bdf4-16b8-47d1-8276-5ba9e57c4aa5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:34:57.555785 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2bdf4-16b8-47d1-8276-5ba9e57c4aa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:57.558791 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2bdf4-16b8-47d1-8276-5ba9e57c4aa5 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:57.572170 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 17/37] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:34:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:34:57.576566 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-fd9213ec-2271-4697-95d7-e0a43b0f9992 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:34:57.576816 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-fd9213ec-2271-4697-95d7-e0a43b0f9992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:34:57.578218 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2bdf4-16b8-47d1-8276-5ba9e57c4aa5 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:57.606460 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:57.660327 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 21/38] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:34:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:34:57.668559 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260609f-bf83-495c-90ea-6c0b53399e0e None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:57.668875 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260609f-bf83-495c-90ea-6c0b53399e0e None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:57.669132 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260609f-bf83-495c-90ea-6c0b53399e0e None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:57.670647 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 22/39] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:34:57.677373 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9960c4d-65c3-41b2-a15a-0495d191cb58 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:57.677660 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9960c4d-65c3-41b2-a15a-0495d191cb58 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:57.678134 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9960c4d-65c3-41b2-a15a-0495d191cb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:57.697022 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-a9960c4d-65c3-41b2-a15a-0495d191cb58 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:34:57.698244 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-a9960c4d-65c3-41b2-a15a-0495d191cb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:34:57.711283 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2bdf4-16b8-47d1-8276-5ba9e57c4aa5 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:57.753207 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8d2f5-c7d8-4f81-acbf-833ef1fb2a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:57.754116 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8d2f5-c7d8-4f81-acbf-833ef1fb2a5c None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:57.754751 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8d2f5-c7d8-4f81-acbf-833ef1fb2a5c None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:57.754751 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8d2f5-c7d8-4f81-acbf-833ef1fb2a5c None admin] PATH_INFO: `/v3/users/e5936312ffff4fbfb32882db5724bdca` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:57.756013 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d8d2f5-c7d8-4f81-acbf-833ef1fb2a5c None admin] RBAC: Authorizing `identity:get_user(user_id=e5936312ffff4fbfb32882db5724bdca)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:57.758198 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d8d2f5-c7d8-4f81-acbf-833ef1fb2a5c None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:57.759102 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 18/40] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:34:57 2022] GET /identity/v3/users/e5936312ffff4fbfb32882db5724bdca => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:34:57.759903 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8d2f5-c7d8-4f81-acbf-833ef1fb2a5c None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:57.777616 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 23/41] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:34:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:34:57.778460 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9960c4d-65c3-41b2-a15a-0495d191cb58 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:57.790617 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:57.863925 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8d2f5-c7d8-4f81-acbf-833ef1fb2a5c None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:57.865558 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:57.880730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9960c4d-65c3-41b2-a15a-0495d191cb58 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:57.898524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55351bfe-917f-4e88-aecb-7cb50c58250b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:57.899195 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55351bfe-917f-4e88-aecb-7cb50c58250b None admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:57.899488 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55351bfe-917f-4e88-aecb-7cb50c58250b None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:57.899796 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55351bfe-917f-4e88-aecb-7cb50c58250b None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:57.900637 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55351bfe-917f-4e88-aecb-7cb50c58250b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:57.902052 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55351bfe-917f-4e88-aecb-7cb50c58250b None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:57.914221 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56492ccb-06ab-4ac1-bf28-6a4ba35791b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:57.915017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56492ccb-06ab-4ac1-bf28-6a4ba35791b4 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:57.915306 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56492ccb-06ab-4ac1-bf28-6a4ba35791b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:57.918199 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56492ccb-06ab-4ac1-bf28-6a4ba35791b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:57.918199 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56492ccb-06ab-4ac1-bf28-6a4ba35791b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:57.918529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56492ccb-06ab-4ac1-bf28-6a4ba35791b4 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:57.920196 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 24/42] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:34:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:34:57.921036 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56492ccb-06ab-4ac1-bf28-6a4ba35791b4 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:57.995892 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 19/43] 10.222.0.39 () {60 vars in 1131 bytes} [Mon May 23 15:34:57 2022] POST /identity/v3/roles => generated 223 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:34:57.996695 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55351bfe-917f-4e88-aecb-7cb50c58250b None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:58.034969 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56492ccb-06ab-4ac1-bf28-6a4ba35791b4 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:58.076266 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca509a-f2e3-4b1f-a9cd-8747f11e9cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:58.077085 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca509a-f2e3-4b1f-a9cd-8747f11e9cba None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:58.077361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca509a-f2e3-4b1f-a9cd-8747f11e9cba None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:58.077637 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca509a-f2e3-4b1f-a9cd-8747f11e9cba None admin] PATH_INFO: `/v3/domains/default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:58.079052 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca509a-f2e3-4b1f-a9cd-8747f11e9cba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:58.080633 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca509a-f2e3-4b1f-a9cd-8747f11e9cba None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:58.082349 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 25/44] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:34:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:34:58.088154 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca509a-f2e3-4b1f-a9cd-8747f11e9cba None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:58.107148 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:58.116998 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:58.122261 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55351bfe-917f-4e88-aecb-7cb50c58250b None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:58.161789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71993c92-b302-4df4-aa23-05565388ddb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:58.162687 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71993c92-b302-4df4-aa23-05565388ddb4 None admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:58.162972 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71993c92-b302-4df4-aa23-05565388ddb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:58.163251 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71993c92-b302-4df4-aa23-05565388ddb4 None admin] PATH_INFO: `/v3/domains/default/users/e5936312ffff4fbfb32882db5724bdca/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:58.165466 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71993c92-b302-4df4-aa23-05565388ddb4 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e5936312ffff4fbfb32882db5724bdca, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:58.167078 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71993c92-b302-4df4-aa23-05565388ddb4 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:58.198171 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca509a-f2e3-4b1f-a9cd-8747f11e9cba None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:58.236192 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2ba98-96a0-4997-b62c-39bb0d7b31a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:58.236863 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2ba98-96a0-4997-b62c-39bb0d7b31a9 None admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:58.237157 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2ba98-96a0-4997-b62c-39bb0d7b31a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:58.240523 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2ba98-96a0-4997-b62c-39bb0d7b31a9 None admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:58.240523 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2ba98-96a0-4997-b62c-39bb0d7b31a9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:58.240523 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2ba98-96a0-4997-b62c-39bb0d7b31a9 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:58.243846 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 20/45] 10.222.0.39 () {58 vars in 1361 bytes} [Mon May 23 15:34:57 2022] PUT /identity/v3/domains/default/users/e5936312ffff4fbfb32882db5724bdca/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:34:58.324992 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 26/46] 10.222.0.39 () {60 vars in 1141 bytes} [Mon May 23 15:34:58 2022] POST /identity/v3/projects => generated 312 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:35:00.439681 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08001497-6401-4030-8e0d-e7c715f27ca1 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:00.440213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08001497-6401-4030-8e0d-e7c715f27ca1 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:00.440296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08001497-6401-4030-8e0d-e7c715f27ca1 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:00.441745 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 21/47] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:00.447158 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37963939-1bf8-4d79-94a8-5c150c548fea None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:00.447537 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37963939-1bf8-4d79-94a8-5c150c548fea None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:00.447767 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37963939-1bf8-4d79-94a8-5c150c548fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:00.465726 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-37963939-1bf8-4d79-94a8-5c150c548fea None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:00.466852 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-37963939-1bf8-4d79-94a8-5c150c548fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:00.533253 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 27/48] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:00.538659 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b39d6-d180-4074-bf62-23a4cad95943 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:00.539047 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b39d6-d180-4074-bf62-23a4cad95943 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:00.539333 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b39d6-d180-4074-bf62-23a4cad95943 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:00.540751 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 22/49] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:00.545722 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4df03-d3c2-44f3-a57b-bfe535a874f1 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:00.546018 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4df03-d3c2-44f3-a57b-bfe535a874f1 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:00.546303 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4df03-d3c2-44f3-a57b-bfe535a874f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:00.552733 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:00.557660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b39d6-d180-4074-bf62-23a4cad95943 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:00.564171 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-91f4df03-d3c2-44f3-a57b-bfe535a874f1 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:00.565355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-91f4df03-d3c2-44f3-a57b-bfe535a874f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:00.635463 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 28/50] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:35:00.658833 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4df03-d3c2-44f3-a57b-bfe535a874f1 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:00.659096 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b39d6-d180-4074-bf62-23a4cad95943 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:00.692335 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a78052-be43-418f-b8e2-1d015095d659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:00.693116 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a78052-be43-418f-b8e2-1d015095d659 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:00.693401 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a78052-be43-418f-b8e2-1d015095d659 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:00.693674 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a78052-be43-418f-b8e2-1d015095d659 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:00.704126 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a78052-be43-418f-b8e2-1d015095d659 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:00.711655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-89a78052-be43-418f-b8e2-1d015095d659 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:35:00.711655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:00.711655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:00.711655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:00.711655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:00.711655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:00.711655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:00.711655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:00.711655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:00.711655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:00.711655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:00.711655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:00.711655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:00.711655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:00.711655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:00.711655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:00.712521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:00.712521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:00.712521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:00.712521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:00.712521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:00.712521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:00.712521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:00.712521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:00.712521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:00.712521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:00.712521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:00.712521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:35:00.712521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:00.712521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:00.712521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:00.712521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:00.713461 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:00.713461 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:00.713461 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:00.713461 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:00.713461 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:00.713461 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:00.713461 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:00.713461 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:00.713461 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:00.713461 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:00.713461 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:35:00.713461 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:35:00.713461 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 23/51] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:35:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:35:00.719010 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a78052-be43-418f-b8e2-1d015095d659 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:00.729647 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:00.756951 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4df03-d3c2-44f3-a57b-bfe535a874f1 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:00.791175 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c52c5-a214-42be-a0ee-242166cc79f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:00.792096 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c52c5-a214-42be-a0ee-242166cc79f6 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:00.792392 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c52c5-a214-42be-a0ee-242166cc79f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:00.792673 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c52c5-a214-42be-a0ee-242166cc79f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:00.793871 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c52c5-a214-42be-a0ee-242166cc79f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:00.795347 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c52c5-a214-42be-a0ee-242166cc79f6 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:00.797336 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 29/52] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:35:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:35:00.802456 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c52c5-a214-42be-a0ee-242166cc79f6 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:00.805076 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:00.821342 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a78052-be43-418f-b8e2-1d015095d659 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:00.855180 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8533e-b705-4537-b46a-b13a4be42956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:00.855872 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8533e-b705-4537-b46a-b13a4be42956 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:00.856158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8533e-b705-4537-b46a-b13a4be42956 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:00.856429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8533e-b705-4537-b46a-b13a4be42956 None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:00.857176 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8533e-b705-4537-b46a-b13a4be42956 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:00.857603 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8533e-b705-4537-b46a-b13a4be42956 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:00.858864 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8533e-b705-4537-b46a-b13a4be42956 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:00.866960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 24/53] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:00.872401 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8533e-b705-4537-b46a-b13a4be42956 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:00.905347 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c52c5-a214-42be-a0ee-242166cc79f6 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:00.940219 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c176b-0f22-403d-b1ab-b79c8f8c42cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:00.940882 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c176b-0f22-403d-b1ab-b79c8f8c42cb None admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:00.941175 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c176b-0f22-403d-b1ab-b79c8f8c42cb None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:00.941458 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c176b-0f22-403d-b1ab-b79c8f8c42cb None admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:00.942223 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c176b-0f22-403d-b1ab-b79c8f8c42cb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:00.942380 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:00.943674 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c176b-0f22-403d-b1ab-b79c8f8c42cb None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:00.973565 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8533e-b705-4537-b46a-b13a4be42956 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:01.006989 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ba5a3-4788-41c7-8f17-d864f2c75ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:01.007911 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ba5a3-4788-41c7-8f17-d864f2c75ea0 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:01.008201 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ba5a3-4788-41c7-8f17-d864f2c75ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:01.008479 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ba5a3-4788-41c7-8f17-d864f2c75ea0 None admin] PATH_INFO: `/v3/users/e5936312ffff4fbfb32882db5724bdca` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:01.009679 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ba5a3-4788-41c7-8f17-d864f2c75ea0 None admin] RBAC: Authorizing `identity:get_user(user_id=e5936312ffff4fbfb32882db5724bdca)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:01.011140 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ba5a3-4788-41c7-8f17-d864f2c75ea0 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:01.012800 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 25/54] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:35:00 2022] GET /identity/v3/users/e5936312ffff4fbfb32882db5724bdca => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:35:01.018593 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ba5a3-4788-41c7-8f17-d864f2c75ea0 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:01.038985 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 30/55] 10.222.0.39 () {60 vars in 1140 bytes} [Mon May 23 15:35:00 2022] POST /identity/v3/projects => generated 298 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:35:01.125934 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ba5a3-4788-41c7-8f17-d864f2c75ea0 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:01.162887 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a56660-4a90-4b25-b665-2dbc1d2068a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:01.163751 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a56660-4a90-4b25-b665-2dbc1d2068a8 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:01.164043 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a56660-4a90-4b25-b665-2dbc1d2068a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:01.164321 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a56660-4a90-4b25-b665-2dbc1d2068a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:01.165581 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a56660-4a90-4b25-b665-2dbc1d2068a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:01.167088 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a56660-4a90-4b25-b665-2dbc1d2068a8 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:01.169016 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 26/56] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:35:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:35:01.175175 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c176b-0f22-403d-b1ab-b79c8f8c42cb None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:01.265450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:01.290246 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c176b-0f22-403d-b1ab-b79c8f8c42cb None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:01.325000 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf853c-34e8-4fdc-b1ab-e5f97befaa0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:01.325678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf853c-34e8-4fdc-b1ab-e5f97befaa0a None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:01.325944 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf853c-34e8-4fdc-b1ab-e5f97befaa0a None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:01.326309 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf853c-34e8-4fdc-b1ab-e5f97befaa0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:01.327146 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf853c-34e8-4fdc-b1ab-e5f97befaa0a None admin] RBAC: Adding query filter params (role.id=3ab888f5f68740bd8f9df4447f4f5a7a, scope.domain.id=default, user.id=e5936312ffff4fbfb32882db5724bdca) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:01.327460 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf853c-34e8-4fdc-b1ab-e5f97befaa0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:01.329584 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf853c-34e8-4fdc-b1ab-e5f97befaa0a None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:01.338144 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 31/57] 10.222.0.39 () {56 vars in 1322 bytes} [Mon May 23 15:35:01 2022] GET /identity/v3/role_assignments?user.id=e5936312ffff4fbfb32882db5724bdca&scope.domain.id=default&role.id=3ab888f5f68740bd8f9df4447f4f5a7a => generated 530 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:03.246547 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a21edd-7b6b-412b-ac0b-8e0d80a3666e None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:03.246973 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a21edd-7b6b-412b-ac0b-8e0d80a3666e None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:03.247114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a21edd-7b6b-412b-ac0b-8e0d80a3666e None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:03.248511 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 27/58] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:03.254242 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444af072-f901-4717-8636-45568c182332 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:03.254652 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444af072-f901-4717-8636-45568c182332 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:03.254815 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444af072-f901-4717-8636-45568c182332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:03.271615 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-444af072-f901-4717-8636-45568c182332 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:03.272797 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-444af072-f901-4717-8636-45568c182332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:03.336681 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 32/59] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:03.361696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a21edd-7b6b-412b-ac0b-8e0d80a3666e None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:03.371033 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:03.461398 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a21edd-7b6b-412b-ac0b-8e0d80a3666e None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:03.494023 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf198f5-447b-414e-8ab0-414ea3b9c8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:03.494742 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf198f5-447b-414e-8ab0-414ea3b9c8a8 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:03.495024 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf198f5-447b-414e-8ab0-414ea3b9c8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:03.495295 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf198f5-447b-414e-8ab0-414ea3b9c8a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:03.496475 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf198f5-447b-414e-8ab0-414ea3b9c8a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:03.497918 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf198f5-447b-414e-8ab0-414ea3b9c8a8 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:03.499575 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 28/60] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:35:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:03.505050 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444af072-f901-4717-8636-45568c182332 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:03.552869 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:03.601868 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444af072-f901-4717-8636-45568c182332 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:03.634613 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d1ac0-c7ad-48ea-b589-49f715a6123e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:03.635268 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d1ac0-c7ad-48ea-b589-49f715a6123e None admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:03.635553 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d1ac0-c7ad-48ea-b589-49f715a6123e None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:03.635862 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d1ac0-c7ad-48ea-b589-49f715a6123e None admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:03.636572 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d1ac0-c7ad-48ea-b589-49f715a6123e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:03.638015 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d1ac0-c7ad-48ea-b589-49f715a6123e None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:03.723210 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 33/61] 10.222.0.39 () {60 vars in 1132 bytes} [Mon May 23 15:35:03 2022] POST /identity/v3/users => generated 275 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:35:07.034490 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273e2bc-3beb-460e-b219-54c4088e887b None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:07.035003 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273e2bc-3beb-460e-b219-54c4088e887b None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:07.035077 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273e2bc-3beb-460e-b219-54c4088e887b None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:07.036690 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 29/62] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:07.042183 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20ce85-3ef7-4742-a4eb-c72c638cf66c None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:07.042963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20ce85-3ef7-4742-a4eb-c72c638cf66c None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:07.043394 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20ce85-3ef7-4742-a4eb-c72c638cf66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:07.071869 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-ea20ce85-3ef7-4742-a4eb-c72c638cf66c None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:07.074154 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-ea20ce85-3ef7-4742-a4eb-c72c638cf66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:07.085257 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a35f1-cd1c-494e-b730-3f091727c1a9 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:07.086327 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a35f1-cd1c-494e-b730-3f091727c1a9 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:07.086822 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a35f1-cd1c-494e-b730-3f091727c1a9 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:07.088840 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 30/63] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:35:07.095968 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396b34f-3758-47e7-8e80-57924fa89ed7 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:07.096533 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396b34f-3758-47e7-8e80-57924fa89ed7 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:07.097234 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396b34f-3758-47e7-8e80-57924fa89ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:07.132683 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-2396b34f-3758-47e7-8e80-57924fa89ed7 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:07.139644 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-2396b34f-3758-47e7-8e80-57924fa89ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:07.184711 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 34/64] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:07.223872 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20ce85-3ef7-4742-a4eb-c72c638cf66c None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:07.284709 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:07.285228 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 31/65] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:35:07.306400 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396b34f-3758-47e7-8e80-57924fa89ed7 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:07.310357 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:07.421230 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20ce85-3ef7-4742-a4eb-c72c638cf66c None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:07.447363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396b34f-3758-47e7-8e80-57924fa89ed7 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:07.471376 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1ec2a-aea7-42eb-850b-fb8b8b456811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:07.472552 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1ec2a-aea7-42eb-850b-fb8b8b456811 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:07.473064 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1ec2a-aea7-42eb-850b-fb8b8b456811 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:07.473542 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1ec2a-aea7-42eb-850b-fb8b8b456811 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:07.485546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1ec2a-aea7-42eb-850b-fb8b8b456811 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:07.489371 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efacea9d-834c-444b-9430-e36065699805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:07.490168 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacea9d-834c-444b-9430-e36065699805 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:07.490456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacea9d-834c-444b-9430-e36065699805 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:07.490732 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacea9d-834c-444b-9430-e36065699805 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:07.496675 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-76a1ec2a-aea7-42eb-850b-fb8b8b456811 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:35:07.496675 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:07.496675 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:07.496675 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:07.496675 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:07.496675 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:07.496675 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:07.496675 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:07.496675 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:07.496675 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:07.496675 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:07.496675 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:07.496675 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:07.496675 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:07.496675 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:07.496675 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:07.497535 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:07.497535 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:07.497535 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:07.497535 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:07.497535 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:07.497535 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:07.497535 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:07.497535 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:07.497535 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:07.497535 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:07.497535 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:07.497535 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:35:07.497535 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:07.497535 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:07.497535 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:07.497535 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:07.498281 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:07.498281 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:07.498281 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:07.498281 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:07.498281 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:07.498281 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:07.498281 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:07.498281 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:07.498281 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:07.498281 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:07.498281 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:35:07.498281 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:35:07.501233 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 35/66] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:35:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:35:07.505878 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efacea9d-834c-444b-9430-e36065699805 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:07.507419 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444e171-6c8c-4e67-9cdb-8fdd6785fda9 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:07.507954 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444e171-6c8c-4e67-9cdb-8fdd6785fda9 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:07.508434 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444e171-6c8c-4e67-9cdb-8fdd6785fda9 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:07.509658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-efacea9d-834c-444b-9430-e36065699805 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:07.509658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:07.509658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:07.509658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:07.509658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:07.509658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:07.509658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:07.509658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:07.509658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:07.509658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:07.509658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:07.509658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:07.509658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:07.509658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:07.509658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:07.509658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:07.510578 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:07.510578 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:07.510578 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:07.510578 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:07.510578 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:07.510578 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:07.510578 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:07.510578 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:07.510578 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:07.510578 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:07.510578 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:07.510578 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:35:07.510578 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:07.510578 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:07.510578 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:07.510578 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:07.511313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:07.511313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:07.511313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:07.511313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:07.511313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:07.511313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:07.511313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:07.511313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:07.511313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:07.511313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:07.511313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:07.511313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:35:07.511313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 32/67] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:07.512725 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 36/68] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:07.517541 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efacea9d-834c-444b-9430-e36065699805 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:07.518893 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5fc2f-1d47-4994-bccc-86c819dd1500 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:07.519185 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5fc2f-1d47-4994-bccc-86c819dd1500 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:07.519469 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5fc2f-1d47-4994-bccc-86c819dd1500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:07.543043 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-ffd5fc2f-1d47-4994-bccc-86c819dd1500 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:07.545009 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-ffd5fc2f-1d47-4994-bccc-86c819dd1500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:07.592755 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:07.627979 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 37/69] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:07.628847 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5fc2f-1d47-4994-bccc-86c819dd1500 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:07.640013 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efacea9d-834c-444b-9430-e36065699805 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:07.660025 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:07.674932 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea7db5-995d-4fe2-95c8-08359616e7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:07.675619 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea7db5-995d-4fe2-95c8-08359616e7ef None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:07.675925 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea7db5-995d-4fe2-95c8-08359616e7ef None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:07.676200 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea7db5-995d-4fe2-95c8-08359616e7ef None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:07.676951 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ea7db5-995d-4fe2-95c8-08359616e7ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:07.677259 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ea7db5-995d-4fe2-95c8-08359616e7ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:07.678639 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ea7db5-995d-4fe2-95c8-08359616e7ef None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:07.687650 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 33/70] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:07.688345 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade557e-456b-45d1-944c-aac058b241f1 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:07.688584 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade557e-456b-45d1-944c-aac058b241f1 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:07.688859 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade557e-456b-45d1-944c-aac058b241f1 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:07.690212 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 34/71] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:07.690896 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade557e-456b-45d1-944c-aac058b241f1 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:07.754199 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5fc2f-1d47-4994-bccc-86c819dd1500 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:07.788624 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be3ec7-d021-4bd2-b5e3-a8695387fb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:07.789288 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be3ec7-d021-4bd2-b5e3-a8695387fb5b None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:07.789573 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be3ec7-d021-4bd2-b5e3-a8695387fb5b None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:07.789847 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be3ec7-d021-4bd2-b5e3-a8695387fb5b None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:07.790588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be3ec7-d021-4bd2-b5e3-a8695387fb5b None admin] RBAC: Adding query filter params (name=member) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:07.790895 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be3ec7-d021-4bd2-b5e3-a8695387fb5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:07.792313 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be3ec7-d021-4bd2-b5e3-a8695387fb5b None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:07.804128 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade557e-456b-45d1-944c-aac058b241f1 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:07.804516 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 38/72] 10.222.0.39 () {56 vars in 1101 bytes} [Mon May 23 15:35:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:07.808503 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be3ec7-d021-4bd2-b5e3-a8695387fb5b None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:07.829345 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:07.838064 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881133cb-b824-48fd-8580-e162c546b2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:07.838874 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881133cb-b824-48fd-8580-e162c546b2b9 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:07.839165 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881133cb-b824-48fd-8580-e162c546b2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:07.844407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881133cb-b824-48fd-8580-e162c546b2b9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:07.850870 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881133cb-b824-48fd-8580-e162c546b2b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:07.859137 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-881133cb-b824-48fd-8580-e162c546b2b9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:35:07.859137 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:07.859137 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:07.859137 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:07.859137 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:07.859137 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:07.859137 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:07.859137 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:07.859137 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:07.859137 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:07.859137 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:07.859137 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:07.859137 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:07.859137 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:07.859137 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:07.859137 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:07.860937 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:07.860937 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:07.860937 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:07.860937 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:07.860937 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:07.860937 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:07.860937 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:07.860937 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:07.860937 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:07.860937 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:07.860937 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:07.860937 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:35:07.860937 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:07.860937 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:07.860937 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:07.860937 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:07.863521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:07.863521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:07.863521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:07.863521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:07.863521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:07.863521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:07.863521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:07.863521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:07.863521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:07.863521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:07.863521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:35:07.863521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:35:07.863521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 35/73] 10.222.0.39 () {56 vars in 1114 bytes} [Mon May 23 15:35:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:07.863521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f841f4-22e7-49c6-a1d2-47de1e00404c None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:07.864742 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f841f4-22e7-49c6-a1d2-47de1e00404c None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:07.865028 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f841f4-22e7-49c6-a1d2-47de1e00404c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:07.881287 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-37f841f4-22e7-49c6-a1d2-47de1e00404c None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:07.882472 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-37f841f4-22e7-49c6-a1d2-47de1e00404c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:07.900658 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:07.915142 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be3ec7-d021-4bd2-b5e3-a8695387fb5b None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:07.949381 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 36/74] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:07.950696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4a1c0-a4c2-4f01-9e9e-32fc380aee33 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:07.950902 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446f5e0-8c34-4a6e-9b25-88e7dec9e815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:07.951026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4a1c0-a4c2-4f01-9e9e-32fc380aee33 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:07.951250 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4a1c0-a4c2-4f01-9e9e-32fc380aee33 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:07.951752 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446f5e0-8c34-4a6e-9b25-88e7dec9e815 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:07.952036 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446f5e0-8c34-4a6e-9b25-88e7dec9e815 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:07.952307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446f5e0-8c34-4a6e-9b25-88e7dec9e815 None admin] PATH_INFO: `/v3/users/e5936312ffff4fbfb32882db5724bdca` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:07.952722 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 37/75] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:07.954566 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446f5e0-8c34-4a6e-9b25-88e7dec9e815 None admin] RBAC: Authorizing `identity:get_user(user_id=e5936312ffff4fbfb32882db5724bdca)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:07.956031 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446f5e0-8c34-4a6e-9b25-88e7dec9e815 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:07.957683 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 39/76] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:35:07 2022] GET /identity/v3/users/e5936312ffff4fbfb32882db5724bdca => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:07.958425 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4a1c0-a4c2-4f01-9e9e-32fc380aee33 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:07.960530 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446f5e0-8c34-4a6e-9b25-88e7dec9e815 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:08.060477 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4a1c0-a4c2-4f01-9e9e-32fc380aee33 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:08.065287 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446f5e0-8c34-4a6e-9b25-88e7dec9e815 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:08.076794 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:08.095070 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b735d0-0647-4489-bb74-011497985d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:08.095988 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b735d0-0647-4489-bb74-011497985d7c None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:08.096241 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b735d0-0647-4489-bb74-011497985d7c None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:08.096518 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b735d0-0647-4489-bb74-011497985d7c None admin] PATH_INFO: `/v3/users/838e751633d3499ab737f10ad9b3cd2b` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:08.099011 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b2937-9b1b-45ab-8501-7a98b6b0d8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:08.099711 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b2937-9b1b-45ab-8501-7a98b6b0d8eb None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:08.100090 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b2937-9b1b-45ab-8501-7a98b6b0d8eb None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:08.100376 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b2937-9b1b-45ab-8501-7a98b6b0d8eb None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:08.101125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b2937-9b1b-45ab-8501-7a98b6b0d8eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:08.101439 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b2937-9b1b-45ab-8501-7a98b6b0d8eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:08.102910 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b2937-9b1b-45ab-8501-7a98b6b0d8eb None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:08.109329 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b735d0-0647-4489-bb74-011497985d7c None admin] RBAC: Authorizing `identity:get_user(user_id=838e751633d3499ab737f10ad9b3cd2b)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:08.110842 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b735d0-0647-4489-bb74-011497985d7c None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:08.111008 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 40/77] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:35:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:08.113117 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 38/78] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:35:07 2022] GET /identity/v3/users/838e751633d3499ab737f10ad9b3cd2b => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:08.116989 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae5866-1055-4ac5-b655-24327bc9239f None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:08.117288 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae5866-1055-4ac5-b655-24327bc9239f None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:08.117722 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae5866-1055-4ac5-b655-24327bc9239f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:08.118152 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b735d0-0647-4489-bb74-011497985d7c None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:08.136776 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-39ae5866-1055-4ac5-b655-24327bc9239f None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:08.137960 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-39ae5866-1055-4ac5-b655-24327bc9239f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:08.148959 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:08.207246 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 41/79] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:08.208226 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae5866-1055-4ac5-b655-24327bc9239f None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:08.221242 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b735d0-0647-4489-bb74-011497985d7c None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:08.258508 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cb65a-072a-49d8-bc6d-b8cdef3b9a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:08.259158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cb65a-072a-49d8-bc6d-b8cdef3b9a9d None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:08.259453 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cb65a-072a-49d8-bc6d-b8cdef3b9a9d None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:08.259781 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cb65a-072a-49d8-bc6d-b8cdef3b9a9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:08.301234 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:08.313292 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae5866-1055-4ac5-b655-24327bc9239f None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:08.325881 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23cb65a-072a-49d8-bc6d-b8cdef3b9a9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:08.327361 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23cb65a-072a-49d8-bc6d-b8cdef3b9a9d None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:08.346274 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d562e-3004-4c20-8918-e0c199b348a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:08.347071 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d562e-3004-4c20-8918-e0c199b348a7 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:08.347365 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d562e-3004-4c20-8918-e0c199b348a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:08.347679 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d562e-3004-4c20-8918-e0c199b348a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:08.348888 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d562e-3004-4c20-8918-e0c199b348a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:08.350322 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d562e-3004-4c20-8918-e0c199b348a7 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:08.351969 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 42/80] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:35:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:08.357137 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d562e-3004-4c20-8918-e0c199b348a7 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:08.372783 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:08.425259 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 39/81] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:35:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:35:08.426107 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cb65a-072a-49d8-bc6d-b8cdef3b9a9d None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:08.457530 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d562e-3004-4c20-8918-e0c199b348a7 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:08.492118 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b801b8-4e18-4f4b-82d9-a85d4f8e1fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:08.492982 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b801b8-4e18-4f4b-82d9-a85d4f8e1fee None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:08.493263 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b801b8-4e18-4f4b-82d9-a85d4f8e1fee None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:08.493541 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b801b8-4e18-4f4b-82d9-a85d4f8e1fee None admin] PATH_INFO: `/v3/users/838e751633d3499ab737f10ad9b3cd2b` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:08.494720 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b801b8-4e18-4f4b-82d9-a85d4f8e1fee None admin] RBAC: Authorizing `identity:get_user(user_id=838e751633d3499ab737f10ad9b3cd2b)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:08.496192 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b801b8-4e18-4f4b-82d9-a85d4f8e1fee None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:08.497807 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 43/82] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:35:08 2022] GET /identity/v3/users/838e751633d3499ab737f10ad9b3cd2b => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:08.498558 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b801b8-4e18-4f4b-82d9-a85d4f8e1fee None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:08.507722 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:08.534253 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cb65a-072a-49d8-bc6d-b8cdef3b9a9d None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:08.568762 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d6da4-9b16-4276-b048-53286e46a513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:08.569343 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d6da4-9b16-4276-b048-53286e46a513 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:08.569634 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d6da4-9b16-4276-b048-53286e46a513 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:08.569915 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d6da4-9b16-4276-b048-53286e46a513 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:08.580478 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:08.599040 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b801b8-4e18-4f4b-82d9-a85d4f8e1fee None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:08.634054 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d9ab6-e8a6-48ba-a8ec-655974b06dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:08.634842 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d9ab6-e8a6-48ba-a8ec-655974b06dda None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:08.635128 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d9ab6-e8a6-48ba-a8ec-655974b06dda None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:08.635404 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d9ab6-e8a6-48ba-a8ec-655974b06dda None admin] PATH_INFO: `/v3/roles/member` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:08.636825 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d6da4-9b16-4276-b048-53286e46a513 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:08.638304 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d6da4-9b16-4276-b048-53286e46a513 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:08.645463 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d9ab6-e8a6-48ba-a8ec-655974b06dda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:08.653130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-948d9ab6-e8a6-48ba-a8ec-655974b06dda None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:08.653130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:08.653130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:08.653130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:08.653130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:08.653130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:08.653130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:08.653130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:08.653130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:08.653130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:08.653130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:08.653130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:08.653130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:08.653130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:08.653130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:08.653130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:08.653960 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:08.653960 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:08.653960 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:08.653960 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:08.653960 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:08.653960 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:08.653960 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:08.653960 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:08.653960 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:08.653960 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:08.653960 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:08.653960 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:35:08.653960 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:08.653960 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:08.653960 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:08.653960 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:08.660333 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:08.660333 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:08.660333 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:08.660333 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:08.660333 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:08.660333 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:08.660333 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:08.660333 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:08.660333 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:08.660333 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:08.660333 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:08.660333 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:35:08.660333 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 44/83] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:08.660333 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d9ab6-e8a6-48ba-a8ec-655974b06dda None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:08.710289 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:08.735230 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 40/84] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:35:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:35:08.736155 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d6da4-9b16-4276-b048-53286e46a513 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:08.753572 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d9ab6-e8a6-48ba-a8ec-655974b06dda None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:08.786608 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf80674-183b-472d-915f-7bedf6bfdcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:08.787365 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf80674-183b-472d-915f-7bedf6bfdcfc None admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:08.787681 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf80674-183b-472d-915f-7bedf6bfdcfc None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:08.787965 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf80674-183b-472d-915f-7bedf6bfdcfc None admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:08.788676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf80674-183b-472d-915f-7bedf6bfdcfc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:08.790122 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf80674-183b-472d-915f-7bedf6bfdcfc None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:08.842486 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d6da4-9b16-4276-b048-53286e46a513 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:08.864400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:08.869807 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 45/85] 10.222.0.39 () {60 vars in 1132 bytes} [Mon May 23 15:35:08 2022] POST /identity/v3/users => generated 289 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:35:08.870778 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf80674-183b-472d-915f-7bedf6bfdcfc None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:08.876257 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f6c30-1869-4a3b-9626-732671e6acf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:08.877448 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f6c30-1869-4a3b-9626-732671e6acf2 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:08.877901 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f6c30-1869-4a3b-9626-732671e6acf2 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:08.878368 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f6c30-1869-4a3b-9626-732671e6acf2 None admin] PATH_INFO: `/v3/projects/88c9c3d6e1924302b76cfeeb40525435` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:08.879946 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f6c30-1869-4a3b-9626-732671e6acf2 None admin] RBAC: Authorizing `identity:get_project(project_id=88c9c3d6e1924302b76cfeeb40525435)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:08.881660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f6c30-1869-4a3b-9626-732671e6acf2 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:08.883741 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 41/86] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:08 2022] GET /identity/v3/projects/88c9c3d6e1924302b76cfeeb40525435 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:08.884742 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f6c30-1869-4a3b-9626-732671e6acf2 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:08.938938 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:08.989975 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf80674-183b-472d-915f-7bedf6bfdcfc None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:09.012363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f6c30-1869-4a3b-9626-732671e6acf2 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:09.029891 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20b0de-ce66-4ed2-bc71-0dc3da262f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:09.030497 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20b0de-ce66-4ed2-bc71-0dc3da262f10 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:09.030790 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20b0de-ce66-4ed2-bc71-0dc3da262f10 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:09.031171 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20b0de-ce66-4ed2-bc71-0dc3da262f10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:09.052179 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408a735-fe21-4704-9a9e-6ca972e812ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:09.052858 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408a735-fe21-4704-9a9e-6ca972e812ed None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:09.053140 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408a735-fe21-4704-9a9e-6ca972e812ed None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:09.053415 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408a735-fe21-4704-9a9e-6ca972e812ed None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:09.054169 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4408a735-fe21-4704-9a9e-6ca972e812ed None admin] RBAC: Adding query filter params (name=member) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:09.054478 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4408a735-fe21-4704-9a9e-6ca972e812ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:09.055916 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4408a735-fe21-4704-9a9e-6ca972e812ed None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:09.066838 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 42/87] 10.222.0.39 () {56 vars in 1101 bytes} [Mon May 23 15:35:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:09.067703 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408a735-fe21-4704-9a9e-6ca972e812ed None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:09.110531 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:09.115494 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca20b0de-ce66-4ed2-bc71-0dc3da262f10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:09.116085 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca20b0de-ce66-4ed2-bc71-0dc3da262f10 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:09.215335 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408a735-fe21-4704-9a9e-6ca972e812ed None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:09.218271 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:09.257430 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14452bbd-10d0-472a-a480-bee40c9e59e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:09.257982 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14452bbd-10d0-472a-a480-bee40c9e59e2 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:09.258263 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14452bbd-10d0-472a-a480-bee40c9e59e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:09.258539 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14452bbd-10d0-472a-a480-bee40c9e59e2 None admin] PATH_INFO: `/v3/projects/88c9c3d6e1924302b76cfeeb40525435` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:09.260378 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14452bbd-10d0-472a-a480-bee40c9e59e2 None admin] RBAC: Authorizing `identity:get_project(project_id=88c9c3d6e1924302b76cfeeb40525435)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:09.263801 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14452bbd-10d0-472a-a480-bee40c9e59e2 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:09.263801 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 43/88] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:09 2022] GET /identity/v3/projects/88c9c3d6e1924302b76cfeeb40525435 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:09.265004 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14452bbd-10d0-472a-a480-bee40c9e59e2 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:09.272990 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 46/89] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:35:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:35:09.273519 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20b0de-ce66-4ed2-bc71-0dc3da262f10 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:09.377480 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14452bbd-10d0-472a-a480-bee40c9e59e2 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:09.415565 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1592fa-4678-4a93-813c-c0dd419df06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:09.416264 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1592fa-4678-4a93-813c-c0dd419df06f None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:09.416691 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1592fa-4678-4a93-813c-c0dd419df06f None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:09.416828 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1592fa-4678-4a93-813c-c0dd419df06f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:09.417721 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1592fa-4678-4a93-813c-c0dd419df06f None admin] RBAC: Adding query filter params (role.id=3ab888f5f68740bd8f9df4447f4f5a7a, scope.project.id=88c9c3d6e1924302b76cfeeb40525435, user.id=e5936312ffff4fbfb32882db5724bdca) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:09.418036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1592fa-4678-4a93-813c-c0dd419df06f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:09.419542 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1592fa-4678-4a93-813c-c0dd419df06f None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:09.424237 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20b0de-ce66-4ed2-bc71-0dc3da262f10 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:09.425428 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 44/90] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:35:09 2022] GET /identity/v3/role_assignments?user.id=e5936312ffff4fbfb32882db5724bdca&scope.project.id=88c9c3d6e1924302b76cfeeb40525435&role.id=3ab888f5f68740bd8f9df4447f4f5a7a => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:09.426221 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1592fa-4678-4a93-813c-c0dd419df06f None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:09.435994 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:09.467532 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524ab26-58f4-4b6d-8cad-6f0366ee3dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:09.469515 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524ab26-58f4-4b6d-8cad-6f0366ee3dcb None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:09.469515 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524ab26-58f4-4b6d-8cad-6f0366ee3dcb None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:09.470545 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524ab26-58f4-4b6d-8cad-6f0366ee3dcb None admin] PATH_INFO: `/v3/users/838e751633d3499ab737f10ad9b3cd2b` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:09.472240 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8524ab26-58f4-4b6d-8cad-6f0366ee3dcb None admin] RBAC: Authorizing `identity:get_user(user_id=838e751633d3499ab737f10ad9b3cd2b)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:09.473924 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8524ab26-58f4-4b6d-8cad-6f0366ee3dcb None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:09.476325 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 47/91] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:35:09 2022] GET /identity/v3/users/838e751633d3499ab737f10ad9b3cd2b => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:09.477932 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524ab26-58f4-4b6d-8cad-6f0366ee3dcb None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:09.512806 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:09.619093 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524ab26-58f4-4b6d-8cad-6f0366ee3dcb None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:09.662240 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaed887-f44c-4318-8fa0-5557fe755373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:09.663508 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaed887-f44c-4318-8fa0-5557fe755373 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:09.663967 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaed887-f44c-4318-8fa0-5557fe755373 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:09.664503 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaed887-f44c-4318-8fa0-5557fe755373 None admin] PATH_INFO: `/v3/projects/88c9c3d6e1924302b76cfeeb40525435` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:09.665943 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaed887-f44c-4318-8fa0-5557fe755373 None admin] RBAC: Authorizing `identity:get_project(project_id=88c9c3d6e1924302b76cfeeb40525435)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:09.667583 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaed887-f44c-4318-8fa0-5557fe755373 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:09.669963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 48/92] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:09 2022] GET /identity/v3/projects/88c9c3d6e1924302b76cfeeb40525435 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:09.671551 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaed887-f44c-4318-8fa0-5557fe755373 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:09.709956 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1592fa-4678-4a93-813c-c0dd419df06f None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:09.726768 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:09.754381 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d45ab-45cd-4dab-8880-617a453f1c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:09.761387 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d45ab-45cd-4dab-8880-617a453f1c91 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:09.761387 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d45ab-45cd-4dab-8880-617a453f1c91 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:09.761387 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d45ab-45cd-4dab-8880-617a453f1c91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:09.761387 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d45ab-45cd-4dab-8880-617a453f1c91 None admin] RBAC: Adding query filter params (role.id=c41a7cd1c92b45a7bff9632d07b48006, scope.project.id=88c9c3d6e1924302b76cfeeb40525435, user.id=838e751633d3499ab737f10ad9b3cd2b) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:09.761387 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d45ab-45cd-4dab-8880-617a453f1c91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:09.761387 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d45ab-45cd-4dab-8880-617a453f1c91 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:09.768629 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 45/93] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:35:09 2022] GET /identity/v3/role_assignments?user.id=838e751633d3499ab737f10ad9b3cd2b&scope.project.id=88c9c3d6e1924302b76cfeeb40525435&role.id=c41a7cd1c92b45a7bff9632d07b48006 => generated 259 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:09.768629 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d45ab-45cd-4dab-8880-617a453f1c91 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:09.815689 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaed887-f44c-4318-8fa0-5557fe755373 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:09.858282 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758d074-1f24-4a25-af71-0aa225664490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:09.859835 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758d074-1f24-4a25-af71-0aa225664490 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:09.860758 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758d074-1f24-4a25-af71-0aa225664490 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:09.861231 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758d074-1f24-4a25-af71-0aa225664490 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:09.947039 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758d074-1f24-4a25-af71-0aa225664490 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:09.949046 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758d074-1f24-4a25-af71-0aa225664490 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:09.992008 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:10.069981 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:10.075055 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d45ab-45cd-4dab-8880-617a453f1c91 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:10.080792 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 49/94] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:35:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:35:10.087107 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758d074-1f24-4a25-af71-0aa225664490 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:10.141412 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a4f59-5481-4593-bcb8-67f1b583a2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:10.142560 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a4f59-5481-4593-bcb8-67f1b583a2d8 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:10.143044 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a4f59-5481-4593-bcb8-67f1b583a2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:10.143514 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a4f59-5481-4593-bcb8-67f1b583a2d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:10.144611 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a4f59-5481-4593-bcb8-67f1b583a2d8 None admin] RBAC: Adding query filter params (role.id=a487e8d6e71d4a399b050274528d8db7, scope.project.id=88c9c3d6e1924302b76cfeeb40525435, user.id=838e751633d3499ab737f10ad9b3cd2b) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:10.145139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a4f59-5481-4593-bcb8-67f1b583a2d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:10.146838 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a4f59-5481-4593-bcb8-67f1b583a2d8 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:10.163708 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 46/95] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:35:09 2022] GET /identity/v3/role_assignments?user.id=838e751633d3499ab737f10ad9b3cd2b&scope.project.id=88c9c3d6e1924302b76cfeeb40525435&role.id=a487e8d6e71d4a399b050274528d8db7 => generated 259 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:10.197371 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758d074-1f24-4a25-af71-0aa225664490 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:10.240159 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684f479-0809-48b2-b480-afd1b547163b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:10.241039 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684f479-0809-48b2-b480-afd1b547163b None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:10.241327 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684f479-0809-48b2-b480-afd1b547163b None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:10.241610 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684f479-0809-48b2-b480-afd1b547163b None admin] PATH_INFO: `/v3/projects/32350b9a06344f80b8a7f780a421828d` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:10.242829 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684f479-0809-48b2-b480-afd1b547163b None admin] RBAC: Authorizing `identity:get_project(project_id=32350b9a06344f80b8a7f780a421828d)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:10.244531 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684f479-0809-48b2-b480-afd1b547163b None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:10.246251 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 50/96] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:10 2022] GET /identity/v3/projects/32350b9a06344f80b8a7f780a421828d => generated 312 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:10.256733 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a4f59-5481-4593-bcb8-67f1b583a2d8 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:10.418666 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a4f59-5481-4593-bcb8-67f1b583a2d8 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:10.454455 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e921a6-3aa5-4a86-bb35-961f3470985b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:10.455032 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e921a6-3aa5-4a86-bb35-961f3470985b None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:10.455319 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e921a6-3aa5-4a86-bb35-961f3470985b None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:10.455618 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e921a6-3aa5-4a86-bb35-961f3470985b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:10.456457 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e921a6-3aa5-4a86-bb35-961f3470985b None admin] RBAC: Adding query filter params (role.id=c41a7cd1c92b45a7bff9632d07b48006, scope.project.id=32350b9a06344f80b8a7f780a421828d, user.id=838e751633d3499ab737f10ad9b3cd2b) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:10.456768 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e921a6-3aa5-4a86-bb35-961f3470985b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:10.458240 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e921a6-3aa5-4a86-bb35-961f3470985b None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:10.464150 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 47/97] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:35:10 2022] GET /identity/v3/role_assignments?user.id=838e751633d3499ab737f10ad9b3cd2b&scope.project.id=32350b9a06344f80b8a7f780a421828d&role.id=c41a7cd1c92b45a7bff9632d07b48006 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:11.755400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a964a23-3568-46a5-b34f-64acfd33044e None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:11.755935 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a964a23-3568-46a5-b34f-64acfd33044e None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:11.756037 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a964a23-3568-46a5-b34f-64acfd33044e None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:11.757647 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 51/98] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:11.762558 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e939d-ab0b-41d0-a3eb-e60202fb986a None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:11.763425 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e939d-ab0b-41d0-a3eb-e60202fb986a None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:11.763929 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e939d-ab0b-41d0-a3eb-e60202fb986a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:11.783183 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-639e939d-ab0b-41d0-a3eb-e60202fb986a None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:11.789267 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-639e939d-ab0b-41d0-a3eb-e60202fb986a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:11.815826 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:11.871355 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 48/99] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:11.898169 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a964a23-3568-46a5-b34f-64acfd33044e None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:11.901233 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:12.026299 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a964a23-3568-46a5-b34f-64acfd33044e None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:12.073646 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695cc1d5-30a3-442a-9837-0c90e39314b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:12.074442 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cc1d5-30a3-442a-9837-0c90e39314b0 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:12.074723 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cc1d5-30a3-442a-9837-0c90e39314b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:12.074997 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cc1d5-30a3-442a-9837-0c90e39314b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:12.076202 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695cc1d5-30a3-442a-9837-0c90e39314b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:12.077658 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695cc1d5-30a3-442a-9837-0c90e39314b0 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:12.079853 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 52/100] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:35:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:12.085487 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e939d-ab0b-41d0-a3eb-e60202fb986a None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:12.190685 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f56fae-1849-48f5-a789-2a786a06e2b7 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:12.191027 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f56fae-1849-48f5-a789-2a786a06e2b7 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:12.191314 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f56fae-1849-48f5-a789-2a786a06e2b7 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:12.192713 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 53/101] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:12.198381 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042cd96-b2b1-416a-9786-3c93f63b740b None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:12.198663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042cd96-b2b1-416a-9786-3c93f63b740b None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:12.198942 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042cd96-b2b1-416a-9786-3c93f63b740b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:12.206093 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e939d-ab0b-41d0-a3eb-e60202fb986a None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:12.228923 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-c042cd96-b2b1-416a-9786-3c93f63b740b None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:12.230143 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-c042cd96-b2b1-416a-9786-3c93f63b740b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:12.263961 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95213b9a-43fd-4c32-adb6-4c6fbc5966ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:12.264932 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95213b9a-43fd-4c32-adb6-4c6fbc5966ba None admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:12.265491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95213b9a-43fd-4c32-adb6-4c6fbc5966ba None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:12.265914 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95213b9a-43fd-4c32-adb6-4c6fbc5966ba None admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:12.266775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95213b9a-43fd-4c32-adb6-4c6fbc5966ba None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:12.268405 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95213b9a-43fd-4c32-adb6-4c6fbc5966ba None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:12.333702 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:12.341105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 54/102] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:35:12.374201 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 49/103] 10.222.0.39 () {60 vars in 1141 bytes} [Mon May 23 15:35:12 2022] POST /identity/v3/projects => generated 302 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:35:12.378986 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042cd96-b2b1-416a-9786-3c93f63b740b None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:12.496482 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042cd96-b2b1-416a-9786-3c93f63b740b None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:12.561850 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db86a1-b0df-41c7-9e6c-09782bd39d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:12.563759 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db86a1-b0df-41c7-9e6c-09782bd39d0e None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:12.564049 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db86a1-b0df-41c7-9e6c-09782bd39d0e None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:12.564332 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db86a1-b0df-41c7-9e6c-09782bd39d0e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:12.579914 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db86a1-b0df-41c7-9e6c-09782bd39d0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:12.588400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-02db86a1-b0df-41c7-9e6c-09782bd39d0e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:35:12.588400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:12.588400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:12.588400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:12.588400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:12.588400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:12.588400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:12.588400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:12.588400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:12.588400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:12.588400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:12.588400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:12.588400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:12.588400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:12.588400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:12.588400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:12.589307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:12.589307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:12.589307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:12.589307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:12.589307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:12.589307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:12.589307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:12.589307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:12.589307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:12.589307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:12.589307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:12.589307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:35:12.589307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:12.589307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:12.589307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:12.589307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:12.590062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:12.590062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:12.590062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:12.590062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:12.590062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:12.590062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:12.590062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:12.590062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:12.590062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:12.590062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:12.590062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:35:12.590062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:35:12.590062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 55/104] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:12.596771 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95213b9a-43fd-4c32-adb6-4c6fbc5966ba None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:12.617302 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:12.731063 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95213b9a-43fd-4c32-adb6-4c6fbc5966ba None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:12.781499 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487ce85-c115-4675-9d42-bd333a6bfc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:12.782952 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487ce85-c115-4675-9d42-bd333a6bfc9a None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:12.783437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487ce85-c115-4675-9d42-bd333a6bfc9a None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:12.787986 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487ce85-c115-4675-9d42-bd333a6bfc9a None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:12.788981 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d487ce85-c115-4675-9d42-bd333a6bfc9a None admin] RBAC: Adding query filter params (name=reader) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:12.789498 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d487ce85-c115-4675-9d42-bd333a6bfc9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:12.791143 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d487ce85-c115-4675-9d42-bd333a6bfc9a None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:12.800685 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5eac6f-47d1-4e7c-8480-04d7b5fda032 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:12.801184 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5eac6f-47d1-4e7c-8480-04d7b5fda032 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:12.801259 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5eac6f-47d1-4e7c-8480-04d7b5fda032 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:12.801822 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 50/105] 10.222.0.39 () {56 vars in 1101 bytes} [Mon May 23 15:35:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:12.802708 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 56/106] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:35:12.807368 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487ce85-c115-4675-9d42-bd333a6bfc9a None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:12.817534 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11a068-890e-49a2-b999-3146a007ec24 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:12.817820 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11a068-890e-49a2-b999-3146a007ec24 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:12.818110 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11a068-890e-49a2-b999-3146a007ec24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:12.852097 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-ed11a068-890e-49a2-b999-3146a007ec24 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:12.853206 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-ed11a068-890e-49a2-b999-3146a007ec24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:12.946701 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:12.975772 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:12.999244 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 57/107] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:13.005743 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487ce85-c115-4675-9d42-bd333a6bfc9a None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:13.032612 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11a068-890e-49a2-b999-3146a007ec24 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:13.093297 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe166ae-8691-4bc9-ae02-e005ab286b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:13.094774 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe166ae-8691-4bc9-ae02-e005ab286b39 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:13.095063 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe166ae-8691-4bc9-ae02-e005ab286b39 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:13.095342 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe166ae-8691-4bc9-ae02-e005ab286b39 None admin] PATH_INFO: `/v3/users/d4a13d5f01224ff9a57f0061c53ab19f` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:13.122065 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe166ae-8691-4bc9-ae02-e005ab286b39 None admin] RBAC: Authorizing `identity:get_user(user_id=d4a13d5f01224ff9a57f0061c53ab19f)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:13.123463 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe166ae-8691-4bc9-ae02-e005ab286b39 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:13.125823 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 51/108] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:35:12 2022] GET /identity/v3/users/d4a13d5f01224ff9a57f0061c53ab19f => generated 289 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:13.131455 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe166ae-8691-4bc9-ae02-e005ab286b39 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:13.153457 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11a068-890e-49a2-b999-3146a007ec24 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:13.259289 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cbe47-9a54-451b-959b-1ddc43bb8024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:13.260132 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cbe47-9a54-451b-959b-1ddc43bb8024 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:13.260421 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cbe47-9a54-451b-959b-1ddc43bb8024 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:13.260704 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cbe47-9a54-451b-959b-1ddc43bb8024 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:13.275790 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475cbe47-9a54-451b-959b-1ddc43bb8024 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:13.292588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-475cbe47-9a54-451b-959b-1ddc43bb8024 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:13.292588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:13.292588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:13.292588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:13.292588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:13.292588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:13.292588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:13.292588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:13.292588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:13.292588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:13.292588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:13.292588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:13.292588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:13.292588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:13.292588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:13.292588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:13.293504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:13.293504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:13.293504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:13.293504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:13.293504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:13.293504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:13.293504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:13.293504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:13.293504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:13.293504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:13.293504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:13.293504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:35:13.293504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:13.293504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:13.293504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:13.293504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:13.294238 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:13.294238 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:13.294238 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:13.294238 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:13.294238 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:13.294238 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:13.294238 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:13.294238 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:13.294238 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:13.294238 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:13.294238 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:13.294238 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:35:13.294238 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 58/109] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:13.301556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cbe47-9a54-451b-959b-1ddc43bb8024 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:13.400421 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe166ae-8691-4bc9-ae02-e005ab286b39 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:13.420717 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:13.436814 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:13.446901 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb327e9a-246d-403e-b47e-a8e6a327e994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:13.447928 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb327e9a-246d-403e-b47e-a8e6a327e994 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:13.450701 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb327e9a-246d-403e-b47e-a8e6a327e994 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:13.451193 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb327e9a-246d-403e-b47e-a8e6a327e994 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:13.534762 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb327e9a-246d-403e-b47e-a8e6a327e994 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:13.536781 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb327e9a-246d-403e-b47e-a8e6a327e994 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:13.538270 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cbe47-9a54-451b-959b-1ddc43bb8024 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:13.603096 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e908c69-19f4-4829-9786-d1d6a7c28697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:13.603831 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e908c69-19f4-4829-9786-d1d6a7c28697 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:13.604112 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e908c69-19f4-4829-9786-d1d6a7c28697 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:13.604617 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e908c69-19f4-4829-9786-d1d6a7c28697 None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:13.605636 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e908c69-19f4-4829-9786-d1d6a7c28697 None admin] RBAC: Adding query filter params (name=member) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:13.606141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e908c69-19f4-4829-9786-d1d6a7c28697 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:13.607866 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e908c69-19f4-4829-9786-d1d6a7c28697 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:13.617819 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 59/110] 10.222.0.39 () {56 vars in 1101 bytes} [Mon May 23 15:35:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:35:13.619458 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880be7fd-e6da-4ed9-8459-576afe92f0ca None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:13.620002 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880be7fd-e6da-4ed9-8459-576afe92f0ca None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:13.620476 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880be7fd-e6da-4ed9-8459-576afe92f0ca None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:13.622093 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 60/111] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:13.627697 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b4b16-577b-4649-8151-9cb6a825605c None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:13.628233 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b4b16-577b-4649-8151-9cb6a825605c None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:13.628833 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b4b16-577b-4649-8151-9cb6a825605c None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:13.630422 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 61/112] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:13.631354 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b4b16-577b-4649-8151-9cb6a825605c None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:13.650986 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 52/113] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:35:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 15:35:13.652640 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2a89b-e35c-4c2a-b3eb-b9f1a271e00b None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:13.653085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2a89b-e35c-4c2a-b3eb-b9f1a271e00b None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:13.653494 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2a89b-e35c-4c2a-b3eb-b9f1a271e00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:13.676584 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-5ab2a89b-e35c-4c2a-b3eb-b9f1a271e00b None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:13.678177 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-5ab2a89b-e35c-4c2a-b3eb-b9f1a271e00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:13.705506 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:13.758733 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b4b16-577b-4649-8151-9cb6a825605c None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:13.759872 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 53/114] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:13.761162 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d58325-7b99-45e3-ae1f-bb61c57376a1 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:13.761456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d58325-7b99-45e3-ae1f-bb61c57376a1 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:13.761889 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d58325-7b99-45e3-ae1f-bb61c57376a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:13.778298 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-b7d58325-7b99-45e3-ae1f-bb61c57376a1 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:13.779482 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-b7d58325-7b99-45e3-ae1f-bb61c57376a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:13.789448 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:13.812278 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4079e4b-cde0-4c95-b3a7-e5633ea36444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:13.813316 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4079e4b-cde0-4c95-b3a7-e5633ea36444 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:13.813607 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4079e4b-cde0-4c95-b3a7-e5633ea36444 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:13.813888 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4079e4b-cde0-4c95-b3a7-e5633ea36444 None admin] PATH_INFO: `/v3/users/838e751633d3499ab737f10ad9b3cd2b` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:13.815146 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4079e4b-cde0-4c95-b3a7-e5633ea36444 None admin] RBAC: Authorizing `identity:get_user(user_id=838e751633d3499ab737f10ad9b3cd2b)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:13.816790 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4079e4b-cde0-4c95-b3a7-e5633ea36444 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:13.822995 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 62/115] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:35:13 2022] GET /identity/v3/users/838e751633d3499ab737f10ad9b3cd2b => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:13.823738 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4079e4b-cde0-4c95-b3a7-e5633ea36444 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:13.863633 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 54/116] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:13.863633 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f4319-9623-4a13-9809-091a46ac6fe8 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:13.863633 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f4319-9623-4a13-9809-091a46ac6fe8 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:13.863633 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f4319-9623-4a13-9809-091a46ac6fe8 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:13.863633 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 55/117] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:13.868339 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f4319-9623-4a13-9809-091a46ac6fe8 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:13.940969 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4079e4b-cde0-4c95-b3a7-e5633ea36444 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:13.969959 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:13.978256 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a693f-6837-407c-bd01-a76df63833d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:13.979125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a693f-6837-407c-bd01-a76df63833d0 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:13.979417 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a693f-6837-407c-bd01-a76df63833d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:13.980908 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a693f-6837-407c-bd01-a76df63833d0 None admin] PATH_INFO: `/v3/projects/88c9c3d6e1924302b76cfeeb40525435` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:13.981003 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f4319-9623-4a13-9809-091a46ac6fe8 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:13.981075 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a693f-6837-407c-bd01-a76df63833d0 None admin] RBAC: Authorizing `identity:get_project(project_id=88c9c3d6e1924302b76cfeeb40525435)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:13.982442 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a693f-6837-407c-bd01-a76df63833d0 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:13.984733 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 63/118] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:13 2022] GET /identity/v3/projects/88c9c3d6e1924302b76cfeeb40525435 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:13.985518 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a693f-6837-407c-bd01-a76df63833d0 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:14.017320 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b6993-7a4a-48f3-be53-19f174856438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:14.018390 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b6993-7a4a-48f3-be53-19f174856438 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:14.018876 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b6993-7a4a-48f3-be53-19f174856438 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:14.019326 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b6993-7a4a-48f3-be53-19f174856438 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:14.029724 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b6993-7a4a-48f3-be53-19f174856438 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:14.038168 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-8e9b6993-7a4a-48f3-be53-19f174856438 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:35:14.038168 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:14.038168 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:14.038168 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:14.038168 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:14.038168 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:14.038168 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:14.038168 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:14.038168 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:14.038168 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:14.038168 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:14.038168 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:14.038168 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:14.038168 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:14.038168 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:14.038168 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:14.039029 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:14.039029 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:14.039029 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:14.039029 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:14.039029 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:14.039029 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:14.039029 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:14.039029 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:14.039029 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:14.039029 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:14.039029 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:14.039029 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:35:14.039029 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:14.039029 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:14.039029 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:14.039029 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:14.039824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:14.039824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:14.039824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:14.039824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:14.039824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:14.039824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:14.039824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:14.039824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:14.039824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:14.039824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:14.039824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:35:14.039824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:35:14.041799 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 56/119] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:35:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:14.043169 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9fe8d-33c3-4fb7-b974-0d79f179e25f None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:14.043466 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9fe8d-33c3-4fb7-b974-0d79f179e25f None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:14.043781 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9fe8d-33c3-4fb7-b974-0d79f179e25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:14.047238 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:14.061850 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-cca9fe8d-33c3-4fb7-b974-0d79f179e25f None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:14.064394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-cca9fe8d-33c3-4fb7-b974-0d79f179e25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:14.108349 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a693f-6837-407c-bd01-a76df63833d0 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:14.137830 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 57/120] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:14.139019 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9fe8d-33c3-4fb7-b974-0d79f179e25f None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:14.156048 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f04ef-61a3-4333-a0cd-0d4bc3f676b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:14.157396 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f04ef-61a3-4333-a0cd-0d4bc3f676b3 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:14.157917 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f04ef-61a3-4333-a0cd-0d4bc3f676b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:14.158412 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f04ef-61a3-4333-a0cd-0d4bc3f676b3 None admin] PATH_INFO: `/v3/projects/88c9c3d6e1924302b76cfeeb40525435` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:14.159847 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f04ef-61a3-4333-a0cd-0d4bc3f676b3 None admin] RBAC: Authorizing `identity:get_project(project_id=88c9c3d6e1924302b76cfeeb40525435)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:14.161611 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f04ef-61a3-4333-a0cd-0d4bc3f676b3 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:14.163569 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 64/121] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:13 2022] GET /identity/v3/projects/88c9c3d6e1924302b76cfeeb40525435 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:14.164351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f04ef-61a3-4333-a0cd-0d4bc3f676b3 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:14.272072 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:14.293147 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9fe8d-33c3-4fb7-b974-0d79f179e25f None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:14.301548 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f04ef-61a3-4333-a0cd-0d4bc3f676b3 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:14.318737 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:14.330845 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a1f77-ec64-4ea3-ad75-8f8bf3d3442b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:14.331663 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a1f77-ec64-4ea3-ad75-8f8bf3d3442b None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:14.331951 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a1f77-ec64-4ea3-ad75-8f8bf3d3442b None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:14.332226 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a1f77-ec64-4ea3-ad75-8f8bf3d3442b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:14.336747 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584735d4-70c6-4498-92e3-a5711adb6bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:14.337407 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584735d4-70c6-4498-92e3-a5711adb6bcd None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:14.337698 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584735d4-70c6-4498-92e3-a5711adb6bcd None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:14.337983 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584735d4-70c6-4498-92e3-a5711adb6bcd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:14.338804 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584735d4-70c6-4498-92e3-a5711adb6bcd None admin] RBAC: Adding query filter params (role.id=86bedad6f8c84aefb5822c67df949d08, scope.project.id=88c9c3d6e1924302b76cfeeb40525435, user.id=d4a13d5f01224ff9a57f0061c53ab19f) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:14.339122 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584735d4-70c6-4498-92e3-a5711adb6bcd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:14.340598 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584735d4-70c6-4498-92e3-a5711adb6bcd None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:14.343077 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a1f77-ec64-4ea3-ad75-8f8bf3d3442b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:14.355904 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 65/122] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:35:14 2022] GET /identity/v3/role_assignments?user.id=d4a13d5f01224ff9a57f0061c53ab19f&scope.project.id=88c9c3d6e1924302b76cfeeb40525435&role.id=86bedad6f8c84aefb5822c67df949d08 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:14.355904 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584735d4-70c6-4498-92e3-a5711adb6bcd None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:14.356167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-1e1a1f77-ec64-4ea3-ad75-8f8bf3d3442b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:14.356167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:14.356167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:14.356167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:14.356167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:14.356167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:14.356167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:14.356167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:14.356167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:14.356167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:14.356167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:14.356167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:14.356167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:14.356167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:14.356167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:14.356167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:14.357120 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:14.357120 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:14.357120 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:14.357120 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:14.357120 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:14.357120 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:14.357120 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:14.357120 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:14.357120 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:14.357120 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:14.357120 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:14.357120 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:35:14.357120 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:14.357120 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:14.357120 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:14.357120 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:14.358067 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:14.358067 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:14.358067 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:14.358067 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:14.358067 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:14.358067 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:14.358067 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:14.358067 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:14.358067 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:14.358067 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:14.358067 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:14.358067 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:35:14.358067 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 58/123] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:14.358067 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a1f77-ec64-4ea3-ad75-8f8bf3d3442b None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:14.477128 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584735d4-70c6-4498-92e3-a5711adb6bcd None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:14.508826 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a1f77-ec64-4ea3-ad75-8f8bf3d3442b None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:14.516991 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c2b00-208b-4d37-964d-82c0ef3fcdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:14.517764 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c2b00-208b-4d37-964d-82c0ef3fcdf7 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:14.518120 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c2b00-208b-4d37-964d-82c0ef3fcdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:14.518466 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c2b00-208b-4d37-964d-82c0ef3fcdf7 None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:14.519342 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c2b00-208b-4d37-964d-82c0ef3fcdf7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:14.519813 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c2b00-208b-4d37-964d-82c0ef3fcdf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:14.521363 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c2b00-208b-4d37-964d-82c0ef3fcdf7 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:14.534904 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 66/124] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:14.535923 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c2b00-208b-4d37-964d-82c0ef3fcdf7 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:14.552483 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689994c-6276-4fbe-9cbe-fac0f43354a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:14.553296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689994c-6276-4fbe-9cbe-fac0f43354a6 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:14.553585 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689994c-6276-4fbe-9cbe-fac0f43354a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:14.553862 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689994c-6276-4fbe-9cbe-fac0f43354a6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:14.564656 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:14.571634 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689994c-6276-4fbe-9cbe-fac0f43354a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:14.581637 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-2689994c-6276-4fbe-9cbe-fac0f43354a6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:35:14.581637 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:14.581637 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:14.581637 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:14.581637 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:14.581637 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:14.581637 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:14.581637 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:14.581637 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:14.581637 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:14.581637 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:14.581637 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:14.581637 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:14.581637 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:14.581637 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:14.581637 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:14.582537 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:14.582537 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:14.582537 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:14.582537 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:14.582537 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:14.582537 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:14.582537 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:14.582537 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:14.582537 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:14.582537 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:14.582537 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:14.582537 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:35:14.582537 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:14.582537 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:14.582537 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:14.582537 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:14.583306 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:14.583306 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:14.583306 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:14.583306 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:14.583306 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:14.583306 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:14.583306 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:14.583306 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:14.583306 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:14.583306 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:14.583306 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:35:14.583306 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:35:14.583306 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 59/125] 10.222.0.39 () {56 vars in 1114 bytes} [Mon May 23 15:35:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:14.584009 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689994c-6276-4fbe-9cbe-fac0f43354a6 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:14.612924 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:14.697639 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c2b00-208b-4d37-964d-82c0ef3fcdf7 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:14.699307 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689994c-6276-4fbe-9cbe-fac0f43354a6 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:14.735530 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed1fc3-fae3-44fe-b74e-b560da067f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:14.736798 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed1fc3-fae3-44fe-b74e-b560da067f29 None admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:14.737288 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed1fc3-fae3-44fe-b74e-b560da067f29 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:14.738029 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed1fc3-fae3-44fe-b74e-b560da067f29 None admin] PATH_INFO: `/v3/projects/88c9c3d6e1924302b76cfeeb40525435/users/838e751633d3499ab737f10ad9b3cd2b/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:14.740407 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed1fc3-fae3-44fe-b74e-b560da067f29 None admin] RBAC: Authorizing `identity:create_grant(project_id=88c9c3d6e1924302b76cfeeb40525435, user_id=838e751633d3499ab737f10ad9b3cd2b, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:14.742472 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed1fc3-fae3-44fe-b74e-b560da067f29 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:14.743840 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118358cb-b079-4ec3-b37c-7cde83ad853d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:14.744518 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118358cb-b079-4ec3-b37c-7cde83ad853d None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:14.744806 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118358cb-b079-4ec3-b37c-7cde83ad853d None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:14.745092 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118358cb-b079-4ec3-b37c-7cde83ad853d None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:14.745852 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118358cb-b079-4ec3-b37c-7cde83ad853d None admin] RBAC: Adding query filter params (name=member) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:14.746168 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118358cb-b079-4ec3-b37c-7cde83ad853d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:14.747755 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118358cb-b079-4ec3-b37c-7cde83ad853d None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:14.757613 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 60/126] 10.222.0.39 () {56 vars in 1101 bytes} [Mon May 23 15:35:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:14.762424 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118358cb-b079-4ec3-b37c-7cde83ad853d None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:14.825735 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:14.828529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 67/127] 10.222.0.39 () {58 vars in 1439 bytes} [Mon May 23 15:35:14 2022] PUT /identity/v3/projects/88c9c3d6e1924302b76cfeeb40525435/users/838e751633d3499ab737f10ad9b3cd2b/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:35:14.837476 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed1fc3-fae3-44fe-b74e-b560da067f29 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:14.905413 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118358cb-b079-4ec3-b37c-7cde83ad853d None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:14.991343 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92901e05-d978-4358-8903-4ae3d69082f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:14.992669 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92901e05-d978-4358-8903-4ae3d69082f0 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:15.005084 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92901e05-d978-4358-8903-4ae3d69082f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:15.005257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed1fc3-fae3-44fe-b74e-b560da067f29 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:15.006187 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92901e05-d978-4358-8903-4ae3d69082f0 None admin] PATH_INFO: `/v3/users/e5936312ffff4fbfb32882db5724bdca` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:15.006302 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:15.008412 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92901e05-d978-4358-8903-4ae3d69082f0 None admin] RBAC: Authorizing `identity:get_user(user_id=e5936312ffff4fbfb32882db5724bdca)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:15.013060 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92901e05-d978-4358-8903-4ae3d69082f0 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:15.014955 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 61/128] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:35:14 2022] GET /identity/v3/users/e5936312ffff4fbfb32882db5724bdca => generated 247 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:15.024683 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92901e05-d978-4358-8903-4ae3d69082f0 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:15.048810 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4b269-1f4d-4d5b-b862-f53717d024da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:15.049557 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4b269-1f4d-4d5b-b862-f53717d024da None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:15.049846 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4b269-1f4d-4d5b-b862-f53717d024da None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:15.050129 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4b269-1f4d-4d5b-b862-f53717d024da None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:15.050899 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b4b269-1f4d-4d5b-b862-f53717d024da None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:15.051215 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b4b269-1f4d-4d5b-b862-f53717d024da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:15.052776 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b4b269-1f4d-4d5b-b862-f53717d024da None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:15.075335 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 68/129] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:35:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:15.080977 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4b269-1f4d-4d5b-b862-f53717d024da None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:15.178255 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92901e05-d978-4358-8903-4ae3d69082f0 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:15.205761 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4b269-1f4d-4d5b-b862-f53717d024da None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:15.216677 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:15.229642 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b0fd0-0b91-4c53-8df4-c4fef438ad7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:15.230533 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b0fd0-0b91-4c53-8df4-c4fef438ad7c None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:15.230825 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b0fd0-0b91-4c53-8df4-c4fef438ad7c None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:15.231102 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b0fd0-0b91-4c53-8df4-c4fef438ad7c None admin] PATH_INFO: `/v3/users/838e751633d3499ab737f10ad9b3cd2b` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:15.232396 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b0fd0-0b91-4c53-8df4-c4fef438ad7c None admin] RBAC: Authorizing `identity:get_user(user_id=838e751633d3499ab737f10ad9b3cd2b)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:15.234378 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b0fd0-0b91-4c53-8df4-c4fef438ad7c None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:15.240766 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 62/130] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:35:15 2022] GET /identity/v3/users/838e751633d3499ab737f10ad9b3cd2b => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:15.241656 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b0fd0-0b91-4c53-8df4-c4fef438ad7c None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:15.248306 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d3cd0-593e-4abb-a3bd-eef6ac8fee5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:15.250587 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d3cd0-593e-4abb-a3bd-eef6ac8fee5e None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:15.250587 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d3cd0-593e-4abb-a3bd-eef6ac8fee5e None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:15.250587 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d3cd0-593e-4abb-a3bd-eef6ac8fee5e None admin] PATH_INFO: `/v3/projects/88c9c3d6e1924302b76cfeeb40525435` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:15.255923 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d3cd0-593e-4abb-a3bd-eef6ac8fee5e None admin] RBAC: Authorizing `identity:get_project(project_id=88c9c3d6e1924302b76cfeeb40525435)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:15.257372 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d3cd0-593e-4abb-a3bd-eef6ac8fee5e None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:15.259127 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 69/131] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:15 2022] GET /identity/v3/projects/88c9c3d6e1924302b76cfeeb40525435 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:15.259913 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d3cd0-593e-4abb-a3bd-eef6ac8fee5e None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:15.310279 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:15.385952 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d3cd0-593e-4abb-a3bd-eef6ac8fee5e None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:15.392141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b0fd0-0b91-4c53-8df4-c4fef438ad7c None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:15.425474 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406b2fc-9017-4cc2-a003-9fb5b0b731c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:15.426440 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406b2fc-9017-4cc2-a003-9fb5b0b731c9 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:15.426829 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406b2fc-9017-4cc2-a003-9fb5b0b731c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:15.427110 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406b2fc-9017-4cc2-a003-9fb5b0b731c9 None admin] PATH_INFO: `/v3/projects/32350b9a06344f80b8a7f780a421828d` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:15.428422 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406b2fc-9017-4cc2-a003-9fb5b0b731c9 None admin] RBAC: Authorizing `identity:get_project(project_id=32350b9a06344f80b8a7f780a421828d)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:15.429367 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17194c-1e68-4109-91c0-8c7e18876e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:15.429975 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406b2fc-9017-4cc2-a003-9fb5b0b731c9 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:15.430440 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17194c-1e68-4109-91c0-8c7e18876e04 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:15.430822 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17194c-1e68-4109-91c0-8c7e18876e04 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:15.431200 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17194c-1e68-4109-91c0-8c7e18876e04 None admin] PATH_INFO: `/v3/users/838e751633d3499ab737f10ad9b3cd2b` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:15.431676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 70/132] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:15 2022] GET /identity/v3/projects/32350b9a06344f80b8a7f780a421828d => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:15.432531 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406b2fc-9017-4cc2-a003-9fb5b0b731c9 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:15.432690 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17194c-1e68-4109-91c0-8c7e18876e04 None admin] RBAC: Authorizing `identity:get_user(user_id=838e751633d3499ab737f10ad9b3cd2b)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:15.434312 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17194c-1e68-4109-91c0-8c7e18876e04 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:15.436200 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 63/133] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:35:15 2022] GET /identity/v3/users/838e751633d3499ab737f10ad9b3cd2b => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:15.438003 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905aac0-364b-4e6f-ba33-00f8ed842729 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:15.438388 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905aac0-364b-4e6f-ba33-00f8ed842729 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:15.438783 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905aac0-364b-4e6f-ba33-00f8ed842729 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:15.440387 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 64/134] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:15.445170 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905aac0-364b-4e6f-ba33-00f8ed842729 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:15.518753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:15.552390 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406b2fc-9017-4cc2-a003-9fb5b0b731c9 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:15.555921 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:15.557843 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905aac0-364b-4e6f-ba33-00f8ed842729 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:15.591075 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07d5ec-251d-459a-9e25-9d31c0d6f023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:15.592219 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07d5ec-251d-459a-9e25-9d31c0d6f023 None admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:15.592509 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07d5ec-251d-459a-9e25-9d31c0d6f023 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:15.592868 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07d5ec-251d-459a-9e25-9d31c0d6f023 None admin] PATH_INFO: `/v3/projects/88c9c3d6e1924302b76cfeeb40525435/users/e5936312ffff4fbfb32882db5724bdca/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:15.594737 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce7eea-ed3d-441f-94aa-2d0be1e0d9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:15.595793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce7eea-ed3d-441f-94aa-2d0be1e0d9dd None admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:15.596055 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07d5ec-251d-459a-9e25-9d31c0d6f023 None admin] RBAC: Authorizing `identity:create_grant(project_id=88c9c3d6e1924302b76cfeeb40525435, user_id=e5936312ffff4fbfb32882db5724bdca, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:15.596267 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce7eea-ed3d-441f-94aa-2d0be1e0d9dd None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:15.596643 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce7eea-ed3d-441f-94aa-2d0be1e0d9dd None admin] PATH_INFO: `/v3/projects/32350b9a06344f80b8a7f780a421828d/users/838e751633d3499ab737f10ad9b3cd2b/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:15.597540 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07d5ec-251d-459a-9e25-9d31c0d6f023 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:15.599091 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce7eea-ed3d-441f-94aa-2d0be1e0d9dd None admin] RBAC: Authorizing `identity:create_grant(project_id=32350b9a06344f80b8a7f780a421828d, user_id=838e751633d3499ab737f10ad9b3cd2b, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:15.600779 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce7eea-ed3d-441f-94aa-2d0be1e0d9dd None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:15.686457 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 71/135] 10.222.0.39 () {58 vars in 1439 bytes} [Mon May 23 15:35:15 2022] PUT /identity/v3/projects/88c9c3d6e1924302b76cfeeb40525435/users/e5936312ffff4fbfb32882db5724bdca/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:35:15.688277 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07d5ec-251d-459a-9e25-9d31c0d6f023 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:15.712188 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 65/136] 10.222.0.39 () {58 vars in 1439 bytes} [Mon May 23 15:35:15 2022] PUT /identity/v3/projects/32350b9a06344f80b8a7f780a421828d/users/838e751633d3499ab737f10ad9b3cd2b/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:35:15.713779 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4935977-c481-462d-99d5-4afbc4bcb4ca None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:15.714154 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4935977-c481-462d-99d5-4afbc4bcb4ca None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:15.714530 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4935977-c481-462d-99d5-4afbc4bcb4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:15.748281 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-b4935977-c481-462d-99d5-4afbc4bcb4ca None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:15.749560 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-b4935977-c481-462d-99d5-4afbc4bcb4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:15.944449 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07d5ec-251d-459a-9e25-9d31c0d6f023 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:15.946369 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 66/137] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:15.995018 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4935977-c481-462d-99d5-4afbc4bcb4ca None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:16.014266 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4db803-bab2-4b8f-8b0c-d1af6c3e828c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:16.015203 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4db803-bab2-4b8f-8b0c-d1af6c3e828c None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:16.015645 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4db803-bab2-4b8f-8b0c-d1af6c3e828c None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:16.015912 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4db803-bab2-4b8f-8b0c-d1af6c3e828c None admin] PATH_INFO: `/v3/projects/88c9c3d6e1924302b76cfeeb40525435` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:16.017863 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4db803-bab2-4b8f-8b0c-d1af6c3e828c None admin] RBAC: Authorizing `identity:get_project(project_id=88c9c3d6e1924302b76cfeeb40525435)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:16.019339 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4db803-bab2-4b8f-8b0c-d1af6c3e828c None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:16.021288 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 72/138] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:15 2022] GET /identity/v3/projects/88c9c3d6e1924302b76cfeeb40525435 => generated 298 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:16.029534 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4db803-bab2-4b8f-8b0c-d1af6c3e828c None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:16.066631 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:16.077038 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:16.125678 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4935977-c481-462d-99d5-4afbc4bcb4ca None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:16.149828 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4db803-bab2-4b8f-8b0c-d1af6c3e828c None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:16.177297 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07b9ee-4733-44ba-9acb-d17721b280b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:16.178115 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07b9ee-4733-44ba-9acb-d17721b280b1 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:16.178411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07b9ee-4733-44ba-9acb-d17721b280b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:16.178697 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07b9ee-4733-44ba-9acb-d17721b280b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:16.184353 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07b9ee-4733-44ba-9acb-d17721b280b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:16.185834 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07b9ee-4733-44ba-9acb-d17721b280b1 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:16.188213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 67/139] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:35:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:35:16.190373 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb73c0-28a7-4915-a588-99280dcfc82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:16.191848 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb73c0-28a7-4915-a588-99280dcfc82f None admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:16.191848 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb73c0-28a7-4915-a588-99280dcfc82f None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:16.192324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb73c0-28a7-4915-a588-99280dcfc82f None admin] PATH_INFO: `/v3/projects/88c9c3d6e1924302b76cfeeb40525435/users/838e751633d3499ab737f10ad9b3cd2b/roles/a487e8d6e71d4a399b050274528d8db7` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:16.193649 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07b9ee-4733-44ba-9acb-d17721b280b1 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:16.194801 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb73c0-28a7-4915-a588-99280dcfc82f None admin] RBAC: Authorizing `identity:create_grant(project_id=88c9c3d6e1924302b76cfeeb40525435, user_id=838e751633d3499ab737f10ad9b3cd2b, role_id=a487e8d6e71d4a399b050274528d8db7)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:16.196264 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb73c0-28a7-4915-a588-99280dcfc82f None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:16.288592 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 73/140] 10.222.0.39 () {58 vars in 1439 bytes} [Mon May 23 15:35:16 2022] PUT /identity/v3/projects/88c9c3d6e1924302b76cfeeb40525435/users/838e751633d3499ab737f10ad9b3cd2b/roles/a487e8d6e71d4a399b050274528d8db7 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:35:16.339295 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07b9ee-4733-44ba-9acb-d17721b280b1 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:16.383998 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:16.395936 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090c51f-46cc-4e7e-a7bf-88a895ca3af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:16.396631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090c51f-46cc-4e7e-a7bf-88a895ca3af0 None admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:16.396932 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090c51f-46cc-4e7e-a7bf-88a895ca3af0 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:16.397225 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090c51f-46cc-4e7e-a7bf-88a895ca3af0 None admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:16.398083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090c51f-46cc-4e7e-a7bf-88a895ca3af0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:16.405422 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090c51f-46cc-4e7e-a7bf-88a895ca3af0 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:16.509080 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 68/141] 10.222.0.39 () {60 vars in 1132 bytes} [Mon May 23 15:35:16 2022] POST /identity/v3/users => generated 283 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:35:17.127542 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47264da3-b299-4063-b595-cdd10a15a1ad None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:17.128681 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47264da3-b299-4063-b595-cdd10a15a1ad None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:17.129233 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47264da3-b299-4063-b595-cdd10a15a1ad None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:17.130944 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 74/142] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:17.136779 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced01fa-7e0b-41e9-83de-730c4f61f3f0 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:17.137639 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced01fa-7e0b-41e9-83de-730c4f61f3f0 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:17.138127 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced01fa-7e0b-41e9-83de-730c4f61f3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:17.161522 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-eced01fa-7e0b-41e9-83de-730c4f61f3f0 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:17.163042 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-eced01fa-7e0b-41e9-83de-730c4f61f3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:17.273650 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 69/143] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:35:17.308254 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47264da3-b299-4063-b595-cdd10a15a1ad None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:17.426132 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:17.440742 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47264da3-b299-4063-b595-cdd10a15a1ad None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:17.479675 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12fd83c-0f30-4ef2-8e3f-15424fce8d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:17.480546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fd83c-0f30-4ef2-8e3f-15424fce8d28 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:17.480833 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fd83c-0f30-4ef2-8e3f-15424fce8d28 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:17.481116 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fd83c-0f30-4ef2-8e3f-15424fce8d28 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:17.493918 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12fd83c-0f30-4ef2-8e3f-15424fce8d28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:17.502509 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-e12fd83c-0f30-4ef2-8e3f-15424fce8d28 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:35:17.502509 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:17.502509 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:17.502509 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:17.502509 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:17.502509 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:17.502509 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:17.502509 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:17.502509 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:17.502509 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:17.502509 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:17.502509 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:17.502509 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:17.502509 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:17.502509 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:17.502509 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:17.503413 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:17.503413 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:17.503413 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:17.503413 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:17.503413 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:17.503413 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:17.503413 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:17.503413 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:17.503413 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:17.503413 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:17.503413 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:17.503413 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:35:17.503413 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:17.503413 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:17.503413 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:17.503413 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:17.504242 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:17.504242 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:17.504242 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:17.504242 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:17.504242 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:17.504242 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:17.504242 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:17.504242 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:17.504242 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:17.504242 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:17.504242 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:35:17.504242 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:35:17.504242 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 75/144] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:17.509884 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced01fa-7e0b-41e9-83de-730c4f61f3f0 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:17.623781 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62ae31-1071-4b26-89fc-da1ba2deb301 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:17.624104 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62ae31-1071-4b26-89fc-da1ba2deb301 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:17.624734 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62ae31-1071-4b26-89fc-da1ba2deb301 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:17.626168 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 76/145] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:35:17.633223 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced01fa-7e0b-41e9-83de-730c4f61f3f0 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:17.645265 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:17.647688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26464ef2-54e5-4bf5-b22a-188216744aa3 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:17.647980 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26464ef2-54e5-4bf5-b22a-188216744aa3 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:17.648259 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26464ef2-54e5-4bf5-b22a-188216744aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:17.673105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-26464ef2-54e5-4bf5-b22a-188216744aa3 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:17.674318 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-26464ef2-54e5-4bf5-b22a-188216744aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:17.707747 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe02456-fec1-42b8-b7be-3c40ecfe15fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:17.708347 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe02456-fec1-42b8-b7be-3c40ecfe15fc None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:17.708633 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe02456-fec1-42b8-b7be-3c40ecfe15fc None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:17.708910 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe02456-fec1-42b8-b7be-3c40ecfe15fc None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:17.709662 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe02456-fec1-42b8-b7be-3c40ecfe15fc None admin] RBAC: Adding query filter params (name=reader) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:17.709977 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe02456-fec1-42b8-b7be-3c40ecfe15fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:17.711379 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe02456-fec1-42b8-b7be-3c40ecfe15fc None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:17.730413 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 70/146] 10.222.0.39 () {56 vars in 1101 bytes} [Mon May 23 15:35:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:17.745875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe02456-fec1-42b8-b7be-3c40ecfe15fc None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:17.845167 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 77/147] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:17.879220 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26464ef2-54e5-4bf5-b22a-188216744aa3 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:17.895934 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe02456-fec1-42b8-b7be-3c40ecfe15fc None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:17.954870 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787a125-dc9e-4579-b12d-f0aa179fb497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:17.955894 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787a125-dc9e-4579-b12d-f0aa179fb497 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:17.956189 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787a125-dc9e-4579-b12d-f0aa179fb497 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:17.956480 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787a125-dc9e-4579-b12d-f0aa179fb497 None admin] PATH_INFO: `/v3/users/d4a13d5f01224ff9a57f0061c53ab19f` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:17.960433 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a787a125-dc9e-4579-b12d-f0aa179fb497 None admin] RBAC: Authorizing `identity:get_user(user_id=d4a13d5f01224ff9a57f0061c53ab19f)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:17.962144 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a787a125-dc9e-4579-b12d-f0aa179fb497 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:17.964014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 71/148] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:35:17 2022] GET /identity/v3/users/d4a13d5f01224ff9a57f0061c53ab19f => generated 289 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:17.971676 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787a125-dc9e-4579-b12d-f0aa179fb497 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:18.007982 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:18.022683 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26464ef2-54e5-4bf5-b22a-188216744aa3 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:18.064781 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ebdc9-8e1b-4e6d-9263-4b0a567cea73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:18.066204 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:18.066726 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ebdc9-8e1b-4e6d-9263-4b0a567cea73 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:18.067180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ebdc9-8e1b-4e6d-9263-4b0a567cea73 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:18.067649 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ebdc9-8e1b-4e6d-9263-4b0a567cea73 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:18.082667 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ebdc9-8e1b-4e6d-9263-4b0a567cea73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:18.092355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-e90ebdc9-8e1b-4e6d-9263-4b0a567cea73 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:18.092355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:18.092355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:18.092355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:18.092355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:18.092355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:18.092355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:18.092355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:18.092355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:18.092355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:18.092355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:18.092355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:18.092355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:18.092355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:18.092355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:18.092355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:18.093461 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:18.093461 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:18.093461 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:18.093461 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:18.093461 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:18.093461 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:18.093461 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:18.093461 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:18.093461 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:18.093461 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:18.093461 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:18.093461 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:35:18.093461 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:18.093461 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:18.093461 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:18.093461 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:18.094391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:18.094391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:18.094391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:18.094391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:18.094391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:18.094391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:18.094391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:18.094391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:18.094391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:18.094391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:18.094391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:18.094391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:35:18.097079 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 78/149] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:35:18.103526 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ebdc9-8e1b-4e6d-9263-4b0a567cea73 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:18.183367 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787a125-dc9e-4579-b12d-f0aa179fb497 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:18.238187 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7482b-ab50-4929-ad8b-46803497a345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:18.239354 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7482b-ab50-4929-ad8b-46803497a345 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:18.239830 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7482b-ab50-4929-ad8b-46803497a345 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:18.240274 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7482b-ab50-4929-ad8b-46803497a345 None admin] PATH_INFO: `/v3/projects/88c9c3d6e1924302b76cfeeb40525435` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:18.241635 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f7482b-ab50-4929-ad8b-46803497a345 None admin] RBAC: Authorizing `identity:get_project(project_id=88c9c3d6e1924302b76cfeeb40525435)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:18.243380 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f7482b-ab50-4929-ad8b-46803497a345 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:18.245475 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 72/150] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:17 2022] GET /identity/v3/projects/88c9c3d6e1924302b76cfeeb40525435 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:18.251309 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7482b-ab50-4929-ad8b-46803497a345 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:18.288349 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ebdc9-8e1b-4e6d-9263-4b0a567cea73 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:18.341817 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9fb40-3fbd-459b-9d05-45e36f2dea0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:18.342769 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9fb40-3fbd-459b-9d05-45e36f2dea0c None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:18.348071 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9fb40-3fbd-459b-9d05-45e36f2dea0c None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:18.348554 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9fb40-3fbd-459b-9d05-45e36f2dea0c None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:18.349796 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9fb40-3fbd-459b-9d05-45e36f2dea0c None admin] RBAC: Adding query filter params (name=member) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:18.350264 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9fb40-3fbd-459b-9d05-45e36f2dea0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:18.352318 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9fb40-3fbd-459b-9d05-45e36f2dea0c None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:18.359198 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:18.366946 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 79/151] 10.222.0.39 () {56 vars in 1101 bytes} [Mon May 23 15:35:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:18.375363 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9fb40-3fbd-459b-9d05-45e36f2dea0c None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:18.475256 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7482b-ab50-4929-ad8b-46803497a345 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:18.492611 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:18.556935 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d19a81-a6e9-4cd6-bc61-e666bbec747f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:18.557849 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d19a81-a6e9-4cd6-bc61-e666bbec747f None admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:18.558134 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d19a81-a6e9-4cd6-bc61-e666bbec747f None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:18.558409 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d19a81-a6e9-4cd6-bc61-e666bbec747f None admin] PATH_INFO: `/v3/projects/88c9c3d6e1924302b76cfeeb40525435/users/d4a13d5f01224ff9a57f0061c53ab19f/roles/86bedad6f8c84aefb5822c67df949d08` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:18.560425 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d19a81-a6e9-4cd6-bc61-e666bbec747f None admin] RBAC: Authorizing `identity:create_grant(project_id=88c9c3d6e1924302b76cfeeb40525435, user_id=d4a13d5f01224ff9a57f0061c53ab19f, role_id=86bedad6f8c84aefb5822c67df949d08)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:18.562555 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d19a81-a6e9-4cd6-bc61-e666bbec747f None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:18.594768 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9fb40-3fbd-459b-9d05-45e36f2dea0c None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:18.648066 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91171943-d9c7-43a9-80ef-3dffbf7e4b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:18.648991 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91171943-d9c7-43a9-80ef-3dffbf7e4b51 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:18.649282 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91171943-d9c7-43a9-80ef-3dffbf7e4b51 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:18.649556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91171943-d9c7-43a9-80ef-3dffbf7e4b51 None admin] PATH_INFO: `/v3/users/838e751633d3499ab737f10ad9b3cd2b` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:18.651900 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 73/152] 10.222.0.39 () {58 vars in 1439 bytes} [Mon May 23 15:35:18 2022] PUT /identity/v3/projects/88c9c3d6e1924302b76cfeeb40525435/users/d4a13d5f01224ff9a57f0061c53ab19f/roles/86bedad6f8c84aefb5822c67df949d08 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:35:18.652807 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91171943-d9c7-43a9-80ef-3dffbf7e4b51 None admin] RBAC: Authorizing `identity:get_user(user_id=838e751633d3499ab737f10ad9b3cd2b)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:18.654287 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91171943-d9c7-43a9-80ef-3dffbf7e4b51 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:18.656399 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 80/153] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:35:18 2022] GET /identity/v3/users/838e751633d3499ab737f10ad9b3cd2b => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:35:18.661975 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d19a81-a6e9-4cd6-bc61-e666bbec747f None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:18.810274 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d19a81-a6e9-4cd6-bc61-e666bbec747f None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:18.854818 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59240e6-86a1-4238-9b21-8f0e3822094b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:18.855485 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59240e6-86a1-4238-9b21-8f0e3822094b None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:18.855801 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59240e6-86a1-4238-9b21-8f0e3822094b None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:18.856081 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59240e6-86a1-4238-9b21-8f0e3822094b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:18.905288 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:18.951791 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59240e6-86a1-4238-9b21-8f0e3822094b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:18.954100 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59240e6-86a1-4238-9b21-8f0e3822094b None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:19.089706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 74/154] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:35:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:35:19.095328 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91171943-d9c7-43a9-80ef-3dffbf7e4b51 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:19.173783 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70c7b2-9242-496b-bd56-0cbe2008c8cd None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:19.174099 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70c7b2-9242-496b-bd56-0cbe2008c8cd None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:19.174381 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70c7b2-9242-496b-bd56-0cbe2008c8cd None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:19.175821 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 75/155] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:19.181655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4039f4c-d497-4792-83ae-d54925b4e532 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:19.181944 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4039f4c-d497-4792-83ae-d54925b4e532 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:19.182226 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4039f4c-d497-4792-83ae-d54925b4e532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:19.197109 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:19.210651 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-f4039f4c-d497-4792-83ae-d54925b4e532 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:19.210651 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-f4039f4c-d497-4792-83ae-d54925b4e532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:19.264988 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91171943-d9c7-43a9-80ef-3dffbf7e4b51 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:19.326725 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:19.327140 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 76/156] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:35:19.349887 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb3f1a-050f-4205-a5da-9f34f4c2c4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:19.350562 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4039f4c-d497-4792-83ae-d54925b4e532 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:19.350698 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb3f1a-050f-4205-a5da-9f34f4c2c4de None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:19.350949 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb3f1a-050f-4205-a5da-9f34f4c2c4de None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:19.351224 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb3f1a-050f-4205-a5da-9f34f4c2c4de None admin] PATH_INFO: `/v3/projects/88c9c3d6e1924302b76cfeeb40525435` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:19.356367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb3f1a-050f-4205-a5da-9f34f4c2c4de None admin] RBAC: Authorizing `identity:get_project(project_id=88c9c3d6e1924302b76cfeeb40525435)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:19.357838 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb3f1a-050f-4205-a5da-9f34f4c2c4de None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:19.359700 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 81/157] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:19 2022] GET /identity/v3/projects/88c9c3d6e1924302b76cfeeb40525435 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:19.371931 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb3f1a-050f-4205-a5da-9f34f4c2c4de None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:19.489329 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4039f4c-d497-4792-83ae-d54925b4e532 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:19.541801 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e9019-09a3-4366-8e0f-08d1091f9c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:19.542612 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e9019-09a3-4366-8e0f-08d1091f9c74 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:19.542890 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e9019-09a3-4366-8e0f-08d1091f9c74 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:19.543160 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e9019-09a3-4366-8e0f-08d1091f9c74 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:19.561044 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e9019-09a3-4366-8e0f-08d1091f9c74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:19.573581 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-250e9019-09a3-4366-8e0f-08d1091f9c74 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:19.573581 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:19.573581 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:19.573581 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:19.573581 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:19.573581 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:19.573581 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:19.573581 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:19.573581 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:19.573581 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:19.573581 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:19.573581 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:19.573581 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:19.573581 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:19.573581 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:19.573581 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:19.574496 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:19.574496 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:19.574496 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:19.574496 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:19.574496 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:19.574496 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:19.574496 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:19.574496 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:19.574496 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:19.574496 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:19.574496 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:19.574496 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:35:19.574496 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:19.574496 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:19.574496 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:19.574496 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:19.575265 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:19.575265 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:19.575265 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:19.575265 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:19.575265 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:19.575265 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:19.575265 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:19.575265 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:19.575265 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:19.575265 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:19.575265 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:19.575265 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:35:19.578375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 77/158] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:19.605248 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e9019-09a3-4366-8e0f-08d1091f9c74 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:19.607782 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb3f1a-050f-4205-a5da-9f34f4c2c4de None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:19.667645 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7816412-3125-4f5f-b1de-4d5fffae8a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:19.667645 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7816412-3125-4f5f-b1de-4d5fffae8a0d None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:19.667645 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7816412-3125-4f5f-b1de-4d5fffae8a0d None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:19.667645 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7816412-3125-4f5f-b1de-4d5fffae8a0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:19.668074 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7816412-3125-4f5f-b1de-4d5fffae8a0d None admin] RBAC: Adding query filter params (role.id=c41a7cd1c92b45a7bff9632d07b48006, scope.project.id=88c9c3d6e1924302b76cfeeb40525435, user.id=838e751633d3499ab737f10ad9b3cd2b) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:19.668074 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7816412-3125-4f5f-b1de-4d5fffae8a0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:19.668074 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7816412-3125-4f5f-b1de-4d5fffae8a0d None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:19.677671 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 82/159] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:35:19 2022] GET /identity/v3/role_assignments?user.id=838e751633d3499ab737f10ad9b3cd2b&scope.project.id=88c9c3d6e1924302b76cfeeb40525435&role.id=c41a7cd1c92b45a7bff9632d07b48006 => generated 608 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:35:19.679359 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e69b5-209c-4a99-af19-236c9c9b01dc None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:19.679842 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e69b5-209c-4a99-af19-236c9c9b01dc None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:19.680286 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e69b5-209c-4a99-af19-236c9c9b01dc None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:19.681811 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 83/160] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:19.682281 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:19.689515 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5899ee-61ae-4ffa-b475-422bcfba7611 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:19.689798 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5899ee-61ae-4ffa-b475-422bcfba7611 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:19.690076 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5899ee-61ae-4ffa-b475-422bcfba7611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:19.709521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:19.713093 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-1e5899ee-61ae-4ffa-b475-422bcfba7611 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:19.714283 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-1e5899ee-61ae-4ffa-b475-422bcfba7611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:19.785215 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e9019-09a3-4366-8e0f-08d1091f9c74 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:19.844875 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 84/161] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:19.855358 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721eb6a-01af-4d0d-9547-284e577fbdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:19.855983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721eb6a-01af-4d0d-9547-284e577fbdda None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:19.856264 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721eb6a-01af-4d0d-9547-284e577fbdda None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:19.856538 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721eb6a-01af-4d0d-9547-284e577fbdda None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:19.857305 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721eb6a-01af-4d0d-9547-284e577fbdda None admin] RBAC: Adding query filter params (name=member) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:19.857610 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721eb6a-01af-4d0d-9547-284e577fbdda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:19.859234 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721eb6a-01af-4d0d-9547-284e577fbdda None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:19.868725 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 78/162] 10.222.0.39 () {56 vars in 1101 bytes} [Mon May 23 15:35:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:35:19.875153 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5899ee-61ae-4ffa-b475-422bcfba7611 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:19.897267 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721eb6a-01af-4d0d-9547-284e577fbdda None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:20.068672 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721eb6a-01af-4d0d-9547-284e577fbdda None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:20.094156 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:20.118304 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5edc4-dbfb-4b67-93af-0653b7a66fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:20.118304 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5edc4-dbfb-4b67-93af-0653b7a66fbf None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:20.118304 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5edc4-dbfb-4b67-93af-0653b7a66fbf None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:20.118304 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5edc4-dbfb-4b67-93af-0653b7a66fbf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:20.128271 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5edc4-dbfb-4b67-93af-0653b7a66fbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:20.129837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5899ee-61ae-4ffa-b475-422bcfba7611 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:20.138231 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-d7e5edc4-dbfb-4b67-93af-0653b7a66fbf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:35:20.138231 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:20.138231 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:20.138231 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:20.138231 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:20.138231 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:20.138231 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:20.138231 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:20.138231 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:20.138231 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:20.138231 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:20.138231 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:20.138231 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:20.138231 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:20.138231 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:20.138231 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:20.139166 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:20.139166 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:20.139166 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:20.139166 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:20.139166 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:20.139166 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:20.139166 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:20.139166 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:20.139166 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:20.139166 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:20.139166 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:20.139166 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:35:20.139166 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:20.139166 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:20.139166 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:20.139166 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:20.140315 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:20.140315 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:20.140315 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:20.140315 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:20.140315 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:20.140315 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:20.140315 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:20.140315 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:20.140315 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:20.140315 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:20.140315 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:35:20.140315 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:35:20.140315 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 79/163] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:35:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:35:20.147780 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5edc4-dbfb-4b67-93af-0653b7a66fbf None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:20.222240 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:20.249333 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f06c25-be11-4ff8-ad94-36cbc6d17929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:20.250878 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f06c25-be11-4ff8-ad94-36cbc6d17929 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:20.251166 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f06c25-be11-4ff8-ad94-36cbc6d17929 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:20.251452 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f06c25-be11-4ff8-ad94-36cbc6d17929 None admin] PATH_INFO: `/v3/users/838e751633d3499ab737f10ad9b3cd2b` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:20.256359 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f06c25-be11-4ff8-ad94-36cbc6d17929 None admin] RBAC: Authorizing `identity:get_user(user_id=838e751633d3499ab737f10ad9b3cd2b)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:20.257877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f06c25-be11-4ff8-ad94-36cbc6d17929 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:20.259560 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 85/164] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:35:19 2022] GET /identity/v3/users/838e751633d3499ab737f10ad9b3cd2b => generated 275 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:20.269177 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f06c25-be11-4ff8-ad94-36cbc6d17929 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:20.349830 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5edc4-dbfb-4b67-93af-0653b7a66fbf None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:20.419892 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f06c25-be11-4ff8-ad94-36cbc6d17929 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:20.448344 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3ecae-3741-4b8a-a31e-67ec6addfda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:20.449048 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3ecae-3741-4b8a-a31e-67ec6addfda6 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:20.449330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3ecae-3741-4b8a-a31e-67ec6addfda6 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:20.449607 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3ecae-3741-4b8a-a31e-67ec6addfda6 None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:20.450441 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3ecae-3741-4b8a-a31e-67ec6addfda6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:20.450752 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3ecae-3741-4b8a-a31e-67ec6addfda6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:20.452780 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3ecae-3741-4b8a-a31e-67ec6addfda6 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:20.470231 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 80/165] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:35:20.475584 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3ecae-3741-4b8a-a31e-67ec6addfda6 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:20.476333 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a0ee8-9928-4c88-ac81-c902ec30a736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:20.477008 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a0ee8-9928-4c88-ac81-c902ec30a736 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:20.477297 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a0ee8-9928-4c88-ac81-c902ec30a736 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:20.477579 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a0ee8-9928-4c88-ac81-c902ec30a736 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:20.567981 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:20.572225 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a0ee8-9928-4c88-ac81-c902ec30a736 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:20.573759 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a0ee8-9928-4c88-ac81-c902ec30a736 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:20.587973 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:20.695339 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3ecae-3741-4b8a-a31e-67ec6addfda6 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:20.723517 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 86/166] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:35:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 15:35:20.740695 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a0ee8-9928-4c88-ac81-c902ec30a736 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:20.763238 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed03da6-fcc6-406c-bfc4-50e90363161c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:20.764161 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed03da6-fcc6-406c-bfc4-50e90363161c None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:20.764485 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed03da6-fcc6-406c-bfc4-50e90363161c None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:20.764843 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed03da6-fcc6-406c-bfc4-50e90363161c None admin] PATH_INFO: `/v3/users/e5936312ffff4fbfb32882db5724bdca` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:20.769621 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed03da6-fcc6-406c-bfc4-50e90363161c None admin] RBAC: Authorizing `identity:get_user(user_id=e5936312ffff4fbfb32882db5724bdca)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:20.771174 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed03da6-fcc6-406c-bfc4-50e90363161c None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:20.773233 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 81/167] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:35:20 2022] GET /identity/v3/users/e5936312ffff4fbfb32882db5724bdca => generated 247 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:20.778272 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed03da6-fcc6-406c-bfc4-50e90363161c None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:20.903784 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a0ee8-9928-4c88-ac81-c902ec30a736 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:20.907105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:20.935209 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed03da6-fcc6-406c-bfc4-50e90363161c None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:20.956608 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:20.990763 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6839e-605c-444b-923f-18aebb162cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:20.991445 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6839e-605c-444b-923f-18aebb162cf0 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:20.991741 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6839e-605c-444b-923f-18aebb162cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:20.992023 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6839e-605c-444b-923f-18aebb162cf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:21.036344 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be252c-2533-48b4-818a-af00873e9800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:21.037240 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be252c-2533-48b4-818a-af00873e9800 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:21.037530 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be252c-2533-48b4-818a-af00873e9800 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:21.037814 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be252c-2533-48b4-818a-af00873e9800 None admin] PATH_INFO: `/v3/projects/32350b9a06344f80b8a7f780a421828d` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:21.044398 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be252c-2533-48b4-818a-af00873e9800 None admin] RBAC: Authorizing `identity:get_project(project_id=32350b9a06344f80b8a7f780a421828d)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:21.045889 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be252c-2533-48b4-818a-af00873e9800 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:21.049114 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 87/168] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:20 2022] GET /identity/v3/projects/32350b9a06344f80b8a7f780a421828d => generated 312 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:21.080665 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be252c-2533-48b4-818a-af00873e9800 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:21.086446 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6839e-605c-444b-923f-18aebb162cf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:21.087971 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6839e-605c-444b-923f-18aebb162cf0 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:21.201683 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 82/169] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:35:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:35:21.212788 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6839e-605c-444b-923f-18aebb162cf0 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:21.231967 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:21.461744 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6839e-605c-444b-923f-18aebb162cf0 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:21.514197 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be252c-2533-48b4-818a-af00873e9800 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:21.597012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b4c8c-70a0-4ed7-b284-5d06e33da38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:21.597724 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b4c8c-70a0-4ed7-b284-5d06e33da38a None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:21.598008 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b4c8c-70a0-4ed7-b284-5d06e33da38a None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:21.598283 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b4c8c-70a0-4ed7-b284-5d06e33da38a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:21.599133 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b4c8c-70a0-4ed7-b284-5d06e33da38a None admin] RBAC: Adding query filter params (role.id=c41a7cd1c92b45a7bff9632d07b48006, scope.project.id=32350b9a06344f80b8a7f780a421828d, user.id=838e751633d3499ab737f10ad9b3cd2b) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:21.599447 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b4c8c-70a0-4ed7-b284-5d06e33da38a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:21.601125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b4c8c-70a0-4ed7-b284-5d06e33da38a None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:21.601602 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b3e85-afab-4202-aea4-eede23c6ef71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:21.602702 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b3e85-afab-4202-aea4-eede23c6ef71 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:21.604861 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b3e85-afab-4202-aea4-eede23c6ef71 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:21.605947 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b3e85-afab-4202-aea4-eede23c6ef71 None admin] PATH_INFO: `/v3/projects/88c9c3d6e1924302b76cfeeb40525435` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:21.614840 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b3e85-afab-4202-aea4-eede23c6ef71 None admin] RBAC: Authorizing `identity:get_project(project_id=88c9c3d6e1924302b76cfeeb40525435)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:21.617864 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b3e85-afab-4202-aea4-eede23c6ef71 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:21.622282 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 83/170] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:21 2022] GET /identity/v3/projects/88c9c3d6e1924302b76cfeeb40525435 => generated 298 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:21.625619 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 88/171] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:35:21 2022] GET /identity/v3/role_assignments?user.id=838e751633d3499ab737f10ad9b3cd2b&scope.project.id=32350b9a06344f80b8a7f780a421828d&role.id=c41a7cd1c92b45a7bff9632d07b48006 => generated 608 bytes in 545 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:21.627044 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b5510-47ab-4a81-8de8-012bcdb9aa08 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:21.627338 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b5510-47ab-4a81-8de8-012bcdb9aa08 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:21.627662 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b5510-47ab-4a81-8de8-012bcdb9aa08 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:21.634037 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 89/172] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:21.639954 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b5510-47ab-4a81-8de8-012bcdb9aa08 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:21.640534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1779392-eb84-4cab-810e-9ba01730313c None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:21.641025 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1779392-eb84-4cab-810e-9ba01730313c None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:21.641521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1779392-eb84-4cab-810e-9ba01730313c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:21.703751 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-e1779392-eb84-4cab-810e-9ba01730313c None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:21.709286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-e1779392-eb84-4cab-810e-9ba01730313c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:21.789363 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:21.985365 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 84/173] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:35:21.986947 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbd0a3-f701-47f2-bb38-54369d07640a None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:21.987672 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbd0a3-f701-47f2-bb38-54369d07640a None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:21.988090 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbd0a3-f701-47f2-bb38-54369d07640a None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:21.989509 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 85/174] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:21.995825 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac02b47-915d-4df4-8c7a-dce91b80783c None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:21.996293 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac02b47-915d-4df4-8c7a-dce91b80783c None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:21.996808 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac02b47-915d-4df4-8c7a-dce91b80783c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:21.999857 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b5510-47ab-4a81-8de8-012bcdb9aa08 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:22.026533 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-4ac02b47-915d-4df4-8c7a-dce91b80783c None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:22.029486 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-4ac02b47-915d-4df4-8c7a-dce91b80783c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:22.036302 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:22.081542 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22038940-7a52-436e-9c2b-d87580cdaaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:22.082203 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22038940-7a52-436e-9c2b-d87580cdaaf0 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:22.082484 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22038940-7a52-436e-9c2b-d87580cdaaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:22.082758 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22038940-7a52-436e-9c2b-d87580cdaaf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:22.083610 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22038940-7a52-436e-9c2b-d87580cdaaf0 None admin] RBAC: Adding query filter params (role.id=3ab888f5f68740bd8f9df4447f4f5a7a, scope.project.id=88c9c3d6e1924302b76cfeeb40525435, user.id=e5936312ffff4fbfb32882db5724bdca) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:22.083929 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22038940-7a52-436e-9c2b-d87580cdaaf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:22.085383 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22038940-7a52-436e-9c2b-d87580cdaaf0 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:22.096392 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 90/175] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:35:21 2022] GET /identity/v3/role_assignments?user.id=e5936312ffff4fbfb32882db5724bdca&scope.project.id=88c9c3d6e1924302b76cfeeb40525435&role.id=3ab888f5f68740bd8f9df4447f4f5a7a => generated 608 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:22.097228 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22038940-7a52-436e-9c2b-d87580cdaaf0 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:22.165145 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 86/176] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:35:22.166513 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd6942-4957-44b3-9457-0f9c988c7c30 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:22.167696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd6942-4957-44b3-9457-0f9c988c7c30 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:22.167696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd6942-4957-44b3-9457-0f9c988c7c30 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:22.168495 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 87/177] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:22.174549 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11295d63-1f84-4ccb-8d33-bd5a1bd6419e None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:22.174848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11295d63-1f84-4ccb-8d33-bd5a1bd6419e None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:22.175114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11295d63-1f84-4ccb-8d33-bd5a1bd6419e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:22.246945 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-11295d63-1f84-4ccb-8d33-bd5a1bd6419e None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:22.246945 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-11295d63-1f84-4ccb-8d33-bd5a1bd6419e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:22.338280 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:22.353501 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22038940-7a52-436e-9c2b-d87580cdaaf0 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:22.384039 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 88/178] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:35:22.388891 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11295d63-1f84-4ccb-8d33-bd5a1bd6419e None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:22.422846 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d197cb-f3ba-4a81-9600-6b2416d41b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:22.423700 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d197cb-f3ba-4a81-9600-6b2416d41b6f None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:22.423989 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d197cb-f3ba-4a81-9600-6b2416d41b6f None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:22.424267 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d197cb-f3ba-4a81-9600-6b2416d41b6f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:22.441643 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d197cb-f3ba-4a81-9600-6b2416d41b6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:22.450013 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-44d197cb-f3ba-4a81-9600-6b2416d41b6f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:35:22.450013 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:22.450013 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:22.450013 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:22.450013 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:22.450013 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:22.450013 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:22.450013 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:22.450013 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:22.450013 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:22.450013 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:22.450013 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:22.450013 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:22.450013 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:22.450013 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:22.450013 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:22.450919 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:22.450919 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:22.450919 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:22.450919 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:22.450919 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:22.450919 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:22.450919 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:22.450919 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:22.450919 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:22.450919 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:22.450919 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:22.450919 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:35:22.450919 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:22.450919 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:22.450919 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:22.450919 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:22.451728 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:22.451728 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:22.451728 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:22.451728 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:22.451728 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:22.451728 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:22.451728 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:22.451728 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:22.451728 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:22.451728 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:22.451728 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:35:22.451728 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:35:22.451728 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 91/179] 10.222.0.39 () {56 vars in 1114 bytes} [Mon May 23 15:35:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:22.452612 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d197cb-f3ba-4a81-9600-6b2416d41b6f None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:22.482470 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:22.519674 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11295d63-1f84-4ccb-8d33-bd5a1bd6419e None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:22.555257 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19762f-45a5-4438-9a1c-9784aedf18ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:22.556443 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19762f-45a5-4438-9a1c-9784aedf18ab None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:22.556935 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19762f-45a5-4438-9a1c-9784aedf18ab None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:22.557408 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19762f-45a5-4438-9a1c-9784aedf18ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:22.569428 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19762f-45a5-4438-9a1c-9784aedf18ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:22.572878 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d197cb-f3ba-4a81-9600-6b2416d41b6f None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:22.578328 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-6a19762f-45a5-4438-9a1c-9784aedf18ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:35:22.578328 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:22.578328 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:22.578328 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:22.578328 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:22.578328 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:22.578328 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:22.578328 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:22.578328 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:22.578328 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:22.578328 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:22.578328 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:22.578328 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:22.578328 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:22.578328 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:22.578328 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:22.579448 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:22.579448 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:22.579448 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:22.579448 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:22.579448 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:22.579448 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:22.579448 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:22.579448 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:22.579448 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:22.579448 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:22.579448 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:22.579448 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:35:22.579448 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:22.579448 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:22.579448 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:22.579448 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:22.580283 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:22.580283 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:22.580283 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:22.580283 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:22.580283 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:22.580283 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:22.580283 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:22.580283 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:22.580283 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:22.580283 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:22.580283 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:35:22.580283 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:35:22.580283 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 89/180] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:35:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:22.580929 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19762f-45a5-4438-9a1c-9784aedf18ab None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:22.622508 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de4cd6-cd69-49ac-82bc-533aa5046e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:22.623226 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de4cd6-cd69-49ac-82bc-533aa5046e99 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:22.623515 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de4cd6-cd69-49ac-82bc-533aa5046e99 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:22.623826 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de4cd6-cd69-49ac-82bc-533aa5046e99 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:22.625235 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de4cd6-cd69-49ac-82bc-533aa5046e99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:22.626708 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de4cd6-cd69-49ac-82bc-533aa5046e99 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:22.628562 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 92/181] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:35:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:22.629579 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ed947-2385-4a6c-9784-db51494e75d3 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:22.629869 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ed947-2385-4a6c-9784-db51494e75d3 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:22.630186 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ed947-2385-4a6c-9784-db51494e75d3 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:22.631528 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 93/182] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:22.636938 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ed947-2385-4a6c-9784-db51494e75d3 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:22.663817 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:22.701255 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19762f-45a5-4438-9a1c-9784aedf18ab None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:22.730833 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:22.739515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44b1c3-f4f9-4c2e-a5f7-5087898e812c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:22.740234 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44b1c3-f4f9-4c2e-a5f7-5087898e812c None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:22.740516 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44b1c3-f4f9-4c2e-a5f7-5087898e812c None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:22.740795 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44b1c3-f4f9-4c2e-a5f7-5087898e812c None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:22.741563 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44b1c3-f4f9-4c2e-a5f7-5087898e812c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:22.741856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44b1c3-f4f9-4c2e-a5f7-5087898e812c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:22.743255 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44b1c3-f4f9-4c2e-a5f7-5087898e812c None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:22.748563 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ed947-2385-4a6c-9784-db51494e75d3 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:22.754181 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 90/183] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:35:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:22.759750 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44b1c3-f4f9-4c2e-a5f7-5087898e812c None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:22.789995 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bac828-25c7-4bda-bcdc-fe13379f678f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:22.790651 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bac828-25c7-4bda-bcdc-fe13379f678f None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:22.790932 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bac828-25c7-4bda-bcdc-fe13379f678f None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:22.791206 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bac828-25c7-4bda-bcdc-fe13379f678f None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:22.791978 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bac828-25c7-4bda-bcdc-fe13379f678f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:22.792287 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bac828-25c7-4bda-bcdc-fe13379f678f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:22.793658 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bac828-25c7-4bda-bcdc-fe13379f678f None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:22.802121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 94/184] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:22.803285 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b3ac9-c877-467f-9303-73ddfd9ac8dc None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:22.803579 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b3ac9-c877-467f-9303-73ddfd9ac8dc None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:22.803884 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b3ac9-c877-467f-9303-73ddfd9ac8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:22.820178 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-839b3ac9-c877-467f-9303-73ddfd9ac8dc None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:22.821365 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-839b3ac9-c877-467f-9303-73ddfd9ac8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:22.869387 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44b1c3-f4f9-4c2e-a5f7-5087898e812c None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:22.896507 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 95/185] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:22.900469 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b3ac9-c877-467f-9303-73ddfd9ac8dc None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:22.902593 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84868b6-379f-4681-9055-796b3288eddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:22.903267 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84868b6-379f-4681-9055-796b3288eddf None admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:22.903560 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84868b6-379f-4681-9055-796b3288eddf None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:22.903857 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84868b6-379f-4681-9055-796b3288eddf None admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:22.904571 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84868b6-379f-4681-9055-796b3288eddf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:22.906553 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84868b6-379f-4681-9055-796b3288eddf None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:22.917459 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:22.998344 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b3ac9-c877-467f-9303-73ddfd9ac8dc None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:23.002131 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 91/186] 10.222.0.39 () {60 vars in 1132 bytes} [Mon May 23 15:35:22 2022] POST /identity/v3/users => generated 297 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:35:23.011801 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ca383-aac2-4481-b128-c46316c5ea00 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:23.011801 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ca383-aac2-4481-b128-c46316c5ea00 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:23.011801 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ca383-aac2-4481-b128-c46316c5ea00 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:23.011801 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 92/187] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:23.011801 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ca383-aac2-4481-b128-c46316c5ea00 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:23.050326 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69aa63-f067-4a9a-aed8-0c3966013c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:23.052472 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69aa63-f067-4a9a-aed8-0c3966013c34 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:23.052927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69aa63-f067-4a9a-aed8-0c3966013c34 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:23.053377 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69aa63-f067-4a9a-aed8-0c3966013c34 None admin] PATH_INFO: `/v3/users/838e751633d3499ab737f10ad9b3cd2b` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:23.054811 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf69aa63-f067-4a9a-aed8-0c3966013c34 None admin] RBAC: Authorizing `identity:get_user(user_id=838e751633d3499ab737f10ad9b3cd2b)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:23.057016 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf69aa63-f067-4a9a-aed8-0c3966013c34 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:23.059864 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 96/188] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:35:22 2022] GET /identity/v3/users/838e751633d3499ab737f10ad9b3cd2b => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:23.061253 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69aa63-f067-4a9a-aed8-0c3966013c34 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:23.064896 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:23.131742 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ca383-aac2-4481-b128-c46316c5ea00 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:23.161068 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:23.170454 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3a34b-4f41-4884-b984-464a9a371fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:23.171630 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3a34b-4f41-4884-b984-464a9a371fa3 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:23.171910 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3a34b-4f41-4884-b984-464a9a371fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:23.172187 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3a34b-4f41-4884-b984-464a9a371fa3 None admin] PATH_INFO: `/v3/users/4520b22a13054c5f999561a70e7a9b09` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:23.183077 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69aa63-f067-4a9a-aed8-0c3966013c34 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:23.188569 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3a34b-4f41-4884-b984-464a9a371fa3 None admin] RBAC: Authorizing `identity:get_user(user_id=4520b22a13054c5f999561a70e7a9b09)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:23.190079 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3a34b-4f41-4884-b984-464a9a371fa3 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:23.194881 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 93/189] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:35:23 2022] GET /identity/v3/users/4520b22a13054c5f999561a70e7a9b09 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:23.194881 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f0e62-8c0f-4946-935c-f9a7d5e5f869 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:23.194881 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f0e62-8c0f-4946-935c-f9a7d5e5f869 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:23.194881 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f0e62-8c0f-4946-935c-f9a7d5e5f869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:23.218491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-639f0e62-8c0f-4946-935c-f9a7d5e5f869 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:23.219229 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-639f0e62-8c0f-4946-935c-f9a7d5e5f869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:23.235100 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db82fcd-e3f0-494e-a36d-8aa0530c2fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:23.237151 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db82fcd-e3f0-494e-a36d-8aa0530c2fda None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:23.237151 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db82fcd-e3f0-494e-a36d-8aa0530c2fda None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:23.237151 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db82fcd-e3f0-494e-a36d-8aa0530c2fda None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:23.250375 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db82fcd-e3f0-494e-a36d-8aa0530c2fda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:23.260618 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-8db82fcd-e3f0-494e-a36d-8aa0530c2fda None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:35:23.260618 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:23.260618 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:23.260618 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:23.260618 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:23.260618 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:23.260618 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:23.260618 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:23.260618 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:23.260618 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:23.260618 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:23.260618 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:23.260618 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:23.260618 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:23.260618 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:23.260618 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:23.261504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:23.261504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:23.261504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:23.261504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:23.261504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:23.261504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:23.261504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:23.261504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:23.261504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:23.261504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:23.261504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:23.261504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:35:23.261504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:23.261504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:23.261504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:23.261504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:23.262322 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:23.262322 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:23.262322 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:23.262322 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:23.262322 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:23.262322 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:23.262322 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:23.262322 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:23.262322 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:23.262322 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:23.262322 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:35:23.262322 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:35:23.262322 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 97/190] 10.222.0.39 () {56 vars in 1114 bytes} [Mon May 23 15:35:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:23.265086 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db82fcd-e3f0-494e-a36d-8aa0530c2fda None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:23.298792 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 94/191] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:23.299395 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f0e62-8c0f-4946-935c-f9a7d5e5f869 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:23.339339 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:23.384750 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db82fcd-e3f0-494e-a36d-8aa0530c2fda None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:23.419809 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f0e62-8c0f-4946-935c-f9a7d5e5f869 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:23.436736 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5f55f-cd11-48fb-9437-4dba947b96cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:23.437796 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5f55f-cd11-48fb-9437-4dba947b96cf None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:23.438307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5f55f-cd11-48fb-9437-4dba947b96cf None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:23.438815 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5f55f-cd11-48fb-9437-4dba947b96cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:23.453268 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:23.462648 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb995a43-ec8e-450e-b547-bded297d34c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:23.463492 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb995a43-ec8e-450e-b547-bded297d34c7 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:23.463941 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb995a43-ec8e-450e-b547-bded297d34c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:23.465036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb995a43-ec8e-450e-b547-bded297d34c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:23.518998 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5f55f-cd11-48fb-9437-4dba947b96cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:23.520637 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5f55f-cd11-48fb-9437-4dba947b96cf None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:23.539554 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb995a43-ec8e-450e-b547-bded297d34c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:23.541169 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb995a43-ec8e-450e-b547-bded297d34c7 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:23.578411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:23.634930 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 98/192] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:35:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:35:23.639721 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5f55f-cd11-48fb-9437-4dba947b96cf None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:23.657770 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 95/193] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:35:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:35:23.658933 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb995a43-ec8e-450e-b547-bded297d34c7 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:23.682868 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:23.747238 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5f55f-cd11-48fb-9437-4dba947b96cf None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:23.771946 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb995a43-ec8e-450e-b547-bded297d34c7 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:23.792930 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e1c6c-0a33-4881-8672-55bd757f0ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:23.793590 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e1c6c-0a33-4881-8672-55bd757f0ba5 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:23.793867 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e1c6c-0a33-4881-8672-55bd757f0ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:23.794139 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e1c6c-0a33-4881-8672-55bd757f0ba5 None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:23.794882 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e1c6c-0a33-4881-8672-55bd757f0ba5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:23.795800 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e1c6c-0a33-4881-8672-55bd757f0ba5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:23.797801 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e1c6c-0a33-4881-8672-55bd757f0ba5 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:23.810417 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 99/194] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:35:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:23.812578 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e1c6c-0a33-4881-8672-55bd757f0ba5 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:23.813918 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b9ffc-1baf-4d43-a251-fab02adf9b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:23.814829 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b9ffc-1baf-4d43-a251-fab02adf9b70 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:23.815226 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b9ffc-1baf-4d43-a251-fab02adf9b70 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:23.815591 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b9ffc-1baf-4d43-a251-fab02adf9b70 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:23.818856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:23.833998 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b9ffc-1baf-4d43-a251-fab02adf9b70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:23.849513 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-3d1b9ffc-1baf-4d43-a251-fab02adf9b70 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:35:23.849513 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:23.849513 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:23.849513 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:23.849513 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:23.849513 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:23.849513 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:23.849513 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:23.849513 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:23.849513 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:23.849513 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:23.849513 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:23.849513 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:23.849513 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:23.849513 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:23.849513 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:23.850960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:23.850960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:23.850960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:23.850960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:23.850960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:23.850960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:23.850960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:23.850960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:23.850960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:23.850960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:23.850960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:23.850960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:35:23.850960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:23.850960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:23.850960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:23.850960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:23.851778 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:23.851778 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:23.851778 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:23.851778 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:23.851778 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:23.851778 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:23.851778 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:23.851778 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:23.851778 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:23.851778 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:23.851778 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:35:23.851778 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:35:23.853024 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 96/195] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:23.857879 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b9ffc-1baf-4d43-a251-fab02adf9b70 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:23.948922 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e1c6c-0a33-4881-8672-55bd757f0ba5 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:23.953679 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:23.976563 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b9ffc-1baf-4d43-a251-fab02adf9b70 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:23.988476 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7d64b-502f-4c3a-b1b6-62d957cdcdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:23.989527 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7d64b-502f-4c3a-b1b6-62d957cdcdf2 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:23.989932 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7d64b-502f-4c3a-b1b6-62d957cdcdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:23.990477 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7d64b-502f-4c3a-b1b6-62d957cdcdf2 None admin] PATH_INFO: `/v3/projects/88c9c3d6e1924302b76cfeeb40525435` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:23.991639 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f7d64b-502f-4c3a-b1b6-62d957cdcdf2 None admin] RBAC: Authorizing `identity:get_project(project_id=88c9c3d6e1924302b76cfeeb40525435)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:23.993314 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f7d64b-502f-4c3a-b1b6-62d957cdcdf2 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:23.995038 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 100/196] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:23 2022] GET /identity/v3/projects/88c9c3d6e1924302b76cfeeb40525435 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:24.000721 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7d64b-502f-4c3a-b1b6-62d957cdcdf2 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:24.024946 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33950156-fb99-4900-8b99-6d0d87691ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:24.026359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33950156-fb99-4900-8b99-6d0d87691ee8 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:24.026793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33950156-fb99-4900-8b99-6d0d87691ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:24.027465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33950156-fb99-4900-8b99-6d0d87691ee8 None admin] PATH_INFO: `/v3/projects/f050448816e04bc3ace6d56d9ec83679` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:24.029539 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33950156-fb99-4900-8b99-6d0d87691ee8 None admin] RBAC: Authorizing `identity:get_project(project_id=f050448816e04bc3ace6d56d9ec83679)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:24.031782 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33950156-fb99-4900-8b99-6d0d87691ee8 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:24.033725 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 97/197] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:23 2022] GET /identity/v3/projects/f050448816e04bc3ace6d56d9ec83679 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:24.034523 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33950156-fb99-4900-8b99-6d0d87691ee8 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:24.105588 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:24.121413 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7d64b-502f-4c3a-b1b6-62d957cdcdf2 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:24.157912 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33950156-fb99-4900-8b99-6d0d87691ee8 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:24.167375 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a62d1-69b1-4b18-8d3e-3e9ea0068e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:24.168879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a62d1-69b1-4b18-8d3e-3e9ea0068e40 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:24.169362 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a62d1-69b1-4b18-8d3e-3e9ea0068e40 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:24.170141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a62d1-69b1-4b18-8d3e-3e9ea0068e40 None admin] PATH_INFO: `/v3/users/4520b22a13054c5f999561a70e7a9b09` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:24.171877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a62d1-69b1-4b18-8d3e-3e9ea0068e40 None admin] RBAC: Authorizing `identity:get_user(user_id=4520b22a13054c5f999561a70e7a9b09)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:24.174072 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a62d1-69b1-4b18-8d3e-3e9ea0068e40 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:24.177041 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 101/198] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:35:23 2022] GET /identity/v3/users/4520b22a13054c5f999561a70e7a9b09 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:24.178088 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a62d1-69b1-4b18-8d3e-3e9ea0068e40 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:24.198608 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67849e65-b318-4905-9b4b-2d6503cd1880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:24.201142 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67849e65-b318-4905-9b4b-2d6503cd1880 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:24.201142 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67849e65-b318-4905-9b4b-2d6503cd1880 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:24.201142 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67849e65-b318-4905-9b4b-2d6503cd1880 None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:24.201393 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67849e65-b318-4905-9b4b-2d6503cd1880 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:24.201644 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67849e65-b318-4905-9b4b-2d6503cd1880 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:24.204011 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67849e65-b318-4905-9b4b-2d6503cd1880 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:24.219709 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 98/199] 10.222.0.39 () {56 vars in 1101 bytes} [Mon May 23 15:35:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:24.220802 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67849e65-b318-4905-9b4b-2d6503cd1880 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:24.244854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:24.309685 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a62d1-69b1-4b18-8d3e-3e9ea0068e40 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:24.331025 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67849e65-b318-4905-9b4b-2d6503cd1880 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:24.347524 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb442dc8-e537-4570-aed8-0ca7a83b9805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:24.348214 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb442dc8-e537-4570-aed8-0ca7a83b9805 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:24.348500 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb442dc8-e537-4570-aed8-0ca7a83b9805 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:24.348776 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb442dc8-e537-4570-aed8-0ca7a83b9805 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:24.349694 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb442dc8-e537-4570-aed8-0ca7a83b9805 None admin] RBAC: Adding query filter params (role.id=a487e8d6e71d4a399b050274528d8db7, scope.project.id=88c9c3d6e1924302b76cfeeb40525435, user.id=838e751633d3499ab737f10ad9b3cd2b) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:24.350010 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb442dc8-e537-4570-aed8-0ca7a83b9805 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:24.351648 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb442dc8-e537-4570-aed8-0ca7a83b9805 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:24.357117 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:24.360106 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 102/200] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:35:24 2022] GET /identity/v3/role_assignments?user.id=838e751633d3499ab737f10ad9b3cd2b&scope.project.id=88c9c3d6e1924302b76cfeeb40525435&role.id=a487e8d6e71d4a399b050274528d8db7 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:24.361209 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb442dc8-e537-4570-aed8-0ca7a83b9805 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:24.369520 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff5340-017e-4923-8ccc-e64c8ad7f7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:24.370204 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff5340-017e-4923-8ccc-e64c8ad7f7ca None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:24.370495 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff5340-017e-4923-8ccc-e64c8ad7f7ca None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:24.370777 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff5340-017e-4923-8ccc-e64c8ad7f7ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:24.371700 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff5340-017e-4923-8ccc-e64c8ad7f7ca None admin] RBAC: Adding query filter params (role.id=3ab888f5f68740bd8f9df4447f4f5a7a, scope.project.id=f050448816e04bc3ace6d56d9ec83679, user.id=4520b22a13054c5f999561a70e7a9b09) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:24.372727 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff5340-017e-4923-8ccc-e64c8ad7f7ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:24.373690 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff5340-017e-4923-8ccc-e64c8ad7f7ca None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:24.380864 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 99/201] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:35:24 2022] GET /identity/v3/role_assignments?user.id=4520b22a13054c5f999561a70e7a9b09&scope.project.id=f050448816e04bc3ace6d56d9ec83679&role.id=3ab888f5f68740bd8f9df4447f4f5a7a => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:24.382070 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff5340-017e-4923-8ccc-e64c8ad7f7ca None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:24.485889 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb442dc8-e537-4570-aed8-0ca7a83b9805 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:24.489201 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:24.504362 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff5340-017e-4923-8ccc-e64c8ad7f7ca None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:24.524643 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae47a1-7eeb-4dfa-bd03-34ea7a1482c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:24.525307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae47a1-7eeb-4dfa-bd03-34ea7a1482c7 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:24.525591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae47a1-7eeb-4dfa-bd03-34ea7a1482c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:24.525864 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae47a1-7eeb-4dfa-bd03-34ea7a1482c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:24.545020 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a6093-e2d2-4674-99cf-9c5c12fc1816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:24.547285 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a6093-e2d2-4674-99cf-9c5c12fc1816 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:24.547879 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a6093-e2d2-4674-99cf-9c5c12fc1816 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:24.548366 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a6093-e2d2-4674-99cf-9c5c12fc1816 None admin] PATH_INFO: `/v3/users/d4a13d5f01224ff9a57f0061c53ab19f` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:24.550065 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a6093-e2d2-4674-99cf-9c5c12fc1816 None admin] RBAC: Authorizing `identity:get_user(user_id=d4a13d5f01224ff9a57f0061c53ab19f)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:24.551947 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a6093-e2d2-4674-99cf-9c5c12fc1816 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:24.554033 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 100/202] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:35:24 2022] GET /identity/v3/users/d4a13d5f01224ff9a57f0061c53ab19f => generated 289 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:24.574349 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a6093-e2d2-4674-99cf-9c5c12fc1816 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:24.619925 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae47a1-7eeb-4dfa-bd03-34ea7a1482c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:24.621432 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae47a1-7eeb-4dfa-bd03-34ea7a1482c7 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:24.700419 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:24.747685 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 103/203] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:35:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:35:24.755011 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae47a1-7eeb-4dfa-bd03-34ea7a1482c7 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:24.768978 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:24.818613 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a6093-e2d2-4674-99cf-9c5c12fc1816 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:24.869220 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc311f7-00a3-45e0-b33f-e54e49abc240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:24.870118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc311f7-00a3-45e0-b33f-e54e49abc240 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:24.871314 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc311f7-00a3-45e0-b33f-e54e49abc240 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:24.871837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc311f7-00a3-45e0-b33f-e54e49abc240 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:24.931611 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae47a1-7eeb-4dfa-bd03-34ea7a1482c7 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:24.954022 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc311f7-00a3-45e0-b33f-e54e49abc240 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:24.956118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc311f7-00a3-45e0-b33f-e54e49abc240 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:25.004367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa0503-3404-4d5b-87a8-4b078b7f191c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:25.005721 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa0503-3404-4d5b-87a8-4b078b7f191c None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:25.005721 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa0503-3404-4d5b-87a8-4b078b7f191c None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:25.006139 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa0503-3404-4d5b-87a8-4b078b7f191c None admin] PATH_INFO: `/v3/projects/f050448816e04bc3ace6d56d9ec83679` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:25.007487 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa0503-3404-4d5b-87a8-4b078b7f191c None admin] RBAC: Authorizing `identity:get_project(project_id=f050448816e04bc3ace6d56d9ec83679)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:25.009086 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa0503-3404-4d5b-87a8-4b078b7f191c None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:25.011087 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 104/204] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:24 2022] GET /identity/v3/projects/f050448816e04bc3ace6d56d9ec83679 => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:25.017118 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa0503-3404-4d5b-87a8-4b078b7f191c None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:25.025816 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:25.088071 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 101/205] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:35:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:35:25.104994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc311f7-00a3-45e0-b33f-e54e49abc240 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:25.191094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:25.238892 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa0503-3404-4d5b-87a8-4b078b7f191c None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:25.288000 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2010721-87d2-40ff-9d09-6b96fbdaff27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:25.289347 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2010721-87d2-40ff-9d09-6b96fbdaff27 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:25.289794 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2010721-87d2-40ff-9d09-6b96fbdaff27 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:25.292897 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2010721-87d2-40ff-9d09-6b96fbdaff27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:25.293969 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2010721-87d2-40ff-9d09-6b96fbdaff27 None admin] RBAC: Adding query filter params (role.id=a487e8d6e71d4a399b050274528d8db7, scope.project.id=f050448816e04bc3ace6d56d9ec83679, user.id=4520b22a13054c5f999561a70e7a9b09) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:25.294794 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2010721-87d2-40ff-9d09-6b96fbdaff27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:25.296834 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2010721-87d2-40ff-9d09-6b96fbdaff27 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:25.304378 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 105/206] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:35:25 2022] GET /identity/v3/role_assignments?user.id=4520b22a13054c5f999561a70e7a9b09&scope.project.id=f050448816e04bc3ace6d56d9ec83679&role.id=a487e8d6e71d4a399b050274528d8db7 => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:35:25.347912 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc311f7-00a3-45e0-b33f-e54e49abc240 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:25.409093 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ddcf99-7cff-4520-b429-0cb543fa19a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:25.410007 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ddcf99-7cff-4520-b429-0cb543fa19a7 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:25.410287 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ddcf99-7cff-4520-b429-0cb543fa19a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:25.410559 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ddcf99-7cff-4520-b429-0cb543fa19a7 None admin] PATH_INFO: `/v3/projects/88c9c3d6e1924302b76cfeeb40525435` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:25.416560 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ddcf99-7cff-4520-b429-0cb543fa19a7 None admin] RBAC: Authorizing `identity:get_project(project_id=88c9c3d6e1924302b76cfeeb40525435)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:25.418074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ddcf99-7cff-4520-b429-0cb543fa19a7 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:25.420283 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 102/207] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:25 2022] GET /identity/v3/projects/88c9c3d6e1924302b76cfeeb40525435 => generated 298 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:35:25.429553 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2010721-87d2-40ff-9d09-6b96fbdaff27 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:25.569890 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2010721-87d2-40ff-9d09-6b96fbdaff27 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:25.605064 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f82b4-1774-4ad6-9309-1c40867d15db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:25.605731 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f82b4-1774-4ad6-9309-1c40867d15db None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:25.606017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f82b4-1774-4ad6-9309-1c40867d15db None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:25.606292 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f82b4-1774-4ad6-9309-1c40867d15db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:25.607137 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f82b4-1774-4ad6-9309-1c40867d15db None admin] RBAC: Adding query filter params (role.id=86bedad6f8c84aefb5822c67df949d08, scope.project.id=88c9c3d6e1924302b76cfeeb40525435, user.id=d4a13d5f01224ff9a57f0061c53ab19f) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:25.607451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f82b4-1774-4ad6-9309-1c40867d15db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:25.609624 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f82b4-1774-4ad6-9309-1c40867d15db None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:25.613082 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:25.616275 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 106/208] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:35:25 2022] GET /identity/v3/role_assignments?user.id=d4a13d5f01224ff9a57f0061c53ab19f&scope.project.id=88c9c3d6e1924302b76cfeeb40525435&role.id=86bedad6f8c84aefb5822c67df949d08 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:25.676373 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4000037-10b7-4081-a29b-c82f014d38e9 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:25.676905 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4000037-10b7-4081-a29b-c82f014d38e9 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:25.676905 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4000037-10b7-4081-a29b-c82f014d38e9 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:25.678709 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 103/209] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:25.684696 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614538f7-358b-4e89-a466-82ebd91e7db8 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:25.684990 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614538f7-358b-4e89-a466-82ebd91e7db8 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:25.685276 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614538f7-358b-4e89-a466-82ebd91e7db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:25.710009 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-614538f7-358b-4e89-a466-82ebd91e7db8 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:25.711200 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-614538f7-358b-4e89-a466-82ebd91e7db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:25.805360 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 107/210] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:25.851726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4000037-10b7-4081-a29b-c82f014d38e9 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:25.863580 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cffe2-c907-420a-a7d4-2696563477bf None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:25.863915 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cffe2-c907-420a-a7d4-2696563477bf None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:25.864166 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cffe2-c907-420a-a7d4-2696563477bf None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:25.865549 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 108/211] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:35:25.871582 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bd902-3a0e-465b-8c92-84e97cf5954f None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:25.871907 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bd902-3a0e-465b-8c92-84e97cf5954f None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:25.872161 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bd902-3a0e-465b-8c92-84e97cf5954f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:25.882507 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:25.910284 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-233bd902-3a0e-465b-8c92-84e97cf5954f None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:25.912018 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-233bd902-3a0e-465b-8c92-84e97cf5954f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:26.003836 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4000037-10b7-4081-a29b-c82f014d38e9 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:26.044812 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 109/212] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:26.058065 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b5bc4-c0d8-4dc5-9d84-b65ef0b5852a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:26.058865 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b5bc4-c0d8-4dc5-9d84-b65ef0b5852a None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:26.059144 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b5bc4-c0d8-4dc5-9d84-b65ef0b5852a None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:26.059416 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b5bc4-c0d8-4dc5-9d84-b65ef0b5852a None admin] PATH_INFO: `/v3/domains/default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:26.060612 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b5bc4-c0d8-4dc5-9d84-b65ef0b5852a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:26.062113 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b5bc4-c0d8-4dc5-9d84-b65ef0b5852a None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:26.065557 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 104/213] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:35:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:26.069766 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b5bc4-c0d8-4dc5-9d84-b65ef0b5852a None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:26.069985 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bd902-3a0e-465b-8c92-84e97cf5954f None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:26.136327 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:26.176800 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:26.180554 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bd902-3a0e-465b-8c92-84e97cf5954f None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:26.186097 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b5bc4-c0d8-4dc5-9d84-b65ef0b5852a None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:26.218659 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a9320-0e56-4080-80a6-2eb43341301c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:26.219509 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a9320-0e56-4080-80a6-2eb43341301c None admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:26.219991 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a9320-0e56-4080-80a6-2eb43341301c None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:26.220406 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a9320-0e56-4080-80a6-2eb43341301c None admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:26.221257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779a9320-0e56-4080-80a6-2eb43341301c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:26.222853 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779a9320-0e56-4080-80a6-2eb43341301c None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:26.227638 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6851918-6e7e-49c1-a1a5-0149260fb3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:26.228559 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6851918-6e7e-49c1-a1a5-0149260fb3e1 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:26.228943 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6851918-6e7e-49c1-a1a5-0149260fb3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:26.229318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6851918-6e7e-49c1-a1a5-0149260fb3e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:26.240956 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6851918-6e7e-49c1-a1a5-0149260fb3e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:26.248772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-c6851918-6e7e-49c1-a1a5-0149260fb3e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:26.248772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:26.248772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:26.248772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:26.248772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:26.248772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:26.248772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:26.248772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:26.248772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:26.248772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:26.248772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:26.248772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:26.248772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:26.248772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:26.248772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:26.248772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:26.256021 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:26.256021 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:26.256021 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:26.256021 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:26.256021 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:26.256021 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:26.256021 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:26.256021 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:26.256021 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:26.256021 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:26.256021 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:26.256021 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:35:26.256021 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:26.256021 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:26.256021 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:26.256021 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:26.256839 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:26.256839 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:26.256839 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:26.256839 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:26.256839 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:26.256839 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:26.256839 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:26.256839 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:26.256839 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:26.256839 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:26.256839 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:26.256839 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:35:26.256839 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 105/214] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:26.256839 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6851918-6e7e-49c1-a1a5-0149260fb3e1 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:26.310896 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 110/215] 10.222.0.39 () {60 vars in 1132 bytes} [Mon May 23 15:35:26 2022] POST /identity/v3/users => generated 297 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:35:26.382846 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6851918-6e7e-49c1-a1a5-0149260fb3e1 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:26.425461 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b61805-2673-4bd9-ac10-50c15565517e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:26.426103 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b61805-2673-4bd9-ac10-50c15565517e None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:26.426440 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b61805-2673-4bd9-ac10-50c15565517e None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:26.426715 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b61805-2673-4bd9-ac10-50c15565517e None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:26.427527 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b61805-2673-4bd9-ac10-50c15565517e None admin] RBAC: Adding query filter params (name=member) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:26.427871 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b61805-2673-4bd9-ac10-50c15565517e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:26.429348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b61805-2673-4bd9-ac10-50c15565517e None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:26.439754 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 106/216] 10.222.0.39 () {56 vars in 1101 bytes} [Mon May 23 15:35:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:26.445492 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a9320-0e56-4080-80a6-2eb43341301c None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:26.569293 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a9320-0e56-4080-80a6-2eb43341301c None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:26.587170 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:26.606465 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc29d5-b182-47f5-b81a-95c7e4b70dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:26.607354 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc29d5-b182-47f5-b81a-95c7e4b70dd8 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:26.607714 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc29d5-b182-47f5-b81a-95c7e4b70dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:26.607991 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc29d5-b182-47f5-b81a-95c7e4b70dd8 None admin] PATH_INFO: `/v3/users/f0f1c6df617f4ee6b9ee35f615af2368` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:26.631649 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc29d5-b182-47f5-b81a-95c7e4b70dd8 None admin] RBAC: Authorizing `identity:get_user(user_id=f0f1c6df617f4ee6b9ee35f615af2368)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:26.631649 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc29d5-b182-47f5-b81a-95c7e4b70dd8 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:26.633073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 111/217] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:35:26 2022] GET /identity/v3/users/f0f1c6df617f4ee6b9ee35f615af2368 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:26.638865 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b61805-2673-4bd9-ac10-50c15565517e None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:26.664381 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:26.771753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b61805-2673-4bd9-ac10-50c15565517e None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:26.809918 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c26fd-c112-4dc5-9261-9336bacd5c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:26.810571 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c26fd-c112-4dc5-9261-9336bacd5c38 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:26.810853 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c26fd-c112-4dc5-9261-9336bacd5c38 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:26.811129 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c26fd-c112-4dc5-9261-9336bacd5c38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:26.895388 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c26fd-c112-4dc5-9261-9336bacd5c38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:26.896887 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c26fd-c112-4dc5-9261-9336bacd5c38 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:26.912097 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:27.011479 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 107/218] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:35:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:35:27.018690 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc29d5-b182-47f5-b81a-95c7e4b70dd8 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:27.132333 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc29d5-b182-47f5-b81a-95c7e4b70dd8 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:27.175562 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe1c0a-979a-40d6-8133-0763d875b16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:27.176492 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe1c0a-979a-40d6-8133-0763d875b16b None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:27.176778 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe1c0a-979a-40d6-8133-0763d875b16b None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:27.177057 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe1c0a-979a-40d6-8133-0763d875b16b None admin] PATH_INFO: `/v3/projects/f050448816e04bc3ace6d56d9ec83679` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:27.178287 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe1c0a-979a-40d6-8133-0763d875b16b None admin] RBAC: Authorizing `identity:get_project(project_id=f050448816e04bc3ace6d56d9ec83679)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:27.179781 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe1c0a-979a-40d6-8133-0763d875b16b None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:27.181810 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 112/219] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:27 2022] GET /identity/v3/projects/f050448816e04bc3ace6d56d9ec83679 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:27.188335 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c26fd-c112-4dc5-9261-9336bacd5c38 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:27.269513 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8f0c7-384d-433a-a86f-a0afce8870f3 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:27.269823 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8f0c7-384d-433a-a86f-a0afce8870f3 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:27.270081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8f0c7-384d-433a-a86f-a0afce8870f3 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:27.271466 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 113/220] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:27.289245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04028cff-0602-4c2a-a3c2-dcb9d6f44b38 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:27.289536 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04028cff-0602-4c2a-a3c2-dcb9d6f44b38 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:27.289824 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04028cff-0602-4c2a-a3c2-dcb9d6f44b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:27.325418 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-04028cff-0602-4c2a-a3c2-dcb9d6f44b38 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:27.326599 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-04028cff-0602-4c2a-a3c2-dcb9d6f44b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:27.364803 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c26fd-c112-4dc5-9261-9336bacd5c38 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:27.393302 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:27.400473 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:27.435829 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff2e61-25ba-47fc-822a-7e74835dab2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:27.437011 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff2e61-25ba-47fc-822a-7e74835dab2d None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:27.437301 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff2e61-25ba-47fc-822a-7e74835dab2d None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:27.437580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff2e61-25ba-47fc-822a-7e74835dab2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:27.438420 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff2e61-25ba-47fc-822a-7e74835dab2d None admin] RBAC: Adding query filter params (role.id=c41a7cd1c92b45a7bff9632d07b48006, scope.project.id=f050448816e04bc3ace6d56d9ec83679, user.id=f0f1c6df617f4ee6b9ee35f615af2368) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:27.438733 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff2e61-25ba-47fc-822a-7e74835dab2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:27.441121 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff2e61-25ba-47fc-822a-7e74835dab2d None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:27.451151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 108/221] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:35:27 2022] GET /identity/v3/role_assignments?user.id=f0f1c6df617f4ee6b9ee35f615af2368&scope.project.id=f050448816e04bc3ace6d56d9ec83679&role.id=c41a7cd1c92b45a7bff9632d07b48006 => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:35:27.457406 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 114/222] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:35:27.492920 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff2e61-25ba-47fc-822a-7e74835dab2d None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:27.640802 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff2e61-25ba-47fc-822a-7e74835dab2d None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:27.686707 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e856b0-1bac-4b65-81e8-7fd36597515a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:27.687418 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e856b0-1bac-4b65-81e8-7fd36597515a None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:27.687729 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e856b0-1bac-4b65-81e8-7fd36597515a None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:27.688005 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e856b0-1bac-4b65-81e8-7fd36597515a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:27.700357 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e856b0-1bac-4b65-81e8-7fd36597515a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:27.708856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-24e856b0-1bac-4b65-81e8-7fd36597515a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:35:27.708856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:27.708856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:27.708856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:27.708856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:27.708856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:27.708856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:27.708856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:27.708856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:27.708856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:27.708856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:27.708856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:27.708856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:27.708856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:27.708856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:27.708856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:27.709805 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:27.709805 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:27.709805 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:27.709805 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:27.709805 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:27.709805 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:27.709805 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:27.709805 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:27.709805 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:27.709805 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:27.709805 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:27.709805 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:35:27.709805 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:27.709805 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:27.709805 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:27.709805 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:27.710584 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:27.710584 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:27.710584 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:27.710584 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:27.710584 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:27.710584 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:27.710584 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:27.710584 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:27.710584 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:27.710584 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:27.710584 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:35:27.710584 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:35:27.710584 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 109/223] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:35:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:27.717330 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04028cff-0602-4c2a-a3c2-dcb9d6f44b38 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:27.856702 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04028cff-0602-4c2a-a3c2-dcb9d6f44b38 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:27.881052 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effed27d-02d2-491e-920d-2cb5c1a46a82 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:27.881565 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effed27d-02d2-491e-920d-2cb5c1a46a82 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:27.881642 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effed27d-02d2-491e-920d-2cb5c1a46a82 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:27.883134 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 110/224] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:35:27.888439 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a21f4-8c59-4c6f-8241-02a356f423e0 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:27.888733 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a21f4-8c59-4c6f-8241-02a356f423e0 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:27.889010 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a21f4-8c59-4c6f-8241-02a356f423e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:27.908632 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0befa9d-e7a7-402c-94a3-8ae7bb95548f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:27.909316 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0befa9d-e7a7-402c-94a3-8ae7bb95548f None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:27.909601 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0befa9d-e7a7-402c-94a3-8ae7bb95548f None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:27.909877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0befa9d-e7a7-402c-94a3-8ae7bb95548f None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:27.910635 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0befa9d-e7a7-402c-94a3-8ae7bb95548f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:27.910944 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0befa9d-e7a7-402c-94a3-8ae7bb95548f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:27.912465 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0befa9d-e7a7-402c-94a3-8ae7bb95548f None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:27.925613 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-d26a21f4-8c59-4c6f-8241-02a356f423e0 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:27.926853 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-d26a21f4-8c59-4c6f-8241-02a356f423e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:27.931344 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 115/225] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:27.937765 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0befa9d-e7a7-402c-94a3-8ae7bb95548f None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:27.999027 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:28.011994 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:28.083291 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 111/226] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:28.111987 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0befa9d-e7a7-402c-94a3-8ae7bb95548f None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:28.117742 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a21f4-8c59-4c6f-8241-02a356f423e0 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:28.165698 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0070d-e1c9-4297-8bd8-940c04f07f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:28.166617 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0070d-e1c9-4297-8bd8-940c04f07f0a None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:28.166904 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0070d-e1c9-4297-8bd8-940c04f07f0a None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:28.167215 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0070d-e1c9-4297-8bd8-940c04f07f0a None admin] PATH_INFO: `/v3/users/4520b22a13054c5f999561a70e7a9b09` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:28.168641 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc0070d-e1c9-4297-8bd8-940c04f07f0a None admin] RBAC: Authorizing `identity:get_user(user_id=4520b22a13054c5f999561a70e7a9b09)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:28.170096 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc0070d-e1c9-4297-8bd8-940c04f07f0a None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:28.172886 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 116/227] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:35:27 2022] GET /identity/v3/users/4520b22a13054c5f999561a70e7a9b09 => generated 283 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:35:28.177891 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0070d-e1c9-4297-8bd8-940c04f07f0a None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:28.308310 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0070d-e1c9-4297-8bd8-940c04f07f0a None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:28.309875 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:28.333688 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a21f4-8c59-4c6f-8241-02a356f423e0 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:28.350068 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5328cf-898a-4211-aba7-72eeca39626e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:28.351580 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5328cf-898a-4211-aba7-72eeca39626e None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:28.351903 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5328cf-898a-4211-aba7-72eeca39626e None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:28.352191 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5328cf-898a-4211-aba7-72eeca39626e None admin] PATH_INFO: `/v3/projects/f050448816e04bc3ace6d56d9ec83679` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:28.353411 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5328cf-898a-4211-aba7-72eeca39626e None admin] RBAC: Authorizing `identity:get_project(project_id=f050448816e04bc3ace6d56d9ec83679)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:28.354867 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5328cf-898a-4211-aba7-72eeca39626e None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:28.357102 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 117/228] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:28 2022] GET /identity/v3/projects/f050448816e04bc3ace6d56d9ec83679 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:28.365826 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5328cf-898a-4211-aba7-72eeca39626e None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:28.397798 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99283333-7327-429f-a5da-c6a74fac9917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:28.398616 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99283333-7327-429f-a5da-c6a74fac9917 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:28.398896 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99283333-7327-429f-a5da-c6a74fac9917 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:28.399166 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99283333-7327-429f-a5da-c6a74fac9917 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:28.409794 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99283333-7327-429f-a5da-c6a74fac9917 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:28.418090 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-99283333-7327-429f-a5da-c6a74fac9917 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:35:28.418090 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:28.418090 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:28.418090 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:28.418090 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:28.418090 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:28.418090 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:28.418090 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:28.418090 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:28.418090 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:28.418090 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:28.418090 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:28.418090 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:28.418090 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:28.418090 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:28.418090 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:28.418960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:28.418960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:28.418960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:28.418960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:28.418960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:28.418960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:28.418960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:28.418960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:28.418960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:28.418960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:28.418960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:28.418960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:35:28.418960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:28.418960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:28.418960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:28.418960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:28.421799 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:28.421799 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:28.421799 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:28.421799 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:28.421799 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:28.421799 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:28.421799 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:28.421799 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:28.421799 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:28.421799 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:28.421799 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:35:28.421799 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:35:28.421799 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 112/229] 10.222.0.39 () {56 vars in 1114 bytes} [Mon May 23 15:35:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:35:28.429108 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99283333-7327-429f-a5da-c6a74fac9917 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:28.480289 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:28.549327 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5328cf-898a-4211-aba7-72eeca39626e None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:28.590141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de0e85-9e1b-4147-8ebc-360f34b7bcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:28.591077 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de0e85-9e1b-4147-8ebc-360f34b7bcff None admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:28.591361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de0e85-9e1b-4147-8ebc-360f34b7bcff None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:28.591657 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de0e85-9e1b-4147-8ebc-360f34b7bcff None admin] PATH_INFO: `/v3/projects/f050448816e04bc3ace6d56d9ec83679/users/4520b22a13054c5f999561a70e7a9b09/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:28.595041 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de0e85-9e1b-4147-8ebc-360f34b7bcff None admin] RBAC: Authorizing `identity:create_grant(project_id=f050448816e04bc3ace6d56d9ec83679, user_id=4520b22a13054c5f999561a70e7a9b09, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:28.597876 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de0e85-9e1b-4147-8ebc-360f34b7bcff None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:28.634629 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99283333-7327-429f-a5da-c6a74fac9917 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:28.671714 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f94824-e405-40a8-ac8c-ac090fa0716a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:28.672379 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f94824-e405-40a8-ac8c-ac090fa0716a None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:28.672658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f94824-e405-40a8-ac8c-ac090fa0716a None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:28.672928 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f94824-e405-40a8-ac8c-ac090fa0716a None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:28.673674 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f94824-e405-40a8-ac8c-ac090fa0716a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:28.673980 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f94824-e405-40a8-ac8c-ac090fa0716a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:28.678381 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f94824-e405-40a8-ac8c-ac090fa0716a None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:28.682472 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 118/230] 10.222.0.39 () {58 vars in 1439 bytes} [Mon May 23 15:35:28 2022] PUT /identity/v3/projects/f050448816e04bc3ace6d56d9ec83679/users/4520b22a13054c5f999561a70e7a9b09/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:35:28.696595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 113/231] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:35:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:28.703162 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de0e85-9e1b-4147-8ebc-360f34b7bcff None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:28.743527 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:28.847632 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de0e85-9e1b-4147-8ebc-360f34b7bcff None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:28.900204 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42afda8f-a707-416e-a60c-6508c1f9139f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:28.901168 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afda8f-a707-416e-a60c-6508c1f9139f None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:28.901450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afda8f-a707-416e-a60c-6508c1f9139f None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:28.901771 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afda8f-a707-416e-a60c-6508c1f9139f None admin] PATH_INFO: `/v3/users/4520b22a13054c5f999561a70e7a9b09` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:28.904446 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42afda8f-a707-416e-a60c-6508c1f9139f None admin] RBAC: Authorizing `identity:get_user(user_id=4520b22a13054c5f999561a70e7a9b09)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:28.906605 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42afda8f-a707-416e-a60c-6508c1f9139f None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:28.908725 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 119/232] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:35:28 2022] GET /identity/v3/users/4520b22a13054c5f999561a70e7a9b09 => generated 283 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:35:28.913959 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f94824-e405-40a8-ac8c-ac090fa0716a None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:29.043190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:29.054912 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f94824-e405-40a8-ac8c-ac090fa0716a None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:29.105292 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fbf55-4f7a-4ebb-9802-37d71410fea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:29.106176 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fbf55-4f7a-4ebb-9802-37d71410fea7 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:29.106457 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fbf55-4f7a-4ebb-9802-37d71410fea7 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:29.106987 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fbf55-4f7a-4ebb-9802-37d71410fea7 None admin] PATH_INFO: `/v3/projects/f050448816e04bc3ace6d56d9ec83679` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:29.108348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893fbf55-4f7a-4ebb-9802-37d71410fea7 None admin] RBAC: Authorizing `identity:get_project(project_id=f050448816e04bc3ace6d56d9ec83679)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:29.109835 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893fbf55-4f7a-4ebb-9802-37d71410fea7 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:29.112112 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 114/233] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:28 2022] GET /identity/v3/projects/f050448816e04bc3ace6d56d9ec83679 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:29.117759 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42afda8f-a707-416e-a60c-6508c1f9139f None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:29.221640 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29440ef-ad0b-4dcd-9b59-2f19affdbdd9 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:29.222229 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29440ef-ad0b-4dcd-9b59-2f19affdbdd9 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:29.222723 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29440ef-ad0b-4dcd-9b59-2f19affdbdd9 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:29.224323 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 115/234] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:35:29.229527 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c4568-ab82-4f0b-bba7-58bd8e45d2c7 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:29.230060 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c4568-ab82-4f0b-bba7-58bd8e45d2c7 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:29.230534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c4568-ab82-4f0b-bba7-58bd8e45d2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:29.271633 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42afda8f-a707-416e-a60c-6508c1f9139f None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:29.273145 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-516c4568-ab82-4f0b-bba7-58bd8e45d2c7 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:29.274573 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-516c4568-ab82-4f0b-bba7-58bd8e45d2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:29.289534 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:29.308935 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9abbb-73c6-4de6-9a31-88aaaf1791b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:29.309835 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9abbb-73c6-4de6-9a31-88aaaf1791b3 None admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:29.310122 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9abbb-73c6-4de6-9a31-88aaaf1791b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:29.310395 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9abbb-73c6-4de6-9a31-88aaaf1791b3 None admin] PATH_INFO: `/v3/projects/f050448816e04bc3ace6d56d9ec83679/users/4520b22a13054c5f999561a70e7a9b09/roles/a487e8d6e71d4a399b050274528d8db7` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:29.312850 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9abbb-73c6-4de6-9a31-88aaaf1791b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=f050448816e04bc3ace6d56d9ec83679, user_id=4520b22a13054c5f999561a70e7a9b09, role_id=a487e8d6e71d4a399b050274528d8db7)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:29.314323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9abbb-73c6-4de6-9a31-88aaaf1791b3 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:29.370944 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 116/235] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:29.394592 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c4568-ab82-4f0b-bba7-58bd8e45d2c7 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:29.424803 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 120/236] 10.222.0.39 () {58 vars in 1439 bytes} [Mon May 23 15:35:29 2022] PUT /identity/v3/projects/f050448816e04bc3ace6d56d9ec83679/users/4520b22a13054c5f999561a70e7a9b09/roles/a487e8d6e71d4a399b050274528d8db7 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:35:29.490283 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:29.502788 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c4568-ab82-4f0b-bba7-58bd8e45d2c7 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:29.537826 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb3ae2-be5e-4b76-9126-487d444bd41c None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:29.538120 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb3ae2-be5e-4b76-9126-487d444bd41c None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:29.538396 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb3ae2-be5e-4b76-9126-487d444bd41c None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:29.541055 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7f463-9cc3-4847-b5b0-55a70bd937ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:29.542116 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7f463-9cc3-4847-b5b0-55a70bd937ed None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:29.542571 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7f463-9cc3-4847-b5b0-55a70bd937ed None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:29.543024 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7f463-9cc3-4847-b5b0-55a70bd937ed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:29.543707 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 121/237] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:29.545662 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecc733-33a7-4b9c-bdb1-ac81f1a38a58 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:29.548971 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecc733-33a7-4b9c-bdb1-ac81f1a38a58 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:29.549495 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecc733-33a7-4b9c-bdb1-ac81f1a38a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:29.570117 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7f463-9cc3-4847-b5b0-55a70bd937ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:29.580661 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-14d7f463-9cc3-4847-b5b0-55a70bd937ed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:35:29.580661 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:29.580661 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:29.580661 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:29.580661 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:29.580661 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:29.580661 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:29.580661 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:29.580661 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:29.580661 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:29.580661 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:29.580661 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:29.580661 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:29.580661 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:29.580661 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:29.580661 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:29.581595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:29.581595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:29.581595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:29.581595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:29.581595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:29.581595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:29.581595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:29.581595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:29.581595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:29.581595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:29.581595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:29.581595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:35:29.581595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:29.581595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:29.581595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:29.581595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:29.582395 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:29.582395 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:29.582395 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:29.582395 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:29.582395 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:29.582395 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:29.582395 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:29.582395 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:29.582395 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:29.582395 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:29.582395 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:35:29.582395 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:35:29.582996 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-7eecc733-33a7-4b9c-bdb1-ac81f1a38a58 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:29.582996 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-7eecc733-33a7-4b9c-bdb1-ac81f1a38a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:29.584951 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 117/238] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:29.590869 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7f463-9cc3-4847-b5b0-55a70bd937ed None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:29.695206 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 122/239] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:35:29.718199 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7f463-9cc3-4847-b5b0-55a70bd937ed None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:29.723200 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eecc733-33a7-4b9c-bdb1-ac81f1a38a58 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:29.761166 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad90893-4aa8-47e7-9d50-bf7b8144ce79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:29.762360 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad90893-4aa8-47e7-9d50-bf7b8144ce79 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:29.762814 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad90893-4aa8-47e7-9d50-bf7b8144ce79 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:29.763255 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad90893-4aa8-47e7-9d50-bf7b8144ce79 None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:29.765083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad90893-4aa8-47e7-9d50-bf7b8144ce79 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:29.765588 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad90893-4aa8-47e7-9d50-bf7b8144ce79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:29.767152 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad90893-4aa8-47e7-9d50-bf7b8144ce79 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:29.778466 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 118/240] 10.222.0.39 () {56 vars in 1101 bytes} [Mon May 23 15:35:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:35:29.785057 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad90893-4aa8-47e7-9d50-bf7b8144ce79 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:29.801225 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:29.829735 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:29.855824 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eecc733-33a7-4b9c-bdb1-ac81f1a38a58 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:29.922099 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a8245-a82b-48b8-bd26-fb014b5ffbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:29.924167 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a8245-a82b-48b8-bd26-fb014b5ffbe3 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:29.925955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a8245-a82b-48b8-bd26-fb014b5ffbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:29.927207 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a8245-a82b-48b8-bd26-fb014b5ffbe3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:29.930685 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a8245-a82b-48b8-bd26-fb014b5ffbe3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:29.932325 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a8245-a82b-48b8-bd26-fb014b5ffbe3 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:29.934894 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 123/241] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:35:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:35:29.942586 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a8245-a82b-48b8-bd26-fb014b5ffbe3 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:29.961761 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad90893-4aa8-47e7-9d50-bf7b8144ce79 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:29.999547 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c35d8d-77a3-4d26-a077-1eb4df83abc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:30.000592 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c35d8d-77a3-4d26-a077-1eb4df83abc2 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:30.003129 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c35d8d-77a3-4d26-a077-1eb4df83abc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:30.003129 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c35d8d-77a3-4d26-a077-1eb4df83abc2 None admin] PATH_INFO: `/v3/users/17e9ee8da9484c809a6a130036963127` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:30.016929 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c35d8d-77a3-4d26-a077-1eb4df83abc2 None admin] RBAC: Authorizing `identity:get_user(user_id=17e9ee8da9484c809a6a130036963127)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:30.018746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c35d8d-77a3-4d26-a077-1eb4df83abc2 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:30.020830 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 119/242] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:35:29 2022] GET /identity/v3/users/17e9ee8da9484c809a6a130036963127 => generated 297 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:35:30.025926 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c35d8d-77a3-4d26-a077-1eb4df83abc2 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:30.102781 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:30.140432 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c35d8d-77a3-4d26-a077-1eb4df83abc2 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:30.178611 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d1948-3ae8-4c55-8619-2a93a66cd587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:30.179259 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d1948-3ae8-4c55-8619-2a93a66cd587 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:30.179540 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d1948-3ae8-4c55-8619-2a93a66cd587 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:30.179966 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d1948-3ae8-4c55-8619-2a93a66cd587 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:30.193956 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a8245-a82b-48b8-bd26-fb014b5ffbe3 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:30.257432 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650f5a3-9934-4d7a-9370-b9ed67141833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:30.258119 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650f5a3-9934-4d7a-9370-b9ed67141833 None admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:30.258406 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650f5a3-9934-4d7a-9370-b9ed67141833 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:30.258683 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650f5a3-9934-4d7a-9370-b9ed67141833 None admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:30.259421 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650f5a3-9934-4d7a-9370-b9ed67141833 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:30.260908 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650f5a3-9934-4d7a-9370-b9ed67141833 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:30.313155 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d1948-3ae8-4c55-8619-2a93a66cd587 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:30.314684 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d1948-3ae8-4c55-8619-2a93a66cd587 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:30.362251 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 124/243] 10.222.0.39 () {60 vars in 1132 bytes} [Mon May 23 15:35:29 2022] POST /identity/v3/users => generated 293 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:35:30.364862 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0e4a6-bb7d-4458-a93d-5c075a05ae51 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:30.365382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0e4a6-bb7d-4458-a93d-5c075a05ae51 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:30.365858 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0e4a6-bb7d-4458-a93d-5c075a05ae51 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:30.368302 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 125/244] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:30.375913 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87651da0-fb41-4b67-9002-80afe2671583 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:30.376527 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87651da0-fb41-4b67-9002-80afe2671583 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:30.376979 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87651da0-fb41-4b67-9002-80afe2671583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:30.398487 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-87651da0-fb41-4b67-9002-80afe2671583 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:30.400263 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-87651da0-fb41-4b67-9002-80afe2671583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:30.423704 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:30.472015 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:30.493780 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 126/245] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:30.520355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87651da0-fb41-4b67-9002-80afe2671583 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:30.522141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 120/246] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:35:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 15:35:30.527524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d1948-3ae8-4c55-8619-2a93a66cd587 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:30.648196 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87651da0-fb41-4b67-9002-80afe2671583 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:30.667571 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d1948-3ae8-4c55-8619-2a93a66cd587 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:30.691175 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847274b-a933-4fbd-9984-648dc06f013d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:30.692709 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847274b-a933-4fbd-9984-648dc06f013d None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:30.692709 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847274b-a933-4fbd-9984-648dc06f013d None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:30.692709 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847274b-a933-4fbd-9984-648dc06f013d None admin] PATH_INFO: `/v3/roles/member` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:30.705770 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847274b-a933-4fbd-9984-648dc06f013d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:30.711645 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaccc27-caa6-4fba-9f4a-56bd972d1405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:30.712867 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaccc27-caa6-4fba-9f4a-56bd972d1405 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:30.713367 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaccc27-caa6-4fba-9f4a-56bd972d1405 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:30.713948 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaccc27-caa6-4fba-9f4a-56bd972d1405 None admin] PATH_INFO: `/v3/projects/f050448816e04bc3ace6d56d9ec83679` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:30.715354 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaccc27-caa6-4fba-9f4a-56bd972d1405 None admin] RBAC: Authorizing `identity:get_project(project_id=f050448816e04bc3ace6d56d9ec83679)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:30.716906 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaccc27-caa6-4fba-9f4a-56bd972d1405 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:30.718898 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 121/247] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:30 2022] GET /identity/v3/projects/f050448816e04bc3ace6d56d9ec83679 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:35:30.724325 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-7847274b-a933-4fbd-9984-648dc06f013d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:30.724325 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:30.724325 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:30.724325 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:30.724325 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:30.724325 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:30.724325 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:30.724325 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:30.724325 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:30.724325 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:30.724325 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:30.724325 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:30.724325 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:30.724325 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:30.724325 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:30.724325 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:30.725265 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:30.725265 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:30.725265 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:30.725265 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:30.725265 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:30.725265 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:30.725265 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:30.725265 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:30.725265 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:30.725265 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:30.725265 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:30.725265 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:35:30.725265 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:30.725265 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:30.725265 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:30.725265 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:30.726057 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:30.726057 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:30.726057 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:30.726057 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:30.726057 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:30.726057 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:30.726057 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:30.726057 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:30.726057 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:30.726057 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:30.726057 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:30.726057 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:35:30.726651 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaccc27-caa6-4fba-9f4a-56bd972d1405 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:30.726719 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 127/248] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:30.735241 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847274b-a933-4fbd-9984-648dc06f013d None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:30.739915 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:30.771972 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:30.847153 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaccc27-caa6-4fba-9f4a-56bd972d1405 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:30.872998 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847274b-a933-4fbd-9984-648dc06f013d None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:30.890869 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6079f78-1c57-43e2-a0db-09f36338c6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:30.891543 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6079f78-1c57-43e2-a0db-09f36338c6d1 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:30.891856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6079f78-1c57-43e2-a0db-09f36338c6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:30.892293 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6079f78-1c57-43e2-a0db-09f36338c6d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:30.893440 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6079f78-1c57-43e2-a0db-09f36338c6d1 None admin] RBAC: Adding query filter params (role.id=86bedad6f8c84aefb5822c67df949d08, scope.project.id=f050448816e04bc3ace6d56d9ec83679, user.id=17e9ee8da9484c809a6a130036963127) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:30.893760 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6079f78-1c57-43e2-a0db-09f36338c6d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:30.895343 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6079f78-1c57-43e2-a0db-09f36338c6d1 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:30.904961 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 122/249] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:35:30 2022] GET /identity/v3/role_assignments?user.id=17e9ee8da9484c809a6a130036963127&scope.project.id=f050448816e04bc3ace6d56d9ec83679&role.id=86bedad6f8c84aefb5822c67df949d08 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:35:30.915180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e463fad-f215-4db8-b9d2-6771fc7e6696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:30.915961 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e463fad-f215-4db8-b9d2-6771fc7e6696 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:30.916257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e463fad-f215-4db8-b9d2-6771fc7e6696 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:30.916533 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e463fad-f215-4db8-b9d2-6771fc7e6696 None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:30.917336 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e463fad-f215-4db8-b9d2-6771fc7e6696 None admin] RBAC: Adding query filter params (name=member) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:30.917653 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e463fad-f215-4db8-b9d2-6771fc7e6696 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:30.919173 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e463fad-f215-4db8-b9d2-6771fc7e6696 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:30.937878 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 128/250] 10.222.0.39 () {56 vars in 1101 bytes} [Mon May 23 15:35:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:30.939310 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6079f78-1c57-43e2-a0db-09f36338c6d1 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:31.066988 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:31.070319 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6079f78-1c57-43e2-a0db-09f36338c6d1 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:31.109382 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35554867-d66e-42f9-bf1c-5149f1f6e1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:31.110274 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35554867-d66e-42f9-bf1c-5149f1f6e1d7 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:31.110554 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35554867-d66e-42f9-bf1c-5149f1f6e1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:31.110829 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35554867-d66e-42f9-bf1c-5149f1f6e1d7 None admin] PATH_INFO: `/v3/users/f0f1c6df617f4ee6b9ee35f615af2368` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:31.112368 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35554867-d66e-42f9-bf1c-5149f1f6e1d7 None admin] RBAC: Authorizing `identity:get_user(user_id=f0f1c6df617f4ee6b9ee35f615af2368)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:31.113900 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35554867-d66e-42f9-bf1c-5149f1f6e1d7 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:31.115623 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 123/251] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:35:30 2022] GET /identity/v3/users/f0f1c6df617f4ee6b9ee35f615af2368 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:31.125235 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e463fad-f215-4db8-b9d2-6771fc7e6696 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:31.227983 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:31.278277 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e463fad-f215-4db8-b9d2-6771fc7e6696 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:31.325223 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a6e70-edc8-4a1b-8be0-0294ecbbb4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:31.326116 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a6e70-edc8-4a1b-8be0-0294ecbbb4f9 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:31.326402 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a6e70-edc8-4a1b-8be0-0294ecbbb4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:31.326741 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a6e70-edc8-4a1b-8be0-0294ecbbb4f9 None admin] PATH_INFO: `/v3/projects/f050448816e04bc3ace6d56d9ec83679` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:31.328122 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a6e70-edc8-4a1b-8be0-0294ecbbb4f9 None admin] RBAC: Authorizing `identity:get_project(project_id=f050448816e04bc3ace6d56d9ec83679)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:31.329573 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a6e70-edc8-4a1b-8be0-0294ecbbb4f9 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:31.331460 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 129/252] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:31 2022] GET /identity/v3/projects/f050448816e04bc3ace6d56d9ec83679 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:31.337622 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35554867-d66e-42f9-bf1c-5149f1f6e1d7 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:31.473409 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35554867-d66e-42f9-bf1c-5149f1f6e1d7 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:31.528178 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb0c89-f67a-4e41-9725-9930d0de366f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:31.529439 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb0c89-f67a-4e41-9725-9930d0de366f None admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:31.530385 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb0c89-f67a-4e41-9725-9930d0de366f None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:31.530881 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb0c89-f67a-4e41-9725-9930d0de366f None admin] PATH_INFO: `/v3/projects/f050448816e04bc3ace6d56d9ec83679/users/f0f1c6df617f4ee6b9ee35f615af2368/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:31.536948 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb0c89-f67a-4e41-9725-9930d0de366f None admin] RBAC: Authorizing `identity:create_grant(project_id=f050448816e04bc3ace6d56d9ec83679, user_id=f0f1c6df617f4ee6b9ee35f615af2368, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:31.538634 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb0c89-f67a-4e41-9725-9930d0de366f None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:31.568206 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb476de-2b2b-45b5-833f-d4fd1346c940 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:31.568536 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb476de-2b2b-45b5-833f-d4fd1346c940 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:31.568773 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb476de-2b2b-45b5-833f-d4fd1346c940 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:31.570156 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 130/253] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:35:31.575202 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad8166-6a80-4711-b47a-9b8e9aed7e5d None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:31.575499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad8166-6a80-4711-b47a-9b8e9aed7e5d None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:31.575836 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad8166-6a80-4711-b47a-9b8e9aed7e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:31.600042 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-dbad8166-6a80-4711-b47a-9b8e9aed7e5d None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:31.601284 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-dbad8166-6a80-4711-b47a-9b8e9aed7e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:31.633277 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 124/254] 10.222.0.39 () {58 vars in 1439 bytes} [Mon May 23 15:35:31 2022] PUT /identity/v3/projects/f050448816e04bc3ace6d56d9ec83679/users/f0f1c6df617f4ee6b9ee35f615af2368/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:35:31.690835 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 131/255] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:35:31.727990 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb0c89-f67a-4e41-9725-9930d0de366f None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:31.771195 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:31.885044 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb0c89-f67a-4e41-9725-9930d0de366f None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:31.928921 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c64a6-6d0a-40e1-b46b-be01347505b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:31.929741 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c64a6-6d0a-40e1-b46b-be01347505b2 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:31.930028 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c64a6-6d0a-40e1-b46b-be01347505b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:31.930305 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c64a6-6d0a-40e1-b46b-be01347505b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:31.948504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c64a6-6d0a-40e1-b46b-be01347505b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:31.956877 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-e63c64a6-6d0a-40e1-b46b-be01347505b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:35:31.956877 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:31.956877 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:31.956877 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:31.956877 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:31.956877 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:31.956877 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:31.956877 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:31.956877 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:31.956877 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:31.956877 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:31.956877 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:31.956877 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:31.956877 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:31.956877 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:31.956877 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:31.957731 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:31.957731 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:31.957731 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:31.957731 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:31.957731 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:31.957731 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:31.957731 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:31.957731 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:31.957731 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:31.957731 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:31.957731 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:31.957731 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:35:31.957731 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:31.957731 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:31.957731 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:31.957731 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:31.958510 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:31.958510 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:31.958510 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:31.958510 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:31.958510 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:31.958510 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:31.958510 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:31.958510 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:31.958510 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:31.958510 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:31.958510 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:35:31.958510 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:35:31.958510 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 125/256] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:35:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:31.964091 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad8166-6a80-4711-b47a-9b8e9aed7e5d None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:32.070098 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:32.120377 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad8166-6a80-4711-b47a-9b8e9aed7e5d None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:32.173751 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ba923-ae7f-4c92-8809-3d28e410008f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:32.174441 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ba923-ae7f-4c92-8809-3d28e410008f None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:32.174734 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ba923-ae7f-4c92-8809-3d28e410008f None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:32.175018 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ba923-ae7f-4c92-8809-3d28e410008f None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:32.175864 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ba923-ae7f-4c92-8809-3d28e410008f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:32.176186 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ba923-ae7f-4c92-8809-3d28e410008f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:32.178049 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ba923-ae7f-4c92-8809-3d28e410008f None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:32.191332 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 132/257] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:32.197142 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c64a6-6d0a-40e1-b46b-be01347505b2 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:32.350849 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:32.368673 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c64a6-6d0a-40e1-b46b-be01347505b2 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:32.416300 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ee35d-38b0-4ef3-90a5-1ec0e634c268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:32.417186 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ee35d-38b0-4ef3-90a5-1ec0e634c268 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:32.417469 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ee35d-38b0-4ef3-90a5-1ec0e634c268 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:32.417745 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ee35d-38b0-4ef3-90a5-1ec0e634c268 None admin] PATH_INFO: `/v3/users/4520b22a13054c5f999561a70e7a9b09` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:32.418977 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ee35d-38b0-4ef3-90a5-1ec0e634c268 None admin] RBAC: Authorizing `identity:get_user(user_id=4520b22a13054c5f999561a70e7a9b09)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:32.421043 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ee35d-38b0-4ef3-90a5-1ec0e634c268 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:32.422675 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 126/258] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:35:32 2022] GET /identity/v3/users/4520b22a13054c5f999561a70e7a9b09 => generated 283 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:32.428458 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ba923-ae7f-4c92-8809-3d28e410008f None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:32.568521 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ba923-ae7f-4c92-8809-3d28e410008f None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:32.601221 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:32.619171 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda68f6f-9fd4-412a-b55d-53d3a722a516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:32.619862 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda68f6f-9fd4-412a-b55d-53d3a722a516 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:32.620147 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda68f6f-9fd4-412a-b55d-53d3a722a516 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:32.620424 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda68f6f-9fd4-412a-b55d-53d3a722a516 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:32.724684 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda68f6f-9fd4-412a-b55d-53d3a722a516 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:32.726511 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda68f6f-9fd4-412a-b55d-53d3a722a516 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:32.788027 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc694d4-582d-40dc-bd2f-5d7327e2c0cb None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:32.788302 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc694d4-582d-40dc-bd2f-5d7327e2c0cb None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:32.789233 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc694d4-582d-40dc-bd2f-5d7327e2c0cb None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:32.791079 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 127/259] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:32.796692 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a542867-31dc-4105-b353-19166c7f33fd None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:32.797154 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a542867-31dc-4105-b353-19166c7f33fd None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:32.797585 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a542867-31dc-4105-b353-19166c7f33fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:32.824822 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-6a542867-31dc-4105-b353-19166c7f33fd None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:32.826242 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-6a542867-31dc-4105-b353-19166c7f33fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:32.879734 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 133/260] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:35:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:35:32.885141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda68f6f-9fd4-412a-b55d-53d3a722a516 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:32.937057 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:32.975621 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 128/261] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:33.017056 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a542867-31dc-4105-b353-19166c7f33fd None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:33.049554 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda68f6f-9fd4-412a-b55d-53d3a722a516 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:33.093584 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273b8ab-3ff8-49b5-946c-a86add40ff1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:33.094462 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273b8ab-3ff8-49b5-946c-a86add40ff1a None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:33.094749 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273b8ab-3ff8-49b5-946c-a86add40ff1a None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:33.095023 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273b8ab-3ff8-49b5-946c-a86add40ff1a None admin] PATH_INFO: `/v3/projects/f050448816e04bc3ace6d56d9ec83679` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:33.096265 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273b8ab-3ff8-49b5-946c-a86add40ff1a None admin] RBAC: Authorizing `identity:get_project(project_id=f050448816e04bc3ace6d56d9ec83679)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:33.097725 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273b8ab-3ff8-49b5-946c-a86add40ff1a None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:33.099757 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 134/262] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:32 2022] GET /identity/v3/projects/f050448816e04bc3ace6d56d9ec83679 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:35:33.112325 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273b8ab-3ff8-49b5-946c-a86add40ff1a None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:33.206996 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:33.242162 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a542867-31dc-4105-b353-19166c7f33fd None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:33.298278 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:33.320326 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6dc832-1ab2-4212-a76d-a93519225ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:33.321161 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dc832-1ab2-4212-a76d-a93519225ba5 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:33.321448 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dc832-1ab2-4212-a76d-a93519225ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:33.321726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dc832-1ab2-4212-a76d-a93519225ba5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:33.323857 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273b8ab-3ff8-49b5-946c-a86add40ff1a None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:33.348201 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6dc832-1ab2-4212-a76d-a93519225ba5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:33.356749 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-da6dc832-1ab2-4212-a76d-a93519225ba5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:35:33.356749 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:33.356749 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:33.356749 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:33.356749 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:33.356749 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:33.356749 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:33.356749 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:33.356749 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:33.356749 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:33.356749 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:33.356749 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:33.356749 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:33.356749 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:33.356749 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:33.356749 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:33.357613 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:33.357613 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:33.357613 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:33.357613 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:33.357613 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:33.357613 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:33.357613 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:33.357613 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:33.357613 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:33.357613 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:33.357613 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:33.357613 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:35:33.357613 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:33.357613 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:33.357613 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:33.357613 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:33.358515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:33.358515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:33.358515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:33.358515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:33.358515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:33.358515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:33.358515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:33.358515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:33.358515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:33.358515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:33.358515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:35:33.358515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:35:33.358515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 129/263] 10.222.0.39 () {56 vars in 1114 bytes} [Mon May 23 15:35:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:35:33.369126 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6dc832-1ab2-4212-a76d-a93519225ba5 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:33.401855 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6a370-b923-4ef0-8070-3471c162808a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:33.402531 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6a370-b923-4ef0-8070-3471c162808a None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:33.402819 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6a370-b923-4ef0-8070-3471c162808a None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:33.403101 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6a370-b923-4ef0-8070-3471c162808a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:33.403977 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6a370-b923-4ef0-8070-3471c162808a None admin] RBAC: Adding query filter params (role.id=3ab888f5f68740bd8f9df4447f4f5a7a, scope.project.id=f050448816e04bc3ace6d56d9ec83679, user.id=4520b22a13054c5f999561a70e7a9b09) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:33.404296 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6a370-b923-4ef0-8070-3471c162808a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:33.406277 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6a370-b923-4ef0-8070-3471c162808a None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:33.422471 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 135/264] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:35:33 2022] GET /identity/v3/role_assignments?user.id=4520b22a13054c5f999561a70e7a9b09&scope.project.id=f050448816e04bc3ace6d56d9ec83679&role.id=3ab888f5f68740bd8f9df4447f4f5a7a => generated 608 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:35:33.561352 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6dc832-1ab2-4212-a76d-a93519225ba5 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:33.621942 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03577b34-14fa-47aa-bdd8-549b9f514948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:33.622641 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03577b34-14fa-47aa-bdd8-549b9f514948 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:33.622929 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03577b34-14fa-47aa-bdd8-549b9f514948 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:33.623212 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03577b34-14fa-47aa-bdd8-549b9f514948 None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:33.625279 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03577b34-14fa-47aa-bdd8-549b9f514948 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:33.625597 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03577b34-14fa-47aa-bdd8-549b9f514948 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:33.627033 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03577b34-14fa-47aa-bdd8-549b9f514948 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:33.639890 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 130/265] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:35:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:33.645587 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6a370-b923-4ef0-8070-3471c162808a None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:33.805830 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6a370-b923-4ef0-8070-3471c162808a None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:33.856573 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404154dc-9281-42e3-9602-c33e469612a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:33.857384 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404154dc-9281-42e3-9602-c33e469612a1 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:33.858213 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404154dc-9281-42e3-9602-c33e469612a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:33.858510 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404154dc-9281-42e3-9602-c33e469612a1 None admin] PATH_INFO: `/v3/users/4520b22a13054c5f999561a70e7a9b09` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:33.864334 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404154dc-9281-42e3-9602-c33e469612a1 None admin] RBAC: Authorizing `identity:get_user(user_id=4520b22a13054c5f999561a70e7a9b09)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:33.865811 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404154dc-9281-42e3-9602-c33e469612a1 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:33.867654 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 136/266] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:35:33 2022] GET /identity/v3/users/4520b22a13054c5f999561a70e7a9b09 => generated 283 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:33.873737 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03577b34-14fa-47aa-bdd8-549b9f514948 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:33.893661 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:33.998209 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e72e06-8c3d-414e-b0de-6b96b6db0449 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:33.999200 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e72e06-8c3d-414e-b0de-6b96b6db0449 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:33.999496 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e72e06-8c3d-414e-b0de-6b96b6db0449 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:34.001024 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 137/267] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:34.006212 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c4ab0-cdbf-441c-8d3a-2f09a534c02d None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:34.006500 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c4ab0-cdbf-441c-8d3a-2f09a534c02d None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:34.006790 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c4ab0-cdbf-441c-8d3a-2f09a534c02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:34.012114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03577b34-14fa-47aa-bdd8-549b9f514948 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:34.035032 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-c56c4ab0-cdbf-441c-8d3a-2f09a534c02d None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:34.036635 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-c56c4ab0-cdbf-441c-8d3a-2f09a534c02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:34.057593 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:34.058848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3517a-7d91-46cb-a15e-1bf9c6c995d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:34.059712 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3517a-7d91-46cb-a15e-1bf9c6c995d6 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:34.060146 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3517a-7d91-46cb-a15e-1bf9c6c995d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:34.060599 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3517a-7d91-46cb-a15e-1bf9c6c995d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:34.128899 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 138/268] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:35:34.130654 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cdc6a-7714-49a0-b268-432a3c563f09 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:34.131023 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cdc6a-7714-49a0-b268-432a3c563f09 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:34.131378 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cdc6a-7714-49a0-b268-432a3c563f09 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:34.133832 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 139/269] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:34.141229 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46adc5-2edb-4074-93c4-02a4527b6fba None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:34.141521 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46adc5-2edb-4074-93c4-02a4527b6fba None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:34.141810 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46adc5-2edb-4074-93c4-02a4527b6fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:34.153959 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3517a-7d91-46cb-a15e-1bf9c6c995d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:34.155690 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3517a-7d91-46cb-a15e-1bf9c6c995d6 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:34.166691 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:34.171690 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-ec46adc5-2edb-4074-93c4-02a4527b6fba None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:34.172912 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-ec46adc5-2edb-4074-93c4-02a4527b6fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:34.275127 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 140/270] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:35:34.276553 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46adc5-2edb-4074-93c4-02a4527b6fba None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:34.290853 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 131/271] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:35:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:35:34.306957 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3517a-7d91-46cb-a15e-1bf9c6c995d6 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:34.381904 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:34.400339 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46adc5-2edb-4074-93c4-02a4527b6fba None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:34.414341 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3517a-7d91-46cb-a15e-1bf9c6c995d6 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:34.424669 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:34.441920 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ddfc0-2d3f-45b7-88c3-64c295fb2157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:34.443018 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ddfc0-2d3f-45b7-88c3-64c295fb2157 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:34.443486 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ddfc0-2d3f-45b7-88c3-64c295fb2157 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:34.443970 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ddfc0-2d3f-45b7-88c3-64c295fb2157 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:34.450802 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f6975-064d-4139-9aea-cb23234c53ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:34.453077 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f6975-064d-4139-9aea-cb23234c53ce None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:34.453532 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f6975-064d-4139-9aea-cb23234c53ce None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:34.453960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f6975-064d-4139-9aea-cb23234c53ce None admin] PATH_INFO: `/v3/projects/f050448816e04bc3ace6d56d9ec83679` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:34.455504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f6975-064d-4139-9aea-cb23234c53ce None admin] RBAC: Authorizing `identity:get_project(project_id=f050448816e04bc3ace6d56d9ec83679)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:34.457279 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f6975-064d-4139-9aea-cb23234c53ce None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:34.458917 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ddfc0-2d3f-45b7-88c3-64c295fb2157 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:34.459562 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 132/272] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:34 2022] GET /identity/v3/projects/f050448816e04bc3ace6d56d9ec83679 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:35:34.460604 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f6975-064d-4139-9aea-cb23234c53ce None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:34.474016 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-173ddfc0-2d3f-45b7-88c3-64c295fb2157 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:34.474016 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:34.474016 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:34.474016 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:34.474016 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:34.474016 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:34.474016 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:34.474016 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:34.474016 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:34.474016 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:34.474016 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:34.474016 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:34.474016 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:34.474016 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:34.474016 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:34.474016 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:34.474971 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:34.474971 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:34.474971 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:34.474971 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:34.474971 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:34.474971 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:34.474971 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:34.474971 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:34.474971 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:34.474971 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:34.474971 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:34.474971 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:35:34.474971 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:34.474971 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:34.474971 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:34.474971 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:34.476005 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:34.476005 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:34.476005 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:34.476005 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:34.476005 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:34.476005 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:34.476005 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:34.476005 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:34.476005 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:34.476005 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:34.476005 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:34.476005 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:35:34.478036 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 141/273] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:34.483725 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ddfc0-2d3f-45b7-88c3-64c295fb2157 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:34.595869 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ddfc0-2d3f-45b7-88c3-64c295fb2157 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:34.614153 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f6975-064d-4139-9aea-cb23234c53ce None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:34.633967 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80471b-75d3-448e-93fd-ce41f1cbf389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:34.635009 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80471b-75d3-448e-93fd-ce41f1cbf389 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:34.635505 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80471b-75d3-448e-93fd-ce41f1cbf389 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:34.636067 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80471b-75d3-448e-93fd-ce41f1cbf389 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:34.637176 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80471b-75d3-448e-93fd-ce41f1cbf389 None admin] RBAC: Adding query filter params (role.id=a487e8d6e71d4a399b050274528d8db7, scope.project.id=f050448816e04bc3ace6d56d9ec83679, user.id=4520b22a13054c5f999561a70e7a9b09) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:34.637713 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80471b-75d3-448e-93fd-ce41f1cbf389 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:34.640126 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80471b-75d3-448e-93fd-ce41f1cbf389 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:34.652016 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 142/274] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:35:34 2022] GET /identity/v3/role_assignments?user.id=4520b22a13054c5f999561a70e7a9b09&scope.project.id=f050448816e04bc3ace6d56d9ec83679&role.id=a487e8d6e71d4a399b050274528d8db7 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:34.653842 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80471b-75d3-448e-93fd-ce41f1cbf389 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:34.664562 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24737c0a-afff-404c-bd2d-a701814b3364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:34.665426 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24737c0a-afff-404c-bd2d-a701814b3364 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:34.665713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24737c0a-afff-404c-bd2d-a701814b3364 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:34.665994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24737c0a-afff-404c-bd2d-a701814b3364 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:34.667334 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24737c0a-afff-404c-bd2d-a701814b3364 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:34.668891 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24737c0a-afff-404c-bd2d-a701814b3364 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:34.673021 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 133/275] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:35:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:34.673977 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:34.676820 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344ee8e-64e6-4a0b-8b1c-65b039f2ad72 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:34.677119 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344ee8e-64e6-4a0b-8b1c-65b039f2ad72 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:34.677402 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344ee8e-64e6-4a0b-8b1c-65b039f2ad72 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:34.679549 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 134/276] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:34.680339 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344ee8e-64e6-4a0b-8b1c-65b039f2ad72 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:34.742852 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:34.788712 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80471b-75d3-448e-93fd-ce41f1cbf389 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:34.803094 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344ee8e-64e6-4a0b-8b1c-65b039f2ad72 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:34.829776 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5528cd15-0ed1-4acb-9dc0-acb3f704e494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:34.830462 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528cd15-0ed1-4acb-9dc0-acb3f704e494 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:34.830750 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528cd15-0ed1-4acb-9dc0-acb3f704e494 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:34.831031 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528cd15-0ed1-4acb-9dc0-acb3f704e494 None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:34.831834 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5528cd15-0ed1-4acb-9dc0-acb3f704e494 None admin] RBAC: Adding query filter params (name=member) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:34.832150 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5528cd15-0ed1-4acb-9dc0-acb3f704e494 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:34.833736 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5528cd15-0ed1-4acb-9dc0-acb3f704e494 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:34.841686 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381aa040-cc31-474a-b3dc-9e7cb2ed8fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:34.842934 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381aa040-cc31-474a-b3dc-9e7cb2ed8fb1 None admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:34.843213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381aa040-cc31-474a-b3dc-9e7cb2ed8fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:34.843494 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381aa040-cc31-474a-b3dc-9e7cb2ed8fb1 None admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:34.844201 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 143/277] 10.222.0.39 () {56 vars in 1101 bytes} [Mon May 23 15:35:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:34.844423 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381aa040-cc31-474a-b3dc-9e7cb2ed8fb1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:34.845318 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b774b1-541d-4b39-a350-bf82839299e1 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:34.845794 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b774b1-541d-4b39-a350-bf82839299e1 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:34.845900 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381aa040-cc31-474a-b3dc-9e7cb2ed8fb1 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:34.846079 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b774b1-541d-4b39-a350-bf82839299e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:34.864381 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-a9b774b1-541d-4b39-a350-bf82839299e1 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:34.865598 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-a9b774b1-541d-4b39-a350-bf82839299e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:34.935318 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:34.937443 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 135/278] 10.222.0.39 () {60 vars in 1132 bytes} [Mon May 23 15:35:34 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:35:34.938833 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9deec-9696-443f-a7ad-9c6b9b2274c0 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:34.939131 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9deec-9696-443f-a7ad-9c6b9b2274c0 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:34.939405 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9deec-9696-443f-a7ad-9c6b9b2274c0 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:34.940480 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 144/279] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:34.942192 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 136/280] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:34.945869 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b774b1-541d-4b39-a350-bf82839299e1 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:34.946742 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f098c89-adfb-4968-bb76-5700063279c6 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:34.947039 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f098c89-adfb-4968-bb76-5700063279c6 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:34.947367 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f098c89-adfb-4968-bb76-5700063279c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:34.965266 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-1f098c89-adfb-4968-bb76-5700063279c6 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:34.966571 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-1f098c89-adfb-4968-bb76-5700063279c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:35.054084 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 137/281] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:35:35.055364 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f098c89-adfb-4968-bb76-5700063279c6 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:35.069518 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b774b1-541d-4b39-a350-bf82839299e1 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:35.095919 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:35.113067 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9da7c0-b908-4bab-9f67-d3dcaffec5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:35.113959 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9da7c0-b908-4bab-9f67-d3dcaffec5d2 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:35.114244 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9da7c0-b908-4bab-9f67-d3dcaffec5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:35.114571 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9da7c0-b908-4bab-9f67-d3dcaffec5d2 None admin] PATH_INFO: `/v3/users/5753955d5d0c49fead7e92f7b6a90bcc` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:35.131225 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9da7c0-b908-4bab-9f67-d3dcaffec5d2 None admin] RBAC: Authorizing `identity:get_user(user_id=5753955d5d0c49fead7e92f7b6a90bcc)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:35.132754 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9da7c0-b908-4bab-9f67-d3dcaffec5d2 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:35.134488 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 145/282] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:35:34 2022] GET /identity/v3/users/5753955d5d0c49fead7e92f7b6a90bcc => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:35.135388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9da7c0-b908-4bab-9f67-d3dcaffec5d2 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:35.174906 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f098c89-adfb-4968-bb76-5700063279c6 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:35.214466 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:35.225681 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170c28e-9487-4f25-aae1-df17e5ff1b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:35.226479 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170c28e-9487-4f25-aae1-df17e5ff1b5b None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:35.226756 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170c28e-9487-4f25-aae1-df17e5ff1b5b None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:35.227027 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170c28e-9487-4f25-aae1-df17e5ff1b5b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:35.244204 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170c28e-9487-4f25-aae1-df17e5ff1b5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:35.252440 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-1170c28e-9487-4f25-aae1-df17e5ff1b5b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:35:35.252440 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:35.252440 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:35.252440 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:35.252440 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:35.252440 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:35.252440 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:35.252440 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:35.252440 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:35.252440 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:35.252440 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:35.252440 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:35.252440 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:35.252440 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:35.252440 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:35.252440 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:35.253330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:35.253330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:35.253330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:35.253330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:35.253330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:35.253330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:35.253330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:35.253330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:35.253330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:35.253330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:35.253330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:35.253330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:35:35.253330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:35.253330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:35.253330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:35.253330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:35.255049 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:35.255049 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:35.255049 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:35.255049 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:35.255049 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:35.255049 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:35.255049 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:35.255049 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:35.255049 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:35.255049 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:35.255049 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:35:35.255049 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:35:35.255049 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 138/283] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:35.255049 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170c28e-9487-4f25-aae1-df17e5ff1b5b None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:35.277674 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9da7c0-b908-4bab-9f67-d3dcaffec5d2 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:35.320896 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b05d1d-7a8d-49a2-b8f5-da667ce4fcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:35.321687 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b05d1d-7a8d-49a2-b8f5-da667ce4fcb2 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:35.321965 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b05d1d-7a8d-49a2-b8f5-da667ce4fcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:35.322238 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b05d1d-7a8d-49a2-b8f5-da667ce4fcb2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:35.332991 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b05d1d-7a8d-49a2-b8f5-da667ce4fcb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:35.340663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-83b05d1d-7a8d-49a2-b8f5-da667ce4fcb2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:35.340663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:35.340663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:35.340663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:35.340663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:35.340663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:35.340663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:35.340663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:35.340663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:35.340663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:35.340663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:35.340663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:35.340663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:35.340663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:35.340663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:35.340663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:35.341540 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:35.341540 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:35.341540 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:35.341540 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:35.341540 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:35.341540 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:35.341540 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:35.341540 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:35.341540 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:35.341540 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:35.341540 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:35.341540 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:35:35.341540 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:35.341540 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:35.341540 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:35.341540 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:35.342837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:35.342837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:35.342837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:35.342837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:35.342837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:35.342837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:35.342837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:35.342837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:35.342837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:35.342837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:35.342837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:35.342837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:35:35.342837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 146/284] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:35.342837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b05d1d-7a8d-49a2-b8f5-da667ce4fcb2 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:35.379309 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:35.391663 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170c28e-9487-4f25-aae1-df17e5ff1b5b None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:35.438336 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717ec15-b781-4ead-986d-d371c42c1a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:35.439252 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717ec15-b781-4ead-986d-d371c42c1a0a None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:35.439538 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717ec15-b781-4ead-986d-d371c42c1a0a None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:35.440234 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717ec15-b781-4ead-986d-d371c42c1a0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:35.441083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3717ec15-b781-4ead-986d-d371c42c1a0a None admin] RBAC: Adding query filter params (role.id=c41a7cd1c92b45a7bff9632d07b48006, user.id=5753955d5d0c49fead7e92f7b6a90bcc, scope.system=all) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:35.441395 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3717ec15-b781-4ead-986d-d371c42c1a0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:35.442859 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3717ec15-b781-4ead-986d-d371c42c1a0a None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:35.451038 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 139/285] 10.222.0.39 () {56 vars in 1308 bytes} [Mon May 23 15:35:35 2022] GET /identity/v3/role_assignments?user.id=5753955d5d0c49fead7e92f7b6a90bcc&scope.system=all&role.id=c41a7cd1c92b45a7bff9632d07b48006 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:35.452530 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717ec15-b781-4ead-986d-d371c42c1a0a None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:35.457347 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b05d1d-7a8d-49a2-b8f5-da667ce4fcb2 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:35.478764 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:35.499612 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689a233-801a-4e41-85df-39cdafcaaa73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:35.501403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689a233-801a-4e41-85df-39cdafcaaa73 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:35.501855 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689a233-801a-4e41-85df-39cdafcaaa73 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:35.502221 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689a233-801a-4e41-85df-39cdafcaaa73 None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:35.503074 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689a233-801a-4e41-85df-39cdafcaaa73 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:35.503453 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689a233-801a-4e41-85df-39cdafcaaa73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:35.505011 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689a233-801a-4e41-85df-39cdafcaaa73 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:35.515092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 147/286] 10.222.0.39 () {56 vars in 1101 bytes} [Mon May 23 15:35:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:35.527732 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689a233-801a-4e41-85df-39cdafcaaa73 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:35.594334 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717ec15-b781-4ead-986d-d371c42c1a0a None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:35.650802 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f6fd9-cebc-4a25-9a91-f3f0ac3e2ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:35.651495 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f6fd9-cebc-4a25-9a91-f3f0ac3e2ff1 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:35.651802 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f6fd9-cebc-4a25-9a91-f3f0ac3e2ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:35.652079 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f6fd9-cebc-4a25-9a91-f3f0ac3e2ff1 None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:35.652849 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f6fd9-cebc-4a25-9a91-f3f0ac3e2ff1 None admin] RBAC: Adding query filter params (name=member) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:35.653158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f6fd9-cebc-4a25-9a91-f3f0ac3e2ff1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:35.655200 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f6fd9-cebc-4a25-9a91-f3f0ac3e2ff1 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:35.671625 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 140/287] 10.222.0.39 () {56 vars in 1101 bytes} [Mon May 23 15:35:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:35.679740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f6fd9-cebc-4a25-9a91-f3f0ac3e2ff1 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:35.713576 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:35.716690 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689a233-801a-4e41-85df-39cdafcaaa73 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:35.782783 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f347d-da6a-4c69-b54a-28af864eb269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:35.783718 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f347d-da6a-4c69-b54a-28af864eb269 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:35.784016 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f347d-da6a-4c69-b54a-28af864eb269 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:35.784296 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f347d-da6a-4c69-b54a-28af864eb269 None admin] PATH_INFO: `/v3/users/17e9ee8da9484c809a6a130036963127` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:35.785517 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f347d-da6a-4c69-b54a-28af864eb269 None admin] RBAC: Authorizing `identity:get_user(user_id=17e9ee8da9484c809a6a130036963127)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:35.786981 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f347d-da6a-4c69-b54a-28af864eb269 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:35.789444 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 148/288] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:35:35 2022] GET /identity/v3/users/17e9ee8da9484c809a6a130036963127 => generated 297 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:35.794715 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f347d-da6a-4c69-b54a-28af864eb269 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:35.878704 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f6fd9-cebc-4a25-9a91-f3f0ac3e2ff1 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:35.890861 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:35.940690 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2179a-8737-4792-a9bf-3941fafb44ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:35.941571 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2179a-8737-4792-a9bf-3941fafb44ca None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:35.941854 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2179a-8737-4792-a9bf-3941fafb44ca None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:35.942126 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2179a-8737-4792-a9bf-3941fafb44ca None admin] PATH_INFO: `/v3/users/f0f1c6df617f4ee6b9ee35f615af2368` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:35.944733 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb2179a-8737-4792-a9bf-3941fafb44ca None admin] RBAC: Authorizing `identity:get_user(user_id=f0f1c6df617f4ee6b9ee35f615af2368)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:35.946182 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb2179a-8737-4792-a9bf-3941fafb44ca None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:35.948687 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 141/289] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:35:35 2022] GET /identity/v3/users/f0f1c6df617f4ee6b9ee35f615af2368 => generated 297 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:35.956189 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2179a-8737-4792-a9bf-3941fafb44ca None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:35.982007 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f347d-da6a-4c69-b54a-28af864eb269 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:36.040437 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d0c8e-956e-4cb0-ab1d-56cefb4ecf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:36.041215 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d0c8e-956e-4cb0-ab1d-56cefb4ecf45 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:36.041494 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d0c8e-956e-4cb0-ab1d-56cefb4ecf45 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:36.041765 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d0c8e-956e-4cb0-ab1d-56cefb4ecf45 None admin] PATH_INFO: `/v3/projects/f050448816e04bc3ace6d56d9ec83679` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:36.044126 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d0c8e-956e-4cb0-ab1d-56cefb4ecf45 None admin] RBAC: Authorizing `identity:get_project(project_id=f050448816e04bc3ace6d56d9ec83679)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:36.046093 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d0c8e-956e-4cb0-ab1d-56cefb4ecf45 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:36.052035 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 149/290] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:35 2022] GET /identity/v3/projects/f050448816e04bc3ace6d56d9ec83679 => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:36.057010 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d0c8e-956e-4cb0-ab1d-56cefb4ecf45 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:36.103957 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:36.135375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2179a-8737-4792-a9bf-3941fafb44ca None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:36.202856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee49e8-4d09-4bf8-8d58-f2746802e81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:36.203624 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee49e8-4d09-4bf8-8d58-f2746802e81a None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:36.203939 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee49e8-4d09-4bf8-8d58-f2746802e81a None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:36.204197 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee49e8-4d09-4bf8-8d58-f2746802e81a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:36.251923 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d0c8e-956e-4cb0-ab1d-56cefb4ecf45 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:36.287441 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:36.323998 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c1980-3bb5-4c4c-bcdc-b90fbe093f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:36.324893 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c1980-3bb5-4c4c-bcdc-b90fbe093f68 None admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:36.325175 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c1980-3bb5-4c4c-bcdc-b90fbe093f68 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:36.325452 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c1980-3bb5-4c4c-bcdc-b90fbe093f68 None admin] PATH_INFO: `/v3/projects/f050448816e04bc3ace6d56d9ec83679/users/17e9ee8da9484c809a6a130036963127/roles/86bedad6f8c84aefb5822c67df949d08` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:36.332964 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c1980-3bb5-4c4c-bcdc-b90fbe093f68 None admin] RBAC: Authorizing `identity:create_grant(project_id=f050448816e04bc3ace6d56d9ec83679, user_id=17e9ee8da9484c809a6a130036963127, role_id=86bedad6f8c84aefb5822c67df949d08)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:36.334450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c1980-3bb5-4c4c-bcdc-b90fbe093f68 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:36.340099 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee49e8-4d09-4bf8-8d58-f2746802e81a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:36.341606 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee49e8-4d09-4bf8-8d58-f2746802e81a None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:36.422980 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 150/291] 10.222.0.39 () {58 vars in 1439 bytes} [Mon May 23 15:35:36 2022] PUT /identity/v3/projects/f050448816e04bc3ace6d56d9ec83679/users/17e9ee8da9484c809a6a130036963127/roles/86bedad6f8c84aefb5822c67df949d08 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:35:36.452808 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:36.481516 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 142/292] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:35:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:35:36.487473 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c1980-3bb5-4c4c-bcdc-b90fbe093f68 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:36.625585 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c1980-3bb5-4c4c-bcdc-b90fbe093f68 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:36.673363 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb5047-b789-4af1-aa53-d7a663e65d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:36.674327 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb5047-b789-4af1-aa53-d7a663e65d5a None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:36.674615 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb5047-b789-4af1-aa53-d7a663e65d5a None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:36.674893 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb5047-b789-4af1-aa53-d7a663e65d5a None admin] PATH_INFO: `/v3/projects/f050448816e04bc3ace6d56d9ec83679` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:36.676212 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb5047-b789-4af1-aa53-d7a663e65d5a None admin] RBAC: Authorizing `identity:get_project(project_id=f050448816e04bc3ace6d56d9ec83679)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:36.677805 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb5047-b789-4af1-aa53-d7a663e65d5a None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:36.679950 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 151/293] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:36 2022] GET /identity/v3/projects/f050448816e04bc3ace6d56d9ec83679 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:36.685884 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee49e8-4d09-4bf8-8d58-f2746802e81a None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:36.797200 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee49e8-4d09-4bf8-8d58-f2746802e81a None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:36.843150 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd7e62-4453-46aa-a778-9a8171f7c76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:36.844209 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd7e62-4453-46aa-a778-9a8171f7c76c None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:36.844688 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd7e62-4453-46aa-a778-9a8171f7c76c None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:36.845174 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd7e62-4453-46aa-a778-9a8171f7c76c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:36.846192 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd7e62-4453-46aa-a778-9a8171f7c76c None admin] RBAC: Adding query filter params (role.id=c41a7cd1c92b45a7bff9632d07b48006, scope.project.id=f050448816e04bc3ace6d56d9ec83679, user.id=f0f1c6df617f4ee6b9ee35f615af2368) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:36.846695 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd7e62-4453-46aa-a778-9a8171f7c76c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:36.848389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd7e62-4453-46aa-a778-9a8171f7c76c None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:36.854979 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 143/294] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:35:36 2022] GET /identity/v3/role_assignments?user.id=f0f1c6df617f4ee6b9ee35f615af2368&scope.project.id=f050448816e04bc3ace6d56d9ec83679&role.id=c41a7cd1c92b45a7bff9632d07b48006 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:37.616618 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a939f50-1d41-4b05-8cfa-2487265fc896 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:37.617205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a939f50-1d41-4b05-8cfa-2487265fc896 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:37.617205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a939f50-1d41-4b05-8cfa-2487265fc896 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:37.618854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 152/295] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:37.625559 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe27d34-238c-4e9e-9fc6-8a729c225c6b None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:37.625985 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe27d34-238c-4e9e-9fc6-8a729c225c6b None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:37.626172 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe27d34-238c-4e9e-9fc6-8a729c225c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:37.645463 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-dfe27d34-238c-4e9e-9fc6-8a729c225c6b None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:37.646963 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-dfe27d34-238c-4e9e-9fc6-8a729c225c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:37.692748 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:37.716248 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 144/296] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:37.717572 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86878385-7273-47a5-88b0-58a8a9dd996c None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:37.717866 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86878385-7273-47a5-88b0-58a8a9dd996c None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:37.718147 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86878385-7273-47a5-88b0-58a8a9dd996c None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:37.719489 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 153/297] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:37.724746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e10c4-c08a-4d81-bc4e-bb0fc8063e3b None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:37.725039 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e10c4-c08a-4d81-bc4e-bb0fc8063e3b None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:37.725320 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e10c4-c08a-4d81-bc4e-bb0fc8063e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:37.743870 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86878385-7273-47a5-88b0-58a8a9dd996c None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:37.744333 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-4a9e10c4-c08a-4d81-bc4e-bb0fc8063e3b None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:37.745710 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-4a9e10c4-c08a-4d81-bc4e-bb0fc8063e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:37.807085 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:37.826789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 145/298] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:37.850248 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e10c4-c08a-4d81-bc4e-bb0fc8063e3b None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:37.872839 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86878385-7273-47a5-88b0-58a8a9dd996c None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:37.920896 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918ca72-93dc-4110-8eda-65abfe693aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:37.922230 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918ca72-93dc-4110-8eda-65abfe693aa6 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:37.922521 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918ca72-93dc-4110-8eda-65abfe693aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:37.922802 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918ca72-93dc-4110-8eda-65abfe693aa6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:37.937254 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918ca72-93dc-4110-8eda-65abfe693aa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:37.947985 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-3918ca72-93dc-4110-8eda-65abfe693aa6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:35:37.947985 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:37.947985 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:37.947985 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:37.947985 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:37.947985 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:37.947985 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:37.947985 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:37.947985 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:37.947985 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:37.947985 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:37.947985 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:37.947985 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:37.947985 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:37.947985 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:37.947985 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:37.948846 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:37.948846 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:37.948846 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:37.948846 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:37.948846 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:37.948846 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:37.948846 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:37.948846 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:37.948846 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:37.948846 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:37.948846 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:37.948846 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:35:37.948846 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:37.948846 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:37.948846 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:37.948846 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:37.949614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:37.949614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:37.949614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:37.949614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:37.949614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:37.949614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:37.949614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:37.949614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:37.949614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:37.949614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:37.949614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:35:37.949614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:35:37.949614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 154/299] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:37.956795 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918ca72-93dc-4110-8eda-65abfe693aa6 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:37.996188 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e10c4-c08a-4d81-bc4e-bb0fc8063e3b None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:38.009313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:38.047805 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8e5aa-d547-4798-b3e5-0c8abd909daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:38.048716 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8e5aa-d547-4798-b3e5-0c8abd909daa None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:38.049070 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8e5aa-d547-4798-b3e5-0c8abd909daa None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:38.049418 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8e5aa-d547-4798-b3e5-0c8abd909daa None admin] PATH_INFO: `/v3/domains/default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:38.050667 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8e5aa-d547-4798-b3e5-0c8abd909daa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:38.052318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8e5aa-d547-4798-b3e5-0c8abd909daa None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:38.054787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 146/300] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:35:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:35:38.059868 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8e5aa-d547-4798-b3e5-0c8abd909daa None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:38.085379 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918ca72-93dc-4110-8eda-65abfe693aa6 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:38.088872 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:38.123853 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985a645-fb54-4cbe-8a00-bbb4d422044e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:38.124451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985a645-fb54-4cbe-8a00-bbb4d422044e None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:38.124921 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985a645-fb54-4cbe-8a00-bbb4d422044e None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:38.125319 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985a645-fb54-4cbe-8a00-bbb4d422044e None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:38.126323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985a645-fb54-4cbe-8a00-bbb4d422044e None admin] RBAC: Adding query filter params (name=reader) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:38.126820 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985a645-fb54-4cbe-8a00-bbb4d422044e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:38.128642 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985a645-fb54-4cbe-8a00-bbb4d422044e None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:38.143731 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 155/301] 10.222.0.39 () {56 vars in 1101 bytes} [Mon May 23 15:35:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:38.143731 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5bf39-5327-44ba-a20f-687d4b54605c None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:38.143731 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5bf39-5327-44ba-a20f-687d4b54605c None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:38.143731 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5bf39-5327-44ba-a20f-687d4b54605c None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:38.143731 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 156/302] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:38.143731 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5bf39-5327-44ba-a20f-687d4b54605c None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:38.172057 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8e5aa-d547-4798-b3e5-0c8abd909daa None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:38.250414 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f7133-cdcd-4e1d-9ca0-db27fc57278d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:38.251138 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f7133-cdcd-4e1d-9ca0-db27fc57278d None admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:38.251423 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f7133-cdcd-4e1d-9ca0-db27fc57278d None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:38.251724 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f7133-cdcd-4e1d-9ca0-db27fc57278d None admin] PATH_INFO: `/v3/groups` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:38.252410 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f7133-cdcd-4e1d-9ca0-db27fc57278d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:38.253851 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f7133-cdcd-4e1d-9ca0-db27fc57278d None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:38.315086 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5bf39-5327-44ba-a20f-687d4b54605c None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:38.330843 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 147/303] 10.222.0.39 () {60 vars in 1134 bytes} [Mon May 23 15:35:38 2022] POST /identity/v3/groups => generated 229 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:35:38.345500 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b21e23-8ea6-48e9-a72c-f9f3aa80c613 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:38.345841 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b21e23-8ea6-48e9-a72c-f9f3aa80c613 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:38.346077 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b21e23-8ea6-48e9-a72c-f9f3aa80c613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:38.350335 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4208a-7e37-4fa8-834f-a6fb996e348e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:38.351223 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4208a-7e37-4fa8-834f-a6fb996e348e None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:38.351620 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4208a-7e37-4fa8-834f-a6fb996e348e None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:38.351875 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4208a-7e37-4fa8-834f-a6fb996e348e None admin] PATH_INFO: `/v3/users/52af383ae11242c8a2d49e7ed7dc417d` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:38.370637 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4208a-7e37-4fa8-834f-a6fb996e348e None admin] RBAC: Authorizing `identity:get_user(user_id=52af383ae11242c8a2d49e7ed7dc417d)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:38.372193 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4208a-7e37-4fa8-834f-a6fb996e348e None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:38.375643 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-83b21e23-8ea6-48e9-a72c-f9f3aa80c613 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:38.377207 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-83b21e23-8ea6-48e9-a72c-f9f3aa80c613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:38.379518 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 157/304] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:35:38 2022] GET /identity/v3/users/52af383ae11242c8a2d49e7ed7dc417d => generated 293 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:38.380573 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4208a-7e37-4fa8-834f-a6fb996e348e None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:38.412007 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:38.422704 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:38.489444 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 148/305] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:38.509092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4208a-7e37-4fa8-834f-a6fb996e348e None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:38.514078 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b21e23-8ea6-48e9-a72c-f9f3aa80c613 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:38.556584 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c82bd-3da7-45d3-a8f6-68b95e5f24ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:38.557254 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c82bd-3da7-45d3-a8f6-68b95e5f24ba None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:38.557522 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c82bd-3da7-45d3-a8f6-68b95e5f24ba None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:38.557799 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c82bd-3da7-45d3-a8f6-68b95e5f24ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:38.558652 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c82bd-3da7-45d3-a8f6-68b95e5f24ba None admin] RBAC: Adding query filter params (role.id=86bedad6f8c84aefb5822c67df949d08, user.id=52af383ae11242c8a2d49e7ed7dc417d, scope.system=all) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:38.559022 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c82bd-3da7-45d3-a8f6-68b95e5f24ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:38.561124 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c82bd-3da7-45d3-a8f6-68b95e5f24ba None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:38.566621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 158/306] 10.222.0.39 () {56 vars in 1308 bytes} [Mon May 23 15:35:38 2022] GET /identity/v3/role_assignments?user.id=52af383ae11242c8a2d49e7ed7dc417d&scope.system=all&role.id=86bedad6f8c84aefb5822c67df949d08 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:38.636498 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b21e23-8ea6-48e9-a72c-f9f3aa80c613 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:38.676520 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d566d5-c319-466a-9c20-fc04acef42af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:38.677689 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d566d5-c319-466a-9c20-fc04acef42af None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:38.678191 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d566d5-c319-466a-9c20-fc04acef42af None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:38.678682 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d566d5-c319-466a-9c20-fc04acef42af None admin] PATH_INFO: `/v3/roles/member` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:38.696151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d566d5-c319-466a-9c20-fc04acef42af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:38.704649 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-d5d566d5-c319-466a-9c20-fc04acef42af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:38.704649 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:38.704649 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:38.704649 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:38.704649 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:38.704649 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:38.704649 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:38.704649 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:38.704649 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:38.704649 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:38.704649 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:38.704649 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:38.704649 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:38.704649 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:38.704649 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:38.704649 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:38.705638 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:38.705638 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:38.705638 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:38.705638 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:38.705638 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:38.705638 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:38.705638 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:38.705638 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:38.705638 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:38.705638 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:38.705638 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:38.705638 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:35:38.705638 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:38.705638 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:38.705638 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:38.705638 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:38.706451 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:38.706451 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:38.706451 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:38.706451 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:38.706451 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:38.706451 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:38.706451 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:38.706451 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:38.706451 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:38.706451 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:38.706451 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:38.706451 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:35:38.706451 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 149/307] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:38.717467 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c82bd-3da7-45d3-a8f6-68b95e5f24ba None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:38.824169 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:38.836745 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c82bd-3da7-45d3-a8f6-68b95e5f24ba None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:38.879064 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16dab4-f0ca-4528-bc6f-1a7a24fd1474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:38.880128 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16dab4-f0ca-4528-bc6f-1a7a24fd1474 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:38.880656 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16dab4-f0ca-4528-bc6f-1a7a24fd1474 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:38.881127 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16dab4-f0ca-4528-bc6f-1a7a24fd1474 None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:38.882069 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16dab4-f0ca-4528-bc6f-1a7a24fd1474 None admin] RBAC: Adding query filter params (name=member) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:38.882571 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16dab4-f0ca-4528-bc6f-1a7a24fd1474 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:38.884238 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16dab4-f0ca-4528-bc6f-1a7a24fd1474 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:38.894118 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 159/308] 10.222.0.39 () {56 vars in 1101 bytes} [Mon May 23 15:35:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:38.899890 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d566d5-c319-466a-9c20-fc04acef42af None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:38.907890 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9f474-194b-4064-8751-fb0e02e1983c None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:38.908182 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9f474-194b-4064-8751-fb0e02e1983c None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:38.908467 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9f474-194b-4064-8751-fb0e02e1983c None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:38.911114 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 160/309] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:35:38.915135 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025289f-e79c-4c9a-b00f-fdd5a8b7e952 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:38.915430 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025289f-e79c-4c9a-b00f-fdd5a8b7e952 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:38.915751 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025289f-e79c-4c9a-b00f-fdd5a8b7e952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:38.931395 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:38.934419 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-4025289f-e79c-4c9a-b00f-fdd5a8b7e952 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:38.936181 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-4025289f-e79c-4c9a-b00f-fdd5a8b7e952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:39.019698 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 161/310] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:35:39.028396 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d566d5-c319-466a-9c20-fc04acef42af None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:39.036683 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025289f-e79c-4c9a-b00f-fdd5a8b7e952 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:39.064951 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daeae8e-ada2-4895-9a2a-24e750305bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:39.065951 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daeae8e-ada2-4895-9a2a-24e750305bdd None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:39.066335 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daeae8e-ada2-4895-9a2a-24e750305bdd None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:39.066614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daeae8e-ada2-4895-9a2a-24e750305bdd None admin] PATH_INFO: `/v3/users/5753955d5d0c49fead7e92f7b6a90bcc` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:39.067842 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daeae8e-ada2-4895-9a2a-24e750305bdd None admin] RBAC: Authorizing `identity:get_user(user_id=5753955d5d0c49fead7e92f7b6a90bcc)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:39.069547 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daeae8e-ada2-4895-9a2a-24e750305bdd None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:39.071484 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 150/311] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:35:38 2022] GET /identity/v3/users/5753955d5d0c49fead7e92f7b6a90bcc => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:39.078624 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daeae8e-ada2-4895-9a2a-24e750305bdd None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:39.129550 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:39.150693 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025289f-e79c-4c9a-b00f-fdd5a8b7e952 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:39.182081 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:39.189747 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daeae8e-ada2-4895-9a2a-24e750305bdd None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:39.202174 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7919cba-da2b-4dbb-8524-7c27477d56d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:39.203681 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7919cba-da2b-4dbb-8524-7c27477d56d1 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:39.204344 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7919cba-da2b-4dbb-8524-7c27477d56d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:39.204829 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7919cba-da2b-4dbb-8524-7c27477d56d1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:39.227710 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7919cba-da2b-4dbb-8524-7c27477d56d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:39.230383 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54f643-acc9-4802-abe8-1868a0368bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:39.231320 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54f643-acc9-4802-abe8-1868a0368bb5 None admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:39.231718 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54f643-acc9-4802-abe8-1868a0368bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:39.233695 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54f643-acc9-4802-abe8-1868a0368bb5 None admin] PATH_INFO: `/v3/system/users/5753955d5d0c49fead7e92f7b6a90bcc/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:39.235294 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54f643-acc9-4802-abe8-1868a0368bb5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5753955d5d0c49fead7e92f7b6a90bcc, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:39.237048 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54f643-acc9-4802-abe8-1868a0368bb5 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:39.238326 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-a7919cba-da2b-4dbb-8524-7c27477d56d1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:35:39.238326 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:39.238326 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:39.238326 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:39.238326 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:39.238326 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:39.238326 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:39.238326 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:39.238326 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:39.238326 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:39.238326 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:39.238326 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:39.238326 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:39.238326 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:39.238326 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:39.238326 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:39.239234 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:39.239234 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:39.239234 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:39.239234 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:39.239234 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:39.239234 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:39.239234 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:39.239234 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:39.239234 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:39.239234 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:39.239234 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:39.239234 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:35:39.239234 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:39.239234 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:39.239234 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:39.239234 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:39.240053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:39.240053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:39.240053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:39.240053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:39.240053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:39.240053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:39.240053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:39.240053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:39.240053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:39.240053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:39.240053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:35:39.240053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:35:39.243753 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 162/312] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:39.249510 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7919cba-da2b-4dbb-8524-7c27477d56d1 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:39.332037 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 151/313] 10.222.0.39 () {58 vars in 1334 bytes} [Mon May 23 15:35:39 2022] PUT /identity/v3/system/users/5753955d5d0c49fead7e92f7b6a90bcc/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:35:39.366276 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7919cba-da2b-4dbb-8524-7c27477d56d1 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:39.408748 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b42a2f-8028-4f0c-92f5-d53cb44bd4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:39.409669 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b42a2f-8028-4f0c-92f5-d53cb44bd4b3 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:39.410125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b42a2f-8028-4f0c-92f5-d53cb44bd4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:39.410549 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b42a2f-8028-4f0c-92f5-d53cb44bd4b3 None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:39.411456 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b42a2f-8028-4f0c-92f5-d53cb44bd4b3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:39.412005 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b42a2f-8028-4f0c-92f5-d53cb44bd4b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:39.413721 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b42a2f-8028-4f0c-92f5-d53cb44bd4b3 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:39.424314 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 163/314] 10.222.0.39 () {56 vars in 1101 bytes} [Mon May 23 15:35:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:39.431938 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54f643-acc9-4802-abe8-1868a0368bb5 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:39.540842 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54f643-acc9-4802-abe8-1868a0368bb5 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:39.575345 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39621def-295f-4b32-8d80-1e1a2f8ad488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:39.577041 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39621def-295f-4b32-8d80-1e1a2f8ad488 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:39.577327 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39621def-295f-4b32-8d80-1e1a2f8ad488 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:39.577603 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39621def-295f-4b32-8d80-1e1a2f8ad488 None admin] PATH_INFO: `/v3/users/17e9ee8da9484c809a6a130036963127` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:39.578795 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39621def-295f-4b32-8d80-1e1a2f8ad488 None admin] RBAC: Authorizing `identity:get_user(user_id=17e9ee8da9484c809a6a130036963127)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:39.580289 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39621def-295f-4b32-8d80-1e1a2f8ad488 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:39.586364 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 152/315] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:35:39 2022] GET /identity/v3/users/17e9ee8da9484c809a6a130036963127 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:39.587781 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b42a2f-8028-4f0c-92f5-d53cb44bd4b3 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:39.590731 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:39.696480 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b42a2f-8028-4f0c-92f5-d53cb44bd4b3 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:39.738179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940728ec-3aa8-4350-963b-351df886d7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:39.739674 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940728ec-3aa8-4350-963b-351df886d7a6 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:39.740190 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940728ec-3aa8-4350-963b-351df886d7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:39.740678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940728ec-3aa8-4350-963b-351df886d7a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:39.817284 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940728ec-3aa8-4350-963b-351df886d7a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:39.819082 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940728ec-3aa8-4350-963b-351df886d7a6 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:39.821219 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:39.923535 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 164/316] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:35:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:35:39.932898 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39621def-295f-4b32-8d80-1e1a2f8ad488 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:39.964034 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:40.037757 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39621def-295f-4b32-8d80-1e1a2f8ad488 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:40.073280 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0c64d-0e44-43aa-9af8-a2e8f09aa577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:40.074461 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0c64d-0e44-43aa-9af8-a2e8f09aa577 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:40.074993 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0c64d-0e44-43aa-9af8-a2e8f09aa577 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:40.075465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0c64d-0e44-43aa-9af8-a2e8f09aa577 None admin] PATH_INFO: `/v3/projects/f050448816e04bc3ace6d56d9ec83679` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:40.077073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0c64d-0e44-43aa-9af8-a2e8f09aa577 None admin] RBAC: Authorizing `identity:get_project(project_id=f050448816e04bc3ace6d56d9ec83679)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:40.078731 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0c64d-0e44-43aa-9af8-a2e8f09aa577 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:40.085230 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 153/317] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:39 2022] GET /identity/v3/projects/f050448816e04bc3ace6d56d9ec83679 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:40.088669 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940728ec-3aa8-4350-963b-351df886d7a6 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:40.200952 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940728ec-3aa8-4350-963b-351df886d7a6 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:40.203616 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:40.242129 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4dbe8-2b2c-4988-9d76-2e726cf295ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:40.243059 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4dbe8-2b2c-4988-9d76-2e726cf295ec None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:40.243542 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4dbe8-2b2c-4988-9d76-2e726cf295ec None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:40.244032 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4dbe8-2b2c-4988-9d76-2e726cf295ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:40.245032 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4dbe8-2b2c-4988-9d76-2e726cf295ec None admin] RBAC: Adding query filter params (role.id=86bedad6f8c84aefb5822c67df949d08, scope.project.id=f050448816e04bc3ace6d56d9ec83679, user.id=17e9ee8da9484c809a6a130036963127) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:40.245523 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4dbe8-2b2c-4988-9d76-2e726cf295ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:40.247222 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4dbe8-2b2c-4988-9d76-2e726cf295ec None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:40.254508 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 165/318] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:35:40 2022] GET /identity/v3/role_assignments?user.id=17e9ee8da9484c809a6a130036963127&scope.project.id=f050448816e04bc3ace6d56d9ec83679&role.id=86bedad6f8c84aefb5822c67df949d08 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:40.850292 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d4197-199d-4c88-ac4e-992ee3a05fb2 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:40.850692 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d4197-199d-4c88-ac4e-992ee3a05fb2 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:40.850960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d4197-199d-4c88-ac4e-992ee3a05fb2 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:40.852509 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 154/319] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:40.858037 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec06290-1505-4cb0-aca0-ff528f65e681 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:40.858485 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec06290-1505-4cb0-aca0-ff528f65e681 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:40.858573 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec06290-1505-4cb0-aca0-ff528f65e681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:40.875282 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-5ec06290-1505-4cb0-aca0-ff528f65e681 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:40.876479 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-5ec06290-1505-4cb0-aca0-ff528f65e681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:40.881735 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e7a39-f2e6-494f-bd7c-a67cb7034417 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:40.882024 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e7a39-f2e6-494f-bd7c-a67cb7034417 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:40.882306 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e7a39-f2e6-494f-bd7c-a67cb7034417 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:40.883799 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 155/320] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:35:40.888546 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c525d3-a053-4e23-a264-569916c9a695 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:40.888831 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c525d3-a053-4e23-a264-569916c9a695 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:40.889209 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c525d3-a053-4e23-a264-569916c9a695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:40.907005 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-85c525d3-a053-4e23-a264-569916c9a695 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:40.908209 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-85c525d3-a053-4e23-a264-569916c9a695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:40.947016 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 166/321] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:40.969083 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec06290-1505-4cb0-aca0-ff528f65e681 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:40.978909 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 156/322] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:35:41.002572 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c525d3-a053-4e23-a264-569916c9a695 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:41.027848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:41.068449 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:41.074829 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec06290-1505-4cb0-aca0-ff528f65e681 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:41.108408 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c525d3-a053-4e23-a264-569916c9a695 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:41.112966 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a231123-1797-4482-9a78-975b601587e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:41.113763 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a231123-1797-4482-9a78-975b601587e8 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:41.114045 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a231123-1797-4482-9a78-975b601587e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:41.114319 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a231123-1797-4482-9a78-975b601587e8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:41.126315 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a231123-1797-4482-9a78-975b601587e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:41.134152 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-4a231123-1797-4482-9a78-975b601587e8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:35:41.134152 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:41.134152 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:41.134152 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:41.134152 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:41.134152 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:41.134152 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:41.134152 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:41.134152 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:41.134152 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:41.134152 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:41.134152 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:41.134152 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:41.134152 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:41.134152 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:41.134152 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:41.135019 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:41.135019 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:41.135019 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:41.135019 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:41.135019 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:41.135019 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:41.135019 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:41.135019 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:41.135019 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:41.135019 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:41.135019 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:41.135019 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:35:41.135019 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:41.135019 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:41.135019 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:41.135019 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:41.135840 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:41.135840 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:41.135840 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:41.135840 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:41.135840 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:41.135840 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:41.135840 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:41.135840 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:41.135840 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:41.135840 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:41.135840 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:35:41.135840 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:35:41.135840 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 167/323] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:41.141811 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a231123-1797-4482-9a78-975b601587e8 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:41.148017 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0d59d-3257-4faf-bb1d-b8164140db20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:41.148817 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0d59d-3257-4faf-bb1d-b8164140db20 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:41.149093 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0d59d-3257-4faf-bb1d-b8164140db20 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:41.149364 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0d59d-3257-4faf-bb1d-b8164140db20 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:41.150563 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0d59d-3257-4faf-bb1d-b8164140db20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:41.158559 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0d59d-3257-4faf-bb1d-b8164140db20 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:41.158559 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 157/324] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:35:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:35:41.159414 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0d59d-3257-4faf-bb1d-b8164140db20 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:41.257294 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a231123-1797-4482-9a78-975b601587e8 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:41.262695 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:41.273212 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0d59d-3257-4faf-bb1d-b8164140db20 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:41.293258 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04e5f9-1d7a-4d24-941e-85ccfbda4617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:41.294213 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04e5f9-1d7a-4d24-941e-85ccfbda4617 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:41.294644 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04e5f9-1d7a-4d24-941e-85ccfbda4617 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:41.295634 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04e5f9-1d7a-4d24-941e-85ccfbda4617 None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:41.296706 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04e5f9-1d7a-4d24-941e-85ccfbda4617 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:41.297158 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04e5f9-1d7a-4d24-941e-85ccfbda4617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:41.298748 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04e5f9-1d7a-4d24-941e-85ccfbda4617 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:41.308567 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 168/325] 10.222.0.39 () {56 vars in 1101 bytes} [Mon May 23 15:35:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:41.309432 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31932622-a25b-4ef8-90db-37d46885939b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:41.310097 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31932622-a25b-4ef8-90db-37d46885939b None admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:41.310524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31932622-a25b-4ef8-90db-37d46885939b None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:41.310846 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31932622-a25b-4ef8-90db-37d46885939b None admin] PATH_INFO: `/v3/groups` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:41.311527 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31932622-a25b-4ef8-90db-37d46885939b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:41.313117 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31932622-a25b-4ef8-90db-37d46885939b None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:41.314032 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04e5f9-1d7a-4d24-941e-85ccfbda4617 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:41.335225 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:41.401947 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 158/326] 10.222.0.39 () {60 vars in 1134 bytes} [Mon May 23 15:35:41 2022] POST /identity/v3/groups => generated 226 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:35:41.418444 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04e5f9-1d7a-4d24-941e-85ccfbda4617 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:41.462827 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1613d-83bb-4229-a1c7-e24eb1a87fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:41.463814 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1613d-83bb-4229-a1c7-e24eb1a87fdc None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:41.464099 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1613d-83bb-4229-a1c7-e24eb1a87fdc None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:41.464423 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1613d-83bb-4229-a1c7-e24eb1a87fdc None admin] PATH_INFO: `/v3/users/52af383ae11242c8a2d49e7ed7dc417d` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:41.465820 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1613d-83bb-4229-a1c7-e24eb1a87fdc None admin] RBAC: Authorizing `identity:get_user(user_id=52af383ae11242c8a2d49e7ed7dc417d)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:41.468174 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1613d-83bb-4229-a1c7-e24eb1a87fdc None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:41.471079 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 169/327] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:35:41 2022] GET /identity/v3/users/52af383ae11242c8a2d49e7ed7dc417d => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:41.475805 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31932622-a25b-4ef8-90db-37d46885939b None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:41.589819 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31932622-a25b-4ef8-90db-37d46885939b None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:41.619982 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a24eed-d606-4002-b7ae-44b85bc22e94 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:41.620587 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a24eed-d606-4002-b7ae-44b85bc22e94 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:41.621076 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a24eed-d606-4002-b7ae-44b85bc22e94 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:41.622721 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 170/328] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:41.628108 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc3b9a-15d8-478e-b4ae-6dc048bb6b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:41.628270 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba85df-f302-4381-9933-a90014f14a61 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:41.628420 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba85df-f302-4381-9933-a90014f14a61 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:41.628699 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba85df-f302-4381-9933-a90014f14a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:41.628975 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc3b9a-15d8-478e-b4ae-6dc048bb6b63 None admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:41.629257 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc3b9a-15d8-478e-b4ae-6dc048bb6b63 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:41.629533 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc3b9a-15d8-478e-b4ae-6dc048bb6b63 None admin] PATH_INFO: `/v3/system/users/52af383ae11242c8a2d49e7ed7dc417d/roles/86bedad6f8c84aefb5822c67df949d08` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:41.631007 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc3b9a-15d8-478e-b4ae-6dc048bb6b63 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=52af383ae11242c8a2d49e7ed7dc417d, role_id=86bedad6f8c84aefb5822c67df949d08)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:41.632418 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc3b9a-15d8-478e-b4ae-6dc048bb6b63 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:41.647836 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-78ba85df-f302-4381-9933-a90014f14a61 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:41.649028 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-78ba85df-f302-4381-9933-a90014f14a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:41.694402 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 159/329] 10.222.0.39 () {58 vars in 1334 bytes} [Mon May 23 15:35:41 2022] PUT /identity/v3/system/users/52af383ae11242c8a2d49e7ed7dc417d/roles/86bedad6f8c84aefb5822c67df949d08 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:35:41.724298 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 171/330] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:35:41.749673 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc3b9a-15d8-478e-b4ae-6dc048bb6b63 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:41.772249 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:41.869892 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc3b9a-15d8-478e-b4ae-6dc048bb6b63 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:41.910297 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16f7f5-e731-4b20-a03c-56eeb07bfdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:41.911096 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16f7f5-e731-4b20-a03c-56eeb07bfdd1 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:41.911374 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16f7f5-e731-4b20-a03c-56eeb07bfdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:41.911664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16f7f5-e731-4b20-a03c-56eeb07bfdd1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:41.925626 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16f7f5-e731-4b20-a03c-56eeb07bfdd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:41.933625 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-fb16f7f5-e731-4b20-a03c-56eeb07bfdd1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:41.933625 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:41.933625 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:41.933625 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:41.933625 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:41.933625 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:41.933625 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:41.933625 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:41.933625 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:41.933625 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:41.933625 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:41.933625 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:41.933625 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:41.933625 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:41.933625 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:41.933625 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:41.934508 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:41.934508 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:41.934508 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:41.934508 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:41.934508 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:41.934508 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:41.934508 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:41.934508 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:41.934508 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:41.934508 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:41.934508 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:41.934508 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:35:41.934508 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:41.934508 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:41.934508 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:41.934508 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:41.935330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:41.935330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:41.935330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:41.935330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:41.935330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:41.935330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:41.935330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:41.935330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:41.935330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:41.935330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:41.935330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:41.935330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:35:41.936601 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 160/331] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:41.941172 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba85df-f302-4381-9933-a90014f14a61 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:41.964369 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:42.062910 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba85df-f302-4381-9933-a90014f14a61 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:42.107880 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f9703-6121-4dd4-b3a5-b4c0d10a7fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:42.108914 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f9703-6121-4dd4-b3a5-b4c0d10a7fa4 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:42.109201 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f9703-6121-4dd4-b3a5-b4c0d10a7fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:42.109475 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f9703-6121-4dd4-b3a5-b4c0d10a7fa4 None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:42.110239 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f9703-6121-4dd4-b3a5-b4c0d10a7fa4 None admin] RBAC: Adding query filter params (name=member) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:42.110547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f9703-6121-4dd4-b3a5-b4c0d10a7fa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:42.112243 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f9703-6121-4dd4-b3a5-b4c0d10a7fa4 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:42.124925 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 172/332] 10.222.0.39 () {56 vars in 1101 bytes} [Mon May 23 15:35:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:42.130557 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16f7f5-e731-4b20-a03c-56eeb07bfdd1 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:42.237563 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:42.263385 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16f7f5-e731-4b20-a03c-56eeb07bfdd1 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:42.302661 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d6686-3e2a-4775-9ec7-0f6d0fbebb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:42.303942 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d6686-3e2a-4775-9ec7-0f6d0fbebb73 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:42.304425 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d6686-3e2a-4775-9ec7-0f6d0fbebb73 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:42.304902 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d6686-3e2a-4775-9ec7-0f6d0fbebb73 None admin] PATH_INFO: `/v3/users/5753955d5d0c49fead7e92f7b6a90bcc` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:42.306321 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d6686-3e2a-4775-9ec7-0f6d0fbebb73 None admin] RBAC: Authorizing `identity:get_user(user_id=5753955d5d0c49fead7e92f7b6a90bcc)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:42.308116 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d6686-3e2a-4775-9ec7-0f6d0fbebb73 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:42.309985 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 161/333] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:35:42 2022] GET /identity/v3/users/5753955d5d0c49fead7e92f7b6a90bcc => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:42.316835 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f9703-6121-4dd4-b3a5-b4c0d10a7fa4 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:42.439985 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:42.457767 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f9703-6121-4dd4-b3a5-b4c0d10a7fa4 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:42.499175 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd3ab7-1977-4f28-bf5f-0e883e9807b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:42.499832 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd3ab7-1977-4f28-bf5f-0e883e9807b8 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:42.500210 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd3ab7-1977-4f28-bf5f-0e883e9807b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:42.500484 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd3ab7-1977-4f28-bf5f-0e883e9807b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:42.501316 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd3ab7-1977-4f28-bf5f-0e883e9807b8 None admin] RBAC: Adding query filter params (role.id=c41a7cd1c92b45a7bff9632d07b48006, user.id=5753955d5d0c49fead7e92f7b6a90bcc, scope.system=all) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:42.501628 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd3ab7-1977-4f28-bf5f-0e883e9807b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:42.503067 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd3ab7-1977-4f28-bf5f-0e883e9807b8 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:42.515501 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 173/334] 10.222.0.39 () {56 vars in 1308 bytes} [Mon May 23 15:35:42 2022] GET /identity/v3/role_assignments?user.id=5753955d5d0c49fead7e92f7b6a90bcc&scope.system=all&role.id=c41a7cd1c92b45a7bff9632d07b48006 => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:44.100858 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65527c1a-aba1-471f-a0d3-c4db552e47a0 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:44.101902 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65527c1a-aba1-471f-a0d3-c4db552e47a0 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:44.102383 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65527c1a-aba1-471f-a0d3-c4db552e47a0 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:44.104238 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 162/335] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:44.110161 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfee2ea-aead-4b92-b6d8-c4b3ba084fdb None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:44.111279 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfee2ea-aead-4b92-b6d8-c4b3ba084fdb None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:44.111787 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfee2ea-aead-4b92-b6d8-c4b3ba084fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:44.131389 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-dbfee2ea-aead-4b92-b6d8-c4b3ba084fdb None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:44.132929 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-dbfee2ea-aead-4b92-b6d8-c4b3ba084fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:44.220612 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 174/336] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:44.261217 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65527c1a-aba1-471f-a0d3-c4db552e47a0 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:44.401283 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65527c1a-aba1-471f-a0d3-c4db552e47a0 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:44.444884 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e4adc-b600-4846-9d8c-2533590b7fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:44.446005 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e4adc-b600-4846-9d8c-2533590b7fbb None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:44.446465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e4adc-b600-4846-9d8c-2533590b7fbb None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:44.446912 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e4adc-b600-4846-9d8c-2533590b7fbb None admin] PATH_INFO: `/v3/roles/member` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:44.463963 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e4adc-b600-4846-9d8c-2533590b7fbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:44.472407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-475e4adc-b600-4846-9d8c-2533590b7fbb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:44.472407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:44.472407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:44.472407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:44.472407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:44.472407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:44.472407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:44.472407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:44.472407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:44.472407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:44.472407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:44.472407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:44.472407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:44.472407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:44.472407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:44.472407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:44.473360 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:44.473360 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:44.473360 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:44.473360 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:44.473360 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:44.473360 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:44.473360 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:44.473360 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:44.473360 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:44.473360 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:44.473360 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:44.473360 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:35:44.473360 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:44.473360 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:44.473360 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:44.473360 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:44.474139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:44.474139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:44.474139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:44.474139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:44.474139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:44.474139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:44.474139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:44.474139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:44.474139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:44.474139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:44.474139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:44.474139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:35:44.476763 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 163/337] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:44.483457 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfee2ea-aead-4b92-b6d8-c4b3ba084fdb None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:44.593071 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:44.634895 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfee2ea-aead-4b92-b6d8-c4b3ba084fdb None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:44.678717 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef912299-3382-44a9-bce1-c557c8ce5f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:44.679638 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef912299-3382-44a9-bce1-c557c8ce5f53 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:44.680061 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef912299-3382-44a9-bce1-c557c8ce5f53 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:44.680495 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef912299-3382-44a9-bce1-c557c8ce5f53 None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:44.681384 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef912299-3382-44a9-bce1-c557c8ce5f53 None admin] RBAC: Adding query filter params (name=member) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:44.681844 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef912299-3382-44a9-bce1-c557c8ce5f53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:44.683376 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef912299-3382-44a9-bce1-c557c8ce5f53 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:44.697632 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 175/338] 10.222.0.39 () {56 vars in 1101 bytes} [Mon May 23 15:35:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:44.699221 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e4adc-b600-4846-9d8c-2533590b7fbb None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:44.712003 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:44.773301 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b259ef3-9146-40f9-bdd5-4fdb1acfd478 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:44.774342 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b259ef3-9146-40f9-bdd5-4fdb1acfd478 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:44.774832 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b259ef3-9146-40f9-bdd5-4fdb1acfd478 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:44.777059 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 176/339] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:35:44.784236 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5253b-1be1-4602-94e2-593b1f2dfdbb None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:44.784759 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5253b-1be1-4602-94e2-593b1f2dfdbb None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:44.785217 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5253b-1be1-4602-94e2-593b1f2dfdbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:44.813669 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-25d5253b-1be1-4602-94e2-593b1f2dfdbb None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:44.815198 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-25d5253b-1be1-4602-94e2-593b1f2dfdbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:44.899501 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e4adc-b600-4846-9d8c-2533590b7fbb None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:44.904099 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 177/340] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:35:44.932192 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5253b-1be1-4602-94e2-593b1f2dfdbb None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:44.967949 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b505e-52ca-4df9-afd7-5cedc62a4ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:44.968607 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b505e-52ca-4df9-afd7-5cedc62a4ac3 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:44.968889 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b505e-52ca-4df9-afd7-5cedc62a4ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:44.969162 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b505e-52ca-4df9-afd7-5cedc62a4ac3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:45.000480 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:45.046009 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5253b-1be1-4602-94e2-593b1f2dfdbb None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:45.082377 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260f3c7-45df-4640-a4f4-346338f619c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:45.083523 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260f3c7-45df-4640-a4f4-346338f619c7 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:45.084427 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260f3c7-45df-4640-a4f4-346338f619c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:45.084889 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260f3c7-45df-4640-a4f4-346338f619c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:45.097096 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260f3c7-45df-4640-a4f4-346338f619c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:45.105838 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-4260f3c7-45df-4640-a4f4-346338f619c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:35:45.105838 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:45.105838 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:45.105838 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:45.105838 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:45.105838 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:45.105838 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:45.105838 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:45.105838 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:45.105838 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:45.105838 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:45.105838 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:45.105838 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:45.105838 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:45.105838 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:45.105838 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:45.106752 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:45.106752 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:45.106752 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:45.106752 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:45.106752 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:45.106752 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:45.106752 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:45.106752 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:45.106752 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:45.106752 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:45.106752 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:45.106752 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:35:45.106752 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:45.106752 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:45.106752 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:45.106752 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:45.108878 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:45.108878 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:45.108878 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:45.108878 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:45.108878 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:45.108878 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:45.108878 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:45.108878 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:45.108878 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:45.108878 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:45.108878 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:35:45.108878 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:35:45.115764 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 178/341] 10.222.0.39 () {56 vars in 1114 bytes} [Mon May 23 15:35:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:35:45.117876 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260f3c7-45df-4640-a4f4-346338f619c7 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:45.132742 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b505e-52ca-4df9-afd7-5cedc62a4ac3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:45.134253 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b505e-52ca-4df9-afd7-5cedc62a4ac3 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:45.140734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:45.229059 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260f3c7-45df-4640-a4f4-346338f619c7 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:45.268726 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e4104-b261-419f-8b53-2c6c9a6ac82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:45.269740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e4104-b261-419f-8b53-2c6c9a6ac82b None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:45.270169 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e4104-b261-419f-8b53-2c6c9a6ac82b None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:45.270612 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e4104-b261-419f-8b53-2c6c9a6ac82b None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:45.271510 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e4104-b261-419f-8b53-2c6c9a6ac82b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:45.272230 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e4104-b261-419f-8b53-2c6c9a6ac82b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:45.273862 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e4104-b261-419f-8b53-2c6c9a6ac82b None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:45.283746 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 179/342] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:35:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:45.283926 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:45.285457 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1a637-d574-42a8-b08a-8834f7f25202 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:45.285938 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1a637-d574-42a8-b08a-8834f7f25202 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:45.286361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1a637-d574-42a8-b08a-8834f7f25202 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:45.291873 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 180/344] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:45.292319 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 164/344] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:35:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:35:45.293305 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1a637-d574-42a8-b08a-8834f7f25202 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:45.295004 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b505e-52ca-4df9-afd7-5cedc62a4ac3 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:45.415123 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1a637-d574-42a8-b08a-8834f7f25202 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:45.428012 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b505e-52ca-4df9-afd7-5cedc62a4ac3 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:45.430391 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:45.456654 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67604b42-eeb0-4cde-b73c-ba221a5981c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:45.457672 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67604b42-eeb0-4cde-b73c-ba221a5981c6 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:45.458185 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67604b42-eeb0-4cde-b73c-ba221a5981c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:45.458663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67604b42-eeb0-4cde-b73c-ba221a5981c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:45.514368 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3c495-fef9-4ff7-8da5-7fcb8dc08c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:45.515291 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3c495-fef9-4ff7-8da5-7fcb8dc08c0f None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:45.515846 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3c495-fef9-4ff7-8da5-7fcb8dc08c0f None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:45.516264 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3c495-fef9-4ff7-8da5-7fcb8dc08c0f None admin] PATH_INFO: `/v3/projects/88c9c3d6e1924302b76cfeeb40525435` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:45.517760 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e3c495-fef9-4ff7-8da5-7fcb8dc08c0f None admin] RBAC: Authorizing `identity:get_project(project_id=88c9c3d6e1924302b76cfeeb40525435)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:45.523629 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e3c495-fef9-4ff7-8da5-7fcb8dc08c0f None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:45.523831 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:45.526177 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 165/345] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:45 2022] GET /identity/v3/projects/88c9c3d6e1924302b76cfeeb40525435 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:35:45.535625 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a9703-caa9-401a-b4e5-c4a70722775c None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:45.536374 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a9703-caa9-401a-b4e5-c4a70722775c None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:45.536809 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a9703-caa9-401a-b4e5-c4a70722775c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:45.540461 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67604b42-eeb0-4cde-b73c-ba221a5981c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:45.542039 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67604b42-eeb0-4cde-b73c-ba221a5981c6 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:45.566156 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-f24a9703-caa9-401a-b4e5-c4a70722775c None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:45.567576 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-f24a9703-caa9-401a-b4e5-c4a70722775c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:45.656069 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 181/346] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:35:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:35:45.657035 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67604b42-eeb0-4cde-b73c-ba221a5981c6 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:45.711449 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 166/347] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:45.713268 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc9cf4-871e-4fa6-b54d-d17ad01de63c None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:45.713787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc9cf4-871e-4fa6-b54d-d17ad01de63c None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:45.714265 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc9cf4-871e-4fa6-b54d-d17ad01de63c None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:45.716084 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 167/348] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:45.717172 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc9cf4-871e-4fa6-b54d-d17ad01de63c None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:45.758018 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:45.790877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67604b42-eeb0-4cde-b73c-ba221a5981c6 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:45.829337 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea34fa0-1117-4e4b-80c3-69ab6f6bc6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:45.829847 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea34fa0-1117-4e4b-80c3-69ab6f6bc6bc None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:45.830130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea34fa0-1117-4e4b-80c3-69ab6f6bc6bc None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:45.830409 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea34fa0-1117-4e4b-80c3-69ab6f6bc6bc None admin] PATH_INFO: `/v3/groups/62b62d14c1654605893e0bd878fe71e0` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:45.837084 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea34fa0-1117-4e4b-80c3-69ab6f6bc6bc None admin] RBAC: Authorizing `identity:get_group(group_id=62b62d14c1654605893e0bd878fe71e0)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:45.838782 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea34fa0-1117-4e4b-80c3-69ab6f6bc6bc None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:45.842723 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 182/349] 10.222.0.39 () {56 vars in 1180 bytes} [Mon May 23 15:35:45 2022] GET /identity/v3/groups/62b62d14c1654605893e0bd878fe71e0 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:45.844263 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a87d4c-f6c2-4b12-9838-45711e898a51 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:45.844681 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a87d4c-f6c2-4b12-9838-45711e898a51 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:45.845088 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a87d4c-f6c2-4b12-9838-45711e898a51 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:45.846497 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 183/350] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:45.847759 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6426072-593a-4d51-9b16-05631ae4f1ce None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:45.848240 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6426072-593a-4d51-9b16-05631ae4f1ce None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:45.848650 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6426072-593a-4d51-9b16-05631ae4f1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:45.853610 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc9cf4-871e-4fa6-b54d-d17ad01de63c None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:45.856292 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:45.868456 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-f6426072-593a-4d51-9b16-05631ae4f1ce None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:45.869627 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-f6426072-593a-4d51-9b16-05631ae4f1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:45.901888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0699e-370d-4c34-af8f-b9d19026241c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:45.902760 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0699e-370d-4c34-af8f-b9d19026241c None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:45.903045 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0699e-370d-4c34-af8f-b9d19026241c None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:45.903320 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0699e-370d-4c34-af8f-b9d19026241c None admin] PATH_INFO: `/v3/projects/88c9c3d6e1924302b76cfeeb40525435` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:45.905616 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb0699e-370d-4c34-af8f-b9d19026241c None admin] RBAC: Authorizing `identity:get_project(project_id=88c9c3d6e1924302b76cfeeb40525435)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:45.907810 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb0699e-370d-4c34-af8f-b9d19026241c None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:45.910962 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 168/351] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:45 2022] GET /identity/v3/projects/88c9c3d6e1924302b76cfeeb40525435 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:45.912519 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0699e-370d-4c34-af8f-b9d19026241c None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:45.956475 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 184/352] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:45.958094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d461f4-a509-430b-91cb-2d3c34be9e2b None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:45.958616 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d461f4-a509-430b-91cb-2d3c34be9e2b None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:45.959067 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d461f4-a509-430b-91cb-2d3c34be9e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:45.978421 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-a6d461f4-a509-430b-91cb-2d3c34be9e2b None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:45.979941 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-a6d461f4-a509-430b-91cb-2d3c34be9e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:46.059580 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 185/353] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:46.061425 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d461f4-a509-430b-91cb-2d3c34be9e2b None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:46.064677 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:46.078186 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0699e-370d-4c34-af8f-b9d19026241c None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:46.119540 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5292f50-5b68-472a-95da-f2ddba940fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:46.120609 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5292f50-5b68-472a-95da-f2ddba940fcf None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:46.121065 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5292f50-5b68-472a-95da-f2ddba940fcf None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:46.121486 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5292f50-5b68-472a-95da-f2ddba940fcf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:46.134088 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5292f50-5b68-472a-95da-f2ddba940fcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:46.143590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-b5292f50-5b68-472a-95da-f2ddba940fcf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:35:46.143590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:46.143590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:46.143590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:46.143590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:46.143590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:46.143590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:46.143590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:46.143590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:46.143590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:46.143590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:46.143590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:46.143590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:46.143590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:46.143590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:46.143590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:46.144545 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:46.144545 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:46.144545 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:46.144545 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:46.144545 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:46.144545 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:46.144545 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:46.144545 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:46.144545 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:46.144545 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:46.144545 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:46.144545 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:35:46.144545 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:46.144545 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:46.144545 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:46.144545 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:46.145354 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:46.145354 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:46.145354 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:46.145354 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:46.145354 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:46.145354 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:46.145354 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:46.145354 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:46.145354 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:46.145354 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:46.145354 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:35:46.145354 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:35:46.147254 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 169/354] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:46.149414 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5292f50-5b68-472a-95da-f2ddba940fcf None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:46.180789 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d461f4-a509-430b-91cb-2d3c34be9e2b None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:46.191640 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:46.228505 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98191b50-fde1-4309-8776-46762761bfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:46.229207 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98191b50-fde1-4309-8776-46762761bfaa None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:46.229493 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98191b50-fde1-4309-8776-46762761bfaa None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:46.229776 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98191b50-fde1-4309-8776-46762761bfaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:46.230616 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98191b50-fde1-4309-8776-46762761bfaa None admin] RBAC: Adding query filter params (group.id=62b62d14c1654605893e0bd878fe71e0, role.id=c41a7cd1c92b45a7bff9632d07b48006, scope.project.id=88c9c3d6e1924302b76cfeeb40525435) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:46.230936 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98191b50-fde1-4309-8776-46762761bfaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:46.232478 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98191b50-fde1-4309-8776-46762761bfaa None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:46.239217 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 186/355] 10.222.0.39 () {56 vars in 1376 bytes} [Mon May 23 15:35:46 2022] GET /identity/v3/role_assignments?group.id=62b62d14c1654605893e0bd878fe71e0&scope.project.id=88c9c3d6e1924302b76cfeeb40525435&role.id=c41a7cd1c92b45a7bff9632d07b48006 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:46.240628 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98191b50-fde1-4309-8776-46762761bfaa None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:46.299407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5292f50-5b68-472a-95da-f2ddba940fcf None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:46.338274 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:46.350097 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a382b-bdc9-464d-9c08-6ec5c9be6476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:46.350962 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a382b-bdc9-464d-9c08-6ec5c9be6476 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:46.351241 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a382b-bdc9-464d-9c08-6ec5c9be6476 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:46.351511 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a382b-bdc9-464d-9c08-6ec5c9be6476 None admin] PATH_INFO: `/v3/groups/62b62d14c1654605893e0bd878fe71e0` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:46.353158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a382b-bdc9-464d-9c08-6ec5c9be6476 None admin] RBAC: Authorizing `identity:get_group(group_id=62b62d14c1654605893e0bd878fe71e0)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:46.354793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a382b-bdc9-464d-9c08-6ec5c9be6476 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:46.356425 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 170/356] 10.222.0.39 () {56 vars in 1180 bytes} [Mon May 23 15:35:46 2022] GET /identity/v3/groups/62b62d14c1654605893e0bd878fe71e0 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:46.357196 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a382b-bdc9-464d-9c08-6ec5c9be6476 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:46.386588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98191b50-fde1-4309-8776-46762761bfaa None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:46.437986 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ca175-3693-4c5a-b409-f1fe90153869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:46.440522 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ca175-3693-4c5a-b409-f1fe90153869 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:46.441059 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ca175-3693-4c5a-b409-f1fe90153869 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:46.441537 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ca175-3693-4c5a-b409-f1fe90153869 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:46.455311 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ca175-3693-4c5a-b409-f1fe90153869 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:46.464830 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-aa1ca175-3693-4c5a-b409-f1fe90153869 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:35:46.464830 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:46.464830 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:46.464830 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:46.464830 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:46.464830 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:46.464830 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:46.464830 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:46.464830 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:46.464830 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:46.464830 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:46.464830 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:46.464830 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:46.464830 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:46.464830 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:46.464830 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:46.465758 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:46.465758 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:46.465758 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:46.465758 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:46.465758 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:46.465758 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:46.465758 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:46.465758 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:46.465758 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:46.465758 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:46.465758 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:46.465758 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:35:46.465758 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:46.465758 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:46.465758 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:46.465758 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:46.466588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:46.466588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:46.466588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:46.466588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:46.466588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:46.466588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:46.466588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:46.466588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:46.466588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:46.466588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:46.466588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:35:46.466588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:35:46.467983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:46.470183 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 187/357] 10.222.0.39 () {56 vars in 1114 bytes} [Mon May 23 15:35:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:46.470775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a382b-bdc9-464d-9c08-6ec5c9be6476 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:46.471843 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ca175-3693-4c5a-b409-f1fe90153869 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:46.511711 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a829f5b-0943-4697-b567-4fdf68e84209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:46.512535 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a829f5b-0943-4697-b567-4fdf68e84209 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:46.512815 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a829f5b-0943-4697-b567-4fdf68e84209 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:46.513093 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a829f5b-0943-4697-b567-4fdf68e84209 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:46.526752 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a829f5b-0943-4697-b567-4fdf68e84209 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:46.534976 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-0a829f5b-0943-4697-b567-4fdf68e84209 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:46.534976 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:46.534976 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:46.534976 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:46.534976 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:46.534976 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:46.534976 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:46.534976 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:46.534976 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:46.534976 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:46.534976 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:46.534976 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:46.534976 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:46.534976 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:46.534976 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:46.534976 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:46.535964 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:46.535964 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:46.535964 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:46.535964 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:46.535964 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:46.535964 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:46.535964 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:46.535964 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:46.535964 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:46.535964 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:46.535964 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:46.535964 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:35:46.535964 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:46.535964 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:46.535964 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:46.535964 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:46.536838 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:46.536838 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:46.536838 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:46.536838 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:46.536838 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:46.536838 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:46.536838 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:46.536838 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:46.536838 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:46.536838 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:46.536838 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:46.536838 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:35:46.538093 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 171/358] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:46.538093 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a829f5b-0943-4697-b567-4fdf68e84209 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:46.602631 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ca175-3693-4c5a-b409-f1fe90153869 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:46.644608 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:46.645292 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a829f5b-0943-4697-b567-4fdf68e84209 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:46.650111 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdb142-9459-4ec7-bb1d-c161de28102b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:46.654816 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdb142-9459-4ec7-bb1d-c161de28102b None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:46.654816 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdb142-9459-4ec7-bb1d-c161de28102b None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:46.654816 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdb142-9459-4ec7-bb1d-c161de28102b None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:46.654816 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cdb142-9459-4ec7-bb1d-c161de28102b None admin] RBAC: Adding query filter params (name=reader) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:46.654816 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cdb142-9459-4ec7-bb1d-c161de28102b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:46.654816 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cdb142-9459-4ec7-bb1d-c161de28102b None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:46.665541 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 188/359] 10.222.0.39 () {56 vars in 1101 bytes} [Mon May 23 15:35:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:46.667048 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdb142-9459-4ec7-bb1d-c161de28102b None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:46.682524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cfb3a-ba07-4d02-93f3-df6b60f443b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:46.683189 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cfb3a-ba07-4d02-93f3-df6b60f443b2 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:46.683472 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cfb3a-ba07-4d02-93f3-df6b60f443b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:46.683796 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cfb3a-ba07-4d02-93f3-df6b60f443b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:46.684631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cfb3a-ba07-4d02-93f3-df6b60f443b2 None admin] RBAC: Adding query filter params (group.id=62b62d14c1654605893e0bd878fe71e0, role.id=a487e8d6e71d4a399b050274528d8db7, scope.project.id=88c9c3d6e1924302b76cfeeb40525435) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:46.684943 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cfb3a-ba07-4d02-93f3-df6b60f443b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:46.686777 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cfb3a-ba07-4d02-93f3-df6b60f443b2 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:46.692634 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 172/360] 10.222.0.39 () {56 vars in 1376 bytes} [Mon May 23 15:35:46 2022] GET /identity/v3/role_assignments?group.id=62b62d14c1654605893e0bd878fe71e0&scope.project.id=88c9c3d6e1924302b76cfeeb40525435&role.id=a487e8d6e71d4a399b050274528d8db7 => generated 260 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:46.693433 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cfb3a-ba07-4d02-93f3-df6b60f443b2 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:46.722703 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:46.809585 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cfb3a-ba07-4d02-93f3-df6b60f443b2 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:46.869527 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898721f-db7c-4678-ad9a-3166eb1919c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:46.869736 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdb142-9459-4ec7-bb1d-c161de28102b None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:46.870138 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898721f-db7c-4678-ad9a-3166eb1919c5 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:46.870423 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898721f-db7c-4678-ad9a-3166eb1919c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:46.870697 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898721f-db7c-4678-ad9a-3166eb1919c5 None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:46.871468 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898721f-db7c-4678-ad9a-3166eb1919c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:46.872277 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898721f-db7c-4678-ad9a-3166eb1919c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:46.874316 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898721f-db7c-4678-ad9a-3166eb1919c5 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:46.892872 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 173/361] 10.222.0.39 () {56 vars in 1101 bytes} [Mon May 23 15:35:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:46.893851 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898721f-db7c-4678-ad9a-3166eb1919c5 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:46.912610 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f49eb-4e89-49d4-89d8-c3cc0f3a2b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:46.913298 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f49eb-4e89-49d4-89d8-c3cc0f3a2b0a None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:46.913577 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f49eb-4e89-49d4-89d8-c3cc0f3a2b0a None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:46.913848 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f49eb-4e89-49d4-89d8-c3cc0f3a2b0a None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:46.914605 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f49eb-4e89-49d4-89d8-c3cc0f3a2b0a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:46.914915 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f49eb-4e89-49d4-89d8-c3cc0f3a2b0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:46.916336 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f49eb-4e89-49d4-89d8-c3cc0f3a2b0a None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:46.926851 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 189/362] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:35:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:46.928283 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8ac4e-ed6d-405f-b89b-986c6c94c32d None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:46.928573 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8ac4e-ed6d-405f-b89b-986c6c94c32d None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:46.928856 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8ac4e-ed6d-405f-b89b-986c6c94c32d None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:46.934309 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 190/363] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:46.934309 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8ac4e-ed6d-405f-b89b-986c6c94c32d None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:47.006068 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:47.018504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:47.042111 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898721f-db7c-4678-ad9a-3166eb1919c5 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:47.084857 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8ac4e-ed6d-405f-b89b-986c6c94c32d None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:47.086395 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693524b-dddb-43bf-b31f-d60fad5a5c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:47.087506 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693524b-dddb-43bf-b31f-d60fad5a5c2f None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:47.088021 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693524b-dddb-43bf-b31f-d60fad5a5c2f None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:47.088497 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693524b-dddb-43bf-b31f-d60fad5a5c2f None admin] PATH_INFO: `/v3/users/52af383ae11242c8a2d49e7ed7dc417d` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:47.092350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693524b-dddb-43bf-b31f-d60fad5a5c2f None admin] RBAC: Authorizing `identity:get_user(user_id=52af383ae11242c8a2d49e7ed7dc417d)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:47.094143 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693524b-dddb-43bf-b31f-d60fad5a5c2f None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:47.099726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 174/364] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:35:46 2022] GET /identity/v3/users/52af383ae11242c8a2d49e7ed7dc417d => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:47.100869 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693524b-dddb-43bf-b31f-d60fad5a5c2f None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:47.126761 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e6fd0-adec-41b0-b35d-27a7a542df40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:47.127333 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e6fd0-adec-41b0-b35d-27a7a542df40 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:47.127634 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e6fd0-adec-41b0-b35d-27a7a542df40 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:47.127938 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e6fd0-adec-41b0-b35d-27a7a542df40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:47.220723 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e6fd0-adec-41b0-b35d-27a7a542df40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:47.222446 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e6fd0-adec-41b0-b35d-27a7a542df40 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:47.229626 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693524b-dddb-43bf-b31f-d60fad5a5c2f None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:47.280982 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ff3f4-ee28-486a-b352-8f624d6a9025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:47.281635 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ff3f4-ee28-486a-b352-8f624d6a9025 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:47.281923 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ff3f4-ee28-486a-b352-8f624d6a9025 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:47.282195 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ff3f4-ee28-486a-b352-8f624d6a9025 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:47.306000 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:47.313524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:47.364828 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ff3f4-ee28-486a-b352-8f624d6a9025 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:47.366427 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ff3f4-ee28-486a-b352-8f624d6a9025 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:47.370492 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 191/365] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:35:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:35:47.371830 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39170114-b496-45c1-bcc0-2fd80552a461 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:47.372122 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39170114-b496-45c1-bcc0-2fd80552a461 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:47.372423 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39170114-b496-45c1-bcc0-2fd80552a461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:47.392247 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-39170114-b496-45c1-bcc0-2fd80552a461 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:47.392714 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-39170114-b496-45c1-bcc0-2fd80552a461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:47.478998 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 192/366] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:47.479900 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39170114-b496-45c1-bcc0-2fd80552a461 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:47.493372 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 175/367] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:35:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:35:47.494483 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ff3f4-ee28-486a-b352-8f624d6a9025 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:47.564882 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:47.596171 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:47.621266 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39170114-b496-45c1-bcc0-2fd80552a461 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:47.654623 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ff3f4-ee28-486a-b352-8f624d6a9025 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:47.674166 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d83ef1-6cc0-44b9-a3ed-0b6fcac55588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:47.674840 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d83ef1-6cc0-44b9-a3ed-0b6fcac55588 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:47.675126 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d83ef1-6cc0-44b9-a3ed-0b6fcac55588 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:47.675406 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d83ef1-6cc0-44b9-a3ed-0b6fcac55588 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:47.676711 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d83ef1-6cc0-44b9-a3ed-0b6fcac55588 None admin] RBAC: Adding query filter params (role.id=86bedad6f8c84aefb5822c67df949d08, user.id=52af383ae11242c8a2d49e7ed7dc417d, scope.system=all) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:47.677040 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d83ef1-6cc0-44b9-a3ed-0b6fcac55588 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:47.678780 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d83ef1-6cc0-44b9-a3ed-0b6fcac55588 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:47.696801 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 193/368] 10.222.0.39 () {56 vars in 1308 bytes} [Mon May 23 15:35:47 2022] GET /identity/v3/role_assignments?user.id=52af383ae11242c8a2d49e7ed7dc417d&scope.system=all&role.id=86bedad6f8c84aefb5822c67df949d08 => generated 510 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:47.697673 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d83ef1-6cc0-44b9-a3ed-0b6fcac55588 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:47.703725 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d97a8-8f11-4bd4-8fd7-0ac662f4883c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:47.704993 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d97a8-8f11-4bd4-8fd7-0ac662f4883c None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:47.705503 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d97a8-8f11-4bd4-8fd7-0ac662f4883c None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:47.706020 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d97a8-8f11-4bd4-8fd7-0ac662f4883c None admin] PATH_INFO: `/v3/projects/f050448816e04bc3ace6d56d9ec83679` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:47.707727 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d97a8-8f11-4bd4-8fd7-0ac662f4883c None admin] RBAC: Authorizing `identity:get_project(project_id=f050448816e04bc3ace6d56d9ec83679)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:47.709553 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d97a8-8f11-4bd4-8fd7-0ac662f4883c None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:47.712603 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 176/369] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:47 2022] GET /identity/v3/projects/f050448816e04bc3ace6d56d9ec83679 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:47.713722 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d97a8-8f11-4bd4-8fd7-0ac662f4883c None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:47.840580 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d83ef1-6cc0-44b9-a3ed-0b6fcac55588 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:47.887040 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676bfe5-298c-4827-bf33-db54cdbb9185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:47.888522 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676bfe5-298c-4827-bf33-db54cdbb9185 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:47.888935 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676bfe5-298c-4827-bf33-db54cdbb9185 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:47.889218 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676bfe5-298c-4827-bf33-db54cdbb9185 None admin] PATH_INFO: `/v3/projects/f050448816e04bc3ace6d56d9ec83679` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:47.891377 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676bfe5-298c-4827-bf33-db54cdbb9185 None admin] RBAC: Authorizing `identity:get_project(project_id=f050448816e04bc3ace6d56d9ec83679)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:47.893049 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676bfe5-298c-4827-bf33-db54cdbb9185 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:47.895497 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 194/370] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:47 2022] GET /identity/v3/projects/f050448816e04bc3ace6d56d9ec83679 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:47.896840 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676bfe5-298c-4827-bf33-db54cdbb9185 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:47.911583 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:47.943073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d97a8-8f11-4bd4-8fd7-0ac662f4883c None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:47.975963 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:47.992943 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921b345-7fa9-46d7-b5a7-c3ec8a6378c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:47.993752 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921b345-7fa9-46d7-b5a7-c3ec8a6378c7 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:47.994039 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921b345-7fa9-46d7-b5a7-c3ec8a6378c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:47.994315 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921b345-7fa9-46d7-b5a7-c3ec8a6378c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:48.008085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f921b345-7fa9-46d7-b5a7-c3ec8a6378c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:48.019128 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-f921b345-7fa9-46d7-b5a7-c3ec8a6378c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:35:48.019128 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:48.019128 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:48.019128 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:48.019128 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:48.019128 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:48.019128 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:48.019128 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:48.019128 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:48.019128 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:48.019128 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:48.019128 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:48.019128 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:48.019128 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:48.019128 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:48.019128 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:48.020184 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:48.020184 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:48.020184 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:48.020184 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:48.020184 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:48.020184 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:48.020184 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:48.020184 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:48.020184 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:48.020184 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:48.020184 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:48.020184 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:35:48.020184 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:48.020184 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:48.020184 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:48.020184 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:48.021030 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:48.021030 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:48.021030 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:48.021030 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:48.021030 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:48.021030 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:48.021030 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:48.021030 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:48.021030 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:48.021030 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:48.021030 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:35:48.021030 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:35:48.021030 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 177/371] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:35:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:48.021799 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921b345-7fa9-46d7-b5a7-c3ec8a6378c7 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:48.038123 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676bfe5-298c-4827-bf33-db54cdbb9185 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:48.087666 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0dcd63-cb3c-4082-9e97-75ae7c41b961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:48.088539 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dcd63-cb3c-4082-9e97-75ae7c41b961 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:48.088820 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dcd63-cb3c-4082-9e97-75ae7c41b961 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:48.089394 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dcd63-cb3c-4082-9e97-75ae7c41b961 None admin] PATH_INFO: `/v3/groups/62b62d14c1654605893e0bd878fe71e0` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:48.092578 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0dcd63-cb3c-4082-9e97-75ae7c41b961 None admin] RBAC: Authorizing `identity:get_group(group_id=62b62d14c1654605893e0bd878fe71e0)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:48.094058 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0dcd63-cb3c-4082-9e97-75ae7c41b961 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:48.097362 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 195/372] 10.222.0.39 () {56 vars in 1180 bytes} [Mon May 23 15:35:47 2022] GET /identity/v3/groups/62b62d14c1654605893e0bd878fe71e0 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:48.101384 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0dcd63-cb3c-4082-9e97-75ae7c41b961 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:48.165346 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921b345-7fa9-46d7-b5a7-c3ec8a6378c7 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:48.206213 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:48.207317 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9863191-7e8e-4434-bf38-7a7f47552332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:48.208507 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9863191-7e8e-4434-bf38-7a7f47552332 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:48.208790 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9863191-7e8e-4434-bf38-7a7f47552332 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:48.209068 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9863191-7e8e-4434-bf38-7a7f47552332 None admin] PATH_INFO: `/v3/groups/62b62d14c1654605893e0bd878fe71e0` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:48.210300 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9863191-7e8e-4434-bf38-7a7f47552332 None admin] RBAC: Authorizing `identity:get_group(group_id=62b62d14c1654605893e0bd878fe71e0)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:48.212867 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9863191-7e8e-4434-bf38-7a7f47552332 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:48.218699 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 178/373] 10.222.0.39 () {56 vars in 1180 bytes} [Mon May 23 15:35:48 2022] GET /identity/v3/groups/62b62d14c1654605893e0bd878fe71e0 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:48.219953 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9863191-7e8e-4434-bf38-7a7f47552332 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:48.243111 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0dcd63-cb3c-4082-9e97-75ae7c41b961 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:48.278952 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:48.292863 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412364b-a34c-4aa4-a25b-df535458b06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:48.294666 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412364b-a34c-4aa4-a25b-df535458b06c None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:48.294666 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412364b-a34c-4aa4-a25b-df535458b06c None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:48.294666 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412364b-a34c-4aa4-a25b-df535458b06c None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:48.295625 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c412364b-a34c-4aa4-a25b-df535458b06c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:48.296297 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c412364b-a34c-4aa4-a25b-df535458b06c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:48.297882 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c412364b-a34c-4aa4-a25b-df535458b06c None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:48.309481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 196/374] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:48.312706 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412364b-a34c-4aa4-a25b-df535458b06c None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:48.361104 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9863191-7e8e-4434-bf38-7a7f47552332 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:48.404566 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2622ddc-d69a-4dbb-b75a-2993dfd89e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:48.405259 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2622ddc-d69a-4dbb-b75a-2993dfd89e5f None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:48.405811 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2622ddc-d69a-4dbb-b75a-2993dfd89e5f None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:48.406386 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2622ddc-d69a-4dbb-b75a-2993dfd89e5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:48.407246 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2622ddc-d69a-4dbb-b75a-2993dfd89e5f None admin] RBAC: Adding query filter params (group.id=62b62d14c1654605893e0bd878fe71e0, role.id=c41a7cd1c92b45a7bff9632d07b48006, scope.project.id=f050448816e04bc3ace6d56d9ec83679) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:48.407646 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2622ddc-d69a-4dbb-b75a-2993dfd89e5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:48.409155 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2622ddc-d69a-4dbb-b75a-2993dfd89e5f None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:48.416999 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 179/375] 10.222.0.39 () {56 vars in 1376 bytes} [Mon May 23 15:35:48 2022] GET /identity/v3/role_assignments?group.id=62b62d14c1654605893e0bd878fe71e0&scope.project.id=f050448816e04bc3ace6d56d9ec83679&role.id=c41a7cd1c92b45a7bff9632d07b48006 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:48.417809 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2622ddc-d69a-4dbb-b75a-2993dfd89e5f None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:48.459794 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412364b-a34c-4aa4-a25b-df535458b06c None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:48.506925 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f5634-c5b1-4dca-9844-bc1a6a36e36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:48.507611 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f5634-c5b1-4dca-9844-bc1a6a36e36a None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:48.507898 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f5634-c5b1-4dca-9844-bc1a6a36e36a None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:48.508175 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f5634-c5b1-4dca-9844-bc1a6a36e36a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:48.509093 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f5634-c5b1-4dca-9844-bc1a6a36e36a None admin] RBAC: Adding query filter params (group.id=62b62d14c1654605893e0bd878fe71e0, role.id=a487e8d6e71d4a399b050274528d8db7, scope.project.id=f050448816e04bc3ace6d56d9ec83679) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:48.509405 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f5634-c5b1-4dca-9844-bc1a6a36e36a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:48.510944 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f5634-c5b1-4dca-9844-bc1a6a36e36a None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:48.519921 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 197/376] 10.222.0.39 () {56 vars in 1376 bytes} [Mon May 23 15:35:48 2022] GET /identity/v3/role_assignments?group.id=62b62d14c1654605893e0bd878fe71e0&scope.project.id=f050448816e04bc3ace6d56d9ec83679&role.id=a487e8d6e71d4a399b050274528d8db7 => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:48.554549 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2622ddc-d69a-4dbb-b75a-2993dfd89e5f None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:48.570357 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:48.600101 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf0683-1133-4bc0-a7cc-b2dc9c6c5601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:48.600801 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf0683-1133-4bc0-a7cc-b2dc9c6c5601 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:48.601086 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf0683-1133-4bc0-a7cc-b2dc9c6c5601 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:48.601362 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf0683-1133-4bc0-a7cc-b2dc9c6c5601 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:48.683713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf0683-1133-4bc0-a7cc-b2dc9c6c5601 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:48.685284 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf0683-1133-4bc0-a7cc-b2dc9c6c5601 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:48.805318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 180/377] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:35:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:35:48.810976 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f5634-c5b1-4dca-9844-bc1a6a36e36a None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:48.818121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:48.938019 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f5634-c5b1-4dca-9844-bc1a6a36e36a None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:48.979328 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc4ddd-a99d-4ac7-95f3-8e74054c027f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:48.980251 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc4ddd-a99d-4ac7-95f3-8e74054c027f None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:48.980535 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc4ddd-a99d-4ac7-95f3-8e74054c027f None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:48.980814 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc4ddd-a99d-4ac7-95f3-8e74054c027f None admin] PATH_INFO: `/v3/projects/c760023a56dc4c499f942685a1652dbf` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:48.982914 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc4ddd-a99d-4ac7-95f3-8e74054c027f None admin] RBAC: Authorizing `identity:get_project(project_id=c760023a56dc4c499f942685a1652dbf)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:48.984591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc4ddd-a99d-4ac7-95f3-8e74054c027f None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:48.987038 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 198/378] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:48 2022] GET /identity/v3/projects/c760023a56dc4c499f942685a1652dbf => generated 344 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:48.992690 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf0683-1133-4bc0-a7cc-b2dc9c6c5601 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:49.013687 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:49.109077 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf0683-1133-4bc0-a7cc-b2dc9c6c5601 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:49.149058 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50970f65-edef-4c8a-8443-ad324ba0e6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:49.149921 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50970f65-edef-4c8a-8443-ad324ba0e6c5 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:49.150201 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50970f65-edef-4c8a-8443-ad324ba0e6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:49.150472 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50970f65-edef-4c8a-8443-ad324ba0e6c5 None admin] PATH_INFO: `/v3/groups/b4a3a438bf674f5e9c1fb3a45785a2cc` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:49.158676 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50970f65-edef-4c8a-8443-ad324ba0e6c5 None admin] RBAC: Authorizing `identity:get_group(group_id=b4a3a438bf674f5e9c1fb3a45785a2cc)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:49.160172 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50970f65-edef-4c8a-8443-ad324ba0e6c5 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:49.163545 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 181/379] 10.222.0.39 () {56 vars in 1180 bytes} [Mon May 23 15:35:48 2022] GET /identity/v3/groups/b4a3a438bf674f5e9c1fb3a45785a2cc => generated 229 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:49.167470 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc4ddd-a99d-4ac7-95f3-8e74054c027f None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:49.201355 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e35a03-12b9-43fa-9908-3f12646eb150 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:49.201634 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e35a03-12b9-43fa-9908-3f12646eb150 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:49.201831 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e35a03-12b9-43fa-9908-3f12646eb150 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:49.203333 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 182/380] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:35:49.209026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c9fa0-b181-41e1-9c20-c3a0fddaacde None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:49.209604 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c9fa0-b181-41e1-9c20-c3a0fddaacde None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:49.210095 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c9fa0-b181-41e1-9c20-c3a0fddaacde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:49.229099 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-383c9fa0-b181-41e1-9c20-c3a0fddaacde None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:49.230832 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-383c9fa0-b181-41e1-9c20-c3a0fddaacde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:49.275224 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:49.338403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc4ddd-a99d-4ac7-95f3-8e74054c027f None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:49.364922 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 183/381] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:35:49.397767 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba7619-d112-4570-b43c-07f4ff2b6e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:49.398446 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba7619-d112-4570-b43c-07f4ff2b6e7f None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:49.398732 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba7619-d112-4570-b43c-07f4ff2b6e7f None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:49.399007 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba7619-d112-4570-b43c-07f4ff2b6e7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:49.399901 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba7619-d112-4570-b43c-07f4ff2b6e7f None admin] RBAC: Adding query filter params (group.id=b4a3a438bf674f5e9c1fb3a45785a2cc, role.id=3ab888f5f68740bd8f9df4447f4f5a7a, scope.project.id=c760023a56dc4c499f942685a1652dbf) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:49.400199 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba7619-d112-4570-b43c-07f4ff2b6e7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:49.400964 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c9fa0-b181-41e1-9c20-c3a0fddaacde None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:49.401651 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba7619-d112-4570-b43c-07f4ff2b6e7f None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:49.408402 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 199/382] 10.222.0.39 () {56 vars in 1376 bytes} [Mon May 23 15:35:49 2022] GET /identity/v3/role_assignments?group.id=b4a3a438bf674f5e9c1fb3a45785a2cc&scope.project.id=c760023a56dc4c499f942685a1652dbf&role.id=3ab888f5f68740bd8f9df4447f4f5a7a => generated 260 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:49.410413 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:49.536744 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c9fa0-b181-41e1-9c20-c3a0fddaacde None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:49.578021 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822accb-c825-4f50-83dd-16c3326d2fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:49.578878 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822accb-c825-4f50-83dd-16c3326d2fbd None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:49.579157 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822accb-c825-4f50-83dd-16c3326d2fbd None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:49.579430 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822accb-c825-4f50-83dd-16c3326d2fbd None admin] PATH_INFO: `/v3/roles/member` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:49.593212 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822accb-c825-4f50-83dd-16c3326d2fbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:49.604074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-7822accb-c825-4f50-83dd-16c3326d2fbd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:49.604074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:49.604074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:49.604074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:49.604074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:49.604074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:49.604074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:49.604074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:49.604074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:49.604074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:49.604074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:49.604074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:49.604074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:49.604074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:49.604074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:49.604074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:49.605014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:49.605014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:49.605014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:49.605014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:49.605014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:49.605014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:49.605014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:49.605014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:49.605014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:49.605014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:49.605014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:49.605014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:35:49.605014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:49.605014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:49.605014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:49.605014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:49.605816 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:49.605816 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:49.605816 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:49.605816 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:49.605816 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:49.605816 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:49.605816 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:49.605816 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:49.605816 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:49.605816 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:49.605816 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:49.605816 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:35:49.605816 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 184/383] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:35:49.612366 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba7619-d112-4570-b43c-07f4ff2b6e7f None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:49.659782 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e5428-6b2d-48a8-9a1e-6f585d1060b6 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:49.660122 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e5428-6b2d-48a8-9a1e-6f585d1060b6 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:49.660340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e5428-6b2d-48a8-9a1e-6f585d1060b6 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:49.661955 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 185/384] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:49.675455 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d1a62-4abf-4281-bb4d-a9cef39f61fa None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:49.675779 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d1a62-4abf-4281-bb4d-a9cef39f61fa None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:49.676039 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d1a62-4abf-4281-bb4d-a9cef39f61fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:49.706851 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-6b1d1a62-4abf-4281-bb4d-a9cef39f61fa None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:49.708931 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-6b1d1a62-4abf-4281-bb4d-a9cef39f61fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:49.791631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:49.804785 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 186/385] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:35:49.811419 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba7619-d112-4570-b43c-07f4ff2b6e7f None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:49.837383 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d1a62-4abf-4281-bb4d-a9cef39f61fa None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:49.850463 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547f176-035a-4281-918f-9c4a6ba34551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:49.851134 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547f176-035a-4281-918f-9c4a6ba34551 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:49.851415 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547f176-035a-4281-918f-9c4a6ba34551 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:49.851726 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547f176-035a-4281-918f-9c4a6ba34551 None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:49.852581 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547f176-035a-4281-918f-9c4a6ba34551 None admin] RBAC: Adding query filter params (name=member) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:49.852893 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547f176-035a-4281-918f-9c4a6ba34551 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:49.854315 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547f176-035a-4281-918f-9c4a6ba34551 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:49.855937 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:49.864740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 200/386] 10.222.0.39 () {56 vars in 1101 bytes} [Mon May 23 15:35:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:49.871572 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547f176-035a-4281-918f-9c4a6ba34551 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:49.977249 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d1a62-4abf-4281-bb4d-a9cef39f61fa None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:49.997201 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547f176-035a-4281-918f-9c4a6ba34551 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:50.026036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566fdd9-02d0-4841-ae58-efeb2625ea71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:50.027330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566fdd9-02d0-4841-ae58-efeb2625ea71 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:50.027907 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566fdd9-02d0-4841-ae58-efeb2625ea71 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:50.028194 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566fdd9-02d0-4841-ae58-efeb2625ea71 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:50.040148 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f8207-a112-4d0e-812d-a385895109b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:50.041179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f8207-a112-4d0e-812d-a385895109b9 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:50.041603 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f8207-a112-4d0e-812d-a385895109b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:50.041954 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566fdd9-02d0-4841-ae58-efeb2625ea71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:50.042068 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f8207-a112-4d0e-812d-a385895109b9 None admin] PATH_INFO: `/v3/groups/62b62d14c1654605893e0bd878fe71e0` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:50.043334 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2f8207-a112-4d0e-812d-a385895109b9 None admin] RBAC: Authorizing `identity:get_group(group_id=62b62d14c1654605893e0bd878fe71e0)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:50.045024 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2f8207-a112-4d0e-812d-a385895109b9 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:50.050190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-7566fdd9-02d0-4841-ae58-efeb2625ea71 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:35:50.050190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:50.050190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:50.050190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:50.050190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:50.050190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:50.050190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:50.050190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:50.050190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:50.050190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:50.050190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:50.050190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:50.050190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:50.050190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:50.050190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:50.050190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:50.052340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:50.052340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:50.052340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:50.052340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:50.052340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:50.052340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:50.052340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:50.052340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:50.052340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:50.052340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:50.052340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:50.052340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:35:50.052340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:50.052340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:50.052340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:50.052340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:50.054271 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:50.054271 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:50.054271 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:50.054271 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:50.054271 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:50.054271 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:50.054271 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:50.054271 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:50.054271 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:50.054271 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:50.054271 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:35:50.054271 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:35:50.055528 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 201/387] 10.222.0.39 () {56 vars in 1180 bytes} [Mon May 23 15:35:49 2022] GET /identity/v3/groups/62b62d14c1654605893e0bd878fe71e0 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:50.055528 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f8207-a112-4d0e-812d-a385895109b9 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:50.055706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 187/388] 10.222.0.39 () {56 vars in 1114 bytes} [Mon May 23 15:35:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:35:50.059649 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566fdd9-02d0-4841-ae58-efeb2625ea71 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:50.130769 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:50.175931 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:50.179717 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566fdd9-02d0-4841-ae58-efeb2625ea71 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:50.219335 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018ec27-9924-4e6f-94f2-739decb2ac1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:50.220521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018ec27-9924-4e6f-94f2-739decb2ac1f None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:50.220960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018ec27-9924-4e6f-94f2-739decb2ac1f None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:50.221386 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018ec27-9924-4e6f-94f2-739decb2ac1f None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:50.222324 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018ec27-9924-4e6f-94f2-739decb2ac1f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:50.222769 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018ec27-9924-4e6f-94f2-739decb2ac1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:50.224437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018ec27-9924-4e6f-94f2-739decb2ac1f None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:50.237453 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 188/389] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:35:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:50.243658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018ec27-9924-4e6f-94f2-739decb2ac1f None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:50.267700 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f8207-a112-4d0e-812d-a385895109b9 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:50.358689 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018ec27-9924-4e6f-94f2-739decb2ac1f None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:50.365634 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e74aa-e061-4bd1-89f6-75168cf9d5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:50.366618 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e74aa-e061-4bd1-89f6-75168cf9d5af None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:50.366997 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e74aa-e061-4bd1-89f6-75168cf9d5af None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:50.367370 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e74aa-e061-4bd1-89f6-75168cf9d5af None admin] PATH_INFO: `/v3/projects/88c9c3d6e1924302b76cfeeb40525435` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:50.372354 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e74aa-e061-4bd1-89f6-75168cf9d5af None admin] RBAC: Authorizing `identity:get_project(project_id=88c9c3d6e1924302b76cfeeb40525435)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:50.373913 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e74aa-e061-4bd1-89f6-75168cf9d5af None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:50.376087 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 202/390] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:50 2022] GET /identity/v3/projects/88c9c3d6e1924302b76cfeeb40525435 => generated 298 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:50.379181 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:50.381933 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e74aa-e061-4bd1-89f6-75168cf9d5af None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:50.403645 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b4b07-0fd1-41dd-9144-89d202b871b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:50.405425 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b4b07-0fd1-41dd-9144-89d202b871b4 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:50.405841 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b4b07-0fd1-41dd-9144-89d202b871b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:50.406279 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b4b07-0fd1-41dd-9144-89d202b871b4 None admin] PATH_INFO: `/v3/groups/62b62d14c1654605893e0bd878fe71e0` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:50.407707 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b4b07-0fd1-41dd-9144-89d202b871b4 None admin] RBAC: Authorizing `identity:get_group(group_id=62b62d14c1654605893e0bd878fe71e0)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:50.410575 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b4b07-0fd1-41dd-9144-89d202b871b4 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:50.412913 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 189/391] 10.222.0.39 () {56 vars in 1180 bytes} [Mon May 23 15:35:50 2022] GET /identity/v3/groups/62b62d14c1654605893e0bd878fe71e0 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:35:50.418852 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b4b07-0fd1-41dd-9144-89d202b871b4 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:50.500512 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e74aa-e061-4bd1-89f6-75168cf9d5af None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:50.532218 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:50.534127 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b4b07-0fd1-41dd-9144-89d202b871b4 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:50.538242 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660a596-eeed-425f-b5aa-fd97aa4893f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:50.539397 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660a596-eeed-425f-b5aa-fd97aa4893f1 None admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:50.539616 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660a596-eeed-425f-b5aa-fd97aa4893f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:50.540002 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660a596-eeed-425f-b5aa-fd97aa4893f1 None admin] PATH_INFO: `/v3/projects/88c9c3d6e1924302b76cfeeb40525435/groups/62b62d14c1654605893e0bd878fe71e0/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:50.542090 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660a596-eeed-425f-b5aa-fd97aa4893f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=88c9c3d6e1924302b76cfeeb40525435, group_id=62b62d14c1654605893e0bd878fe71e0, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:50.543703 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660a596-eeed-425f-b5aa-fd97aa4893f1 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:50.574651 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff0d73-a1dc-485c-b23f-62b2f65276fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:50.576113 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff0d73-a1dc-485c-b23f-62b2f65276fb None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:50.576552 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff0d73-a1dc-485c-b23f-62b2f65276fb None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:50.576975 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff0d73-a1dc-485c-b23f-62b2f65276fb None admin] PATH_INFO: `/v3/projects/88c9c3d6e1924302b76cfeeb40525435` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:50.578346 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff0d73-a1dc-485c-b23f-62b2f65276fb None admin] RBAC: Authorizing `identity:get_project(project_id=88c9c3d6e1924302b76cfeeb40525435)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:50.579972 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff0d73-a1dc-485c-b23f-62b2f65276fb None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:50.582130 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 190/392] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:50 2022] GET /identity/v3/projects/88c9c3d6e1924302b76cfeeb40525435 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:35:50.588530 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff0d73-a1dc-485c-b23f-62b2f65276fb None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:50.649999 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:50.653132 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 203/393] 10.222.0.39 () {58 vars in 1442 bytes} [Mon May 23 15:35:50 2022] PUT /identity/v3/projects/88c9c3d6e1924302b76cfeeb40525435/groups/62b62d14c1654605893e0bd878fe71e0/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:35:50.701478 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff0d73-a1dc-485c-b23f-62b2f65276fb None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:50.741019 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47933d1f-7330-4800-8f23-dd2ed9876fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:50.742159 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47933d1f-7330-4800-8f23-dd2ed9876fb2 None admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:50.742589 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47933d1f-7330-4800-8f23-dd2ed9876fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:50.743008 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47933d1f-7330-4800-8f23-dd2ed9876fb2 None admin] PATH_INFO: `/v3/projects/88c9c3d6e1924302b76cfeeb40525435/groups/62b62d14c1654605893e0bd878fe71e0/roles/a487e8d6e71d4a399b050274528d8db7` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:50.745605 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47933d1f-7330-4800-8f23-dd2ed9876fb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=88c9c3d6e1924302b76cfeeb40525435, group_id=62b62d14c1654605893e0bd878fe71e0, role_id=a487e8d6e71d4a399b050274528d8db7)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:50.747780 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47933d1f-7330-4800-8f23-dd2ed9876fb2 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:50.830845 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 191/394] 10.222.0.39 () {58 vars in 1442 bytes} [Mon May 23 15:35:50 2022] PUT /identity/v3/projects/88c9c3d6e1924302b76cfeeb40525435/groups/62b62d14c1654605893e0bd878fe71e0/roles/a487e8d6e71d4a399b050274528d8db7 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:35:51.382813 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f7125-0d4f-42c1-8608-95d003d7d3fd None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:51.383927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f7125-0d4f-42c1-8608-95d003d7d3fd None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:51.384464 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f7125-0d4f-42c1-8608-95d003d7d3fd None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:51.386368 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 204/395] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:51.393371 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b85f9c-602f-4c36-b1b1-81be6e585e09 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:51.394917 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b85f9c-602f-4c36-b1b1-81be6e585e09 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:51.395424 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b85f9c-602f-4c36-b1b1-81be6e585e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:51.414457 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-44b85f9c-602f-4c36-b1b1-81be6e585e09 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:51.416056 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-44b85f9c-602f-4c36-b1b1-81be6e585e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:51.496353 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 192/396] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:51.520737 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f7125-0d4f-42c1-8608-95d003d7d3fd None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:51.579157 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338d3a4-761e-47b0-a7bf-9ca8b9995c08 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:51.579852 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338d3a4-761e-47b0-a7bf-9ca8b9995c08 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:51.580357 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338d3a4-761e-47b0-a7bf-9ca8b9995c08 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:51.582002 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 193/397] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:51.588693 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7aa642-e296-4f7d-9394-8758af4c5b36 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:51.589277 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7aa642-e296-4f7d-9394-8758af4c5b36 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:51.589826 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7aa642-e296-4f7d-9394-8758af4c5b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:51.616324 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-6f7aa642-e296-4f7d-9394-8758af4c5b36 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:51.617507 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-6f7aa642-e296-4f7d-9394-8758af4c5b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:51.692672 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:51.711034 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f7125-0d4f-42c1-8608-95d003d7d3fd None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:51.721659 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 194/398] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:35:51.747994 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7716f74-e30a-4712-9e79-7a473a79585e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:51.748284 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7716f74-e30a-4712-9e79-7a473a79585e None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:51.748569 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7716f74-e30a-4712-9e79-7a473a79585e None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:51.748854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7716f74-e30a-4712-9e79-7a473a79585e None admin] PATH_INFO: `/v3/roles/member` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:51.759545 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7716f74-e30a-4712-9e79-7a473a79585e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:51.765043 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7aa642-e296-4f7d-9394-8758af4c5b36 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:51.767945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-b7716f74-e30a-4712-9e79-7a473a79585e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:51.767945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:51.767945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:51.767945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:51.767945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:51.767945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:51.767945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:51.767945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:51.767945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:51.767945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:51.767945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:51.767945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:51.767945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:51.767945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:51.767945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:51.767945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:51.768821 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:51.768821 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:51.768821 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:51.768821 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:51.768821 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:51.768821 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:51.768821 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:51.768821 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:51.768821 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:51.768821 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:51.768821 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:51.768821 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:35:51.768821 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:51.768821 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:51.768821 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:51.768821 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:51.769621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:51.769621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:51.769621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:51.769621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:51.769621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:51.769621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:51.769621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:51.769621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:51.769621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:51.769621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:51.769621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:51.769621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:35:51.769621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 205/399] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:51.783610 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7716f74-e30a-4712-9e79-7a473a79585e None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:51.876003 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:51.881779 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7aa642-e296-4f7d-9394-8758af4c5b36 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:51.920165 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee4a3e-e5f6-4cba-992b-c3ba29546007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:51.921363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee4a3e-e5f6-4cba-992b-c3ba29546007 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:51.921849 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee4a3e-e5f6-4cba-992b-c3ba29546007 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:51.922321 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee4a3e-e5f6-4cba-992b-c3ba29546007 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:51.926756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7716f74-e30a-4712-9e79-7a473a79585e None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:51.936514 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee4a3e-e5f6-4cba-992b-c3ba29546007 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:51.945823 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-8aee4a3e-e5f6-4cba-992b-c3ba29546007 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:35:51.945823 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:51.945823 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:51.945823 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:51.945823 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:51.945823 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:51.945823 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:51.945823 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:51.945823 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:51.945823 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:51.945823 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:51.945823 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:51.945823 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:51.945823 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:51.945823 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:51.945823 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:51.946744 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:51.946744 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:51.946744 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:51.946744 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:51.946744 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:51.946744 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:51.946744 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:51.946744 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:51.946744 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:51.946744 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:51.946744 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:51.946744 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:35:51.946744 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:51.946744 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:51.946744 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:51.946744 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:51.947523 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:51.947523 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:51.947523 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:51.947523 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:51.947523 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:51.947523 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:51.947523 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:51.947523 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:51.947523 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:51.947523 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:51.947523 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:35:51.947523 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:35:51.947523 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 195/400] 10.222.0.39 () {56 vars in 1114 bytes} [Mon May 23 15:35:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:35:51.956651 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee4a3e-e5f6-4cba-992b-c3ba29546007 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:51.986580 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41307449-f873-4892-b9c3-d71ca0479a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:51.987658 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41307449-f873-4892-b9c3-d71ca0479a8f None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:51.988146 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41307449-f873-4892-b9c3-d71ca0479a8f None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:51.988643 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41307449-f873-4892-b9c3-d71ca0479a8f None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:51.989597 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41307449-f873-4892-b9c3-d71ca0479a8f None admin] RBAC: Adding query filter params (name=member) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:51.990106 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41307449-f873-4892-b9c3-d71ca0479a8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:51.993304 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41307449-f873-4892-b9c3-d71ca0479a8f None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:52.011989 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 206/401] 10.222.0.39 () {56 vars in 1101 bytes} [Mon May 23 15:35:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:35:52.020598 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41307449-f873-4892-b9c3-d71ca0479a8f None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:52.064026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:52.107842 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee4a3e-e5f6-4cba-992b-c3ba29546007 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:52.146278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e21032-880b-4b8c-b379-33949ae35b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:52.147357 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e21032-880b-4b8c-b379-33949ae35b10 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:52.147887 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e21032-880b-4b8c-b379-33949ae35b10 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:52.148381 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e21032-880b-4b8c-b379-33949ae35b10 None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:52.149321 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e21032-880b-4b8c-b379-33949ae35b10 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:52.149825 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e21032-880b-4b8c-b379-33949ae35b10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:52.151664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e21032-880b-4b8c-b379-33949ae35b10 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:52.161319 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 196/402] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:35:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:52.167193 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e21032-880b-4b8c-b379-33949ae35b10 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:52.242631 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41307449-f873-4892-b9c3-d71ca0479a8f None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:52.260946 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:52.281353 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cfe99-ad95-4165-a1d8-94a64a8f4ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:52.282558 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cfe99-ad95-4165-a1d8-94a64a8f4ff2 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:52.283073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cfe99-ad95-4165-a1d8-94a64a8f4ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:52.283933 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cfe99-ad95-4165-a1d8-94a64a8f4ff2 None admin] PATH_INFO: `/v3/groups/62b62d14c1654605893e0bd878fe71e0` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:52.286207 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1cfe99-ad95-4165-a1d8-94a64a8f4ff2 None admin] RBAC: Authorizing `identity:get_group(group_id=62b62d14c1654605893e0bd878fe71e0)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:52.288571 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1cfe99-ad95-4165-a1d8-94a64a8f4ff2 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:52.290589 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 207/403] 10.222.0.39 () {56 vars in 1180 bytes} [Mon May 23 15:35:52 2022] GET /identity/v3/groups/62b62d14c1654605893e0bd878fe71e0 => generated 226 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:52.297696 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cfe99-ad95-4165-a1d8-94a64a8f4ff2 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:52.388075 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:52.398824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e21032-880b-4b8c-b379-33949ae35b10 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:52.430932 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cfe99-ad95-4165-a1d8-94a64a8f4ff2 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:52.477470 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e9a13-7e6e-40cb-8faa-cc965a11227b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:52.477717 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82da7c-24a1-4ef0-abdc-18744fe28fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:52.478341 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82da7c-24a1-4ef0-abdc-18744fe28fb6 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:52.478450 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e9a13-7e6e-40cb-8faa-cc965a11227b None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:52.478637 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e9a13-7e6e-40cb-8faa-cc965a11227b None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:52.478740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82da7c-24a1-4ef0-abdc-18744fe28fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:52.478886 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82da7c-24a1-4ef0-abdc-18744fe28fb6 None admin] PATH_INFO: `/v3/projects/f050448816e04bc3ace6d56d9ec83679` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:52.478983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e9a13-7e6e-40cb-8faa-cc965a11227b None admin] PATH_INFO: `/v3/groups/62b62d14c1654605893e0bd878fe71e0` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:52.480078 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e9a13-7e6e-40cb-8faa-cc965a11227b None admin] RBAC: Authorizing `identity:get_group(group_id=62b62d14c1654605893e0bd878fe71e0)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:52.480200 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82da7c-24a1-4ef0-abdc-18744fe28fb6 None admin] RBAC: Authorizing `identity:get_project(project_id=f050448816e04bc3ace6d56d9ec83679)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:52.482032 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82da7c-24a1-4ef0-abdc-18744fe28fb6 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:52.482141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e9a13-7e6e-40cb-8faa-cc965a11227b None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:52.484414 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 208/404] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:52 2022] GET /identity/v3/projects/f050448816e04bc3ace6d56d9ec83679 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:35:52.487748 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 197/405] 10.222.0.39 () {56 vars in 1180 bytes} [Mon May 23 15:35:52 2022] GET /identity/v3/groups/62b62d14c1654605893e0bd878fe71e0 => generated 226 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:52.489779 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82da7c-24a1-4ef0-abdc-18744fe28fb6 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:52.498170 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e9a13-7e6e-40cb-8faa-cc965a11227b None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:52.598002 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:52.653169 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e9a13-7e6e-40cb-8faa-cc965a11227b None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:52.663427 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82da7c-24a1-4ef0-abdc-18744fe28fb6 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:52.698770 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5270c4-4412-4b54-af80-b60cc25a6de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:52.700911 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5270c4-4412-4b54-af80-b60cc25a6de8 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:52.701417 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5270c4-4412-4b54-af80-b60cc25a6de8 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:52.701844 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5270c4-4412-4b54-af80-b60cc25a6de8 None admin] PATH_INFO: `/v3/projects/f050448816e04bc3ace6d56d9ec83679` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:52.703240 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5270c4-4412-4b54-af80-b60cc25a6de8 None admin] RBAC: Authorizing `identity:get_project(project_id=f050448816e04bc3ace6d56d9ec83679)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:52.704523 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8d0ad-85b1-46f0-b135-66652938f0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:52.705055 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5270c4-4412-4b54-af80-b60cc25a6de8 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:52.705582 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8d0ad-85b1-46f0-b135-66652938f0b4 None admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:52.705958 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8d0ad-85b1-46f0-b135-66652938f0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:52.706329 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8d0ad-85b1-46f0-b135-66652938f0b4 None admin] PATH_INFO: `/v3/projects/f050448816e04bc3ace6d56d9ec83679/groups/62b62d14c1654605893e0bd878fe71e0/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:52.707690 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 198/406] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:52 2022] GET /identity/v3/projects/f050448816e04bc3ace6d56d9ec83679 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:35:52.709054 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf2c65-9606-4d9e-931e-39d370f43c31 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:52.709491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf2c65-9606-4d9e-931e-39d370f43c31 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:52.709898 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf2c65-9606-4d9e-931e-39d370f43c31 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:52.711513 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 199/407] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:52.712470 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f8d0ad-85b1-46f0-b135-66652938f0b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=f050448816e04bc3ace6d56d9ec83679, group_id=62b62d14c1654605893e0bd878fe71e0, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:52.713961 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f8d0ad-85b1-46f0-b135-66652938f0b4 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:52.720601 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf2c65-9606-4d9e-931e-39d370f43c31 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:52.755102 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:52.820383 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 209/408] 10.222.0.39 () {58 vars in 1442 bytes} [Mon May 23 15:35:52 2022] PUT /identity/v3/projects/f050448816e04bc3ace6d56d9ec83679/groups/62b62d14c1654605893e0bd878fe71e0/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:35:52.822529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1261cd6-adb8-4c6d-babc-8c7bb13903d4 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:52.828619 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1261cd6-adb8-4c6d-babc-8c7bb13903d4 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:52.829612 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1261cd6-adb8-4c6d-babc-8c7bb13903d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:52.842875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf2c65-9606-4d9e-931e-39d370f43c31 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:52.871687 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-e1261cd6-adb8-4c6d-babc-8c7bb13903d4 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:52.874271 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-e1261cd6-adb8-4c6d-babc-8c7bb13903d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:52.918904 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452844b3-4eae-40bc-8750-96ef47adc39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:52.920992 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452844b3-4eae-40bc-8750-96ef47adc39a None admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:52.921277 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452844b3-4eae-40bc-8750-96ef47adc39a None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:52.921554 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452844b3-4eae-40bc-8750-96ef47adc39a None admin] PATH_INFO: `/v3/projects/f050448816e04bc3ace6d56d9ec83679/groups/62b62d14c1654605893e0bd878fe71e0/roles/a487e8d6e71d4a399b050274528d8db7` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:52.928206 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452844b3-4eae-40bc-8750-96ef47adc39a None admin] RBAC: Authorizing `identity:create_grant(project_id=f050448816e04bc3ace6d56d9ec83679, group_id=62b62d14c1654605893e0bd878fe71e0, role_id=a487e8d6e71d4a399b050274528d8db7)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:52.931257 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452844b3-4eae-40bc-8750-96ef47adc39a None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:52.988442 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 210/409] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:53.012279 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1261cd6-adb8-4c6d-babc-8c7bb13903d4 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:53.036680 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 200/410] 10.222.0.39 () {58 vars in 1442 bytes} [Mon May 23 15:35:52 2022] PUT /identity/v3/projects/f050448816e04bc3ace6d56d9ec83679/groups/62b62d14c1654605893e0bd878fe71e0/roles/a487e8d6e71d4a399b050274528d8db7 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:35:53.072337 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:53.141308 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1261cd6-adb8-4c6d-babc-8c7bb13903d4 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:53.179808 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baacda28-a685-4897-9362-cb57914415ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:53.180621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baacda28-a685-4897-9362-cb57914415ff None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:53.180902 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baacda28-a685-4897-9362-cb57914415ff None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:53.181266 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baacda28-a685-4897-9362-cb57914415ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:53.193892 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baacda28-a685-4897-9362-cb57914415ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:53.202478 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-baacda28-a685-4897-9362-cb57914415ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:35:53.202478 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:53.202478 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:53.202478 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:53.202478 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:53.202478 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:53.202478 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:53.202478 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:53.202478 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:53.202478 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:53.202478 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:53.202478 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:53.202478 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:53.202478 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:53.202478 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:53.202478 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:53.203415 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:53.203415 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:53.203415 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:53.203415 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:53.203415 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:53.203415 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:53.203415 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:53.203415 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:53.203415 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:53.203415 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:53.203415 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:53.203415 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:35:53.203415 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:53.203415 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:53.203415 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:53.203415 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:53.204251 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:53.204251 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:53.204251 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:53.204251 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:53.204251 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:53.204251 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:53.204251 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:53.204251 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:53.204251 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:53.204251 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:53.204251 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:35:53.204251 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:35:53.207725 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 211/411] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:35:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:35:53.209954 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452844b3-4eae-40bc-8750-96ef47adc39a None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:53.312162 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:53.321194 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452844b3-4eae-40bc-8750-96ef47adc39a None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:53.360542 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46570c1f-6140-4b89-a167-39bba19b2a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:53.361274 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46570c1f-6140-4b89-a167-39bba19b2a85 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:53.361559 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46570c1f-6140-4b89-a167-39bba19b2a85 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:53.361833 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46570c1f-6140-4b89-a167-39bba19b2a85 None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:53.362589 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46570c1f-6140-4b89-a167-39bba19b2a85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:53.362899 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46570c1f-6140-4b89-a167-39bba19b2a85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:53.364339 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46570c1f-6140-4b89-a167-39bba19b2a85 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:53.374645 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 201/412] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:53.380293 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baacda28-a685-4897-9362-cb57914415ff None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:53.488661 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:53.492156 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baacda28-a685-4897-9362-cb57914415ff None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:53.526781 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b09adb-23d9-4477-a9fa-7e7b81029a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:53.527728 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b09adb-23d9-4477-a9fa-7e7b81029a1f None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:53.528049 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b09adb-23d9-4477-a9fa-7e7b81029a1f None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:53.528838 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b09adb-23d9-4477-a9fa-7e7b81029a1f None admin] PATH_INFO: `/v3/groups/b4a3a438bf674f5e9c1fb3a45785a2cc` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:53.530017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b09adb-23d9-4477-a9fa-7e7b81029a1f None admin] RBAC: Authorizing `identity:get_group(group_id=b4a3a438bf674f5e9c1fb3a45785a2cc)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:53.531548 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b09adb-23d9-4477-a9fa-7e7b81029a1f None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:53.537658 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 212/413] 10.222.0.39 () {56 vars in 1180 bytes} [Mon May 23 15:35:53 2022] GET /identity/v3/groups/b4a3a438bf674f5e9c1fb3a45785a2cc => generated 229 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:53.539017 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46570c1f-6140-4b89-a167-39bba19b2a85 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:53.546473 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693f0ff-435e-41e8-9881-38eb116c78ae None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:53.547096 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693f0ff-435e-41e8-9881-38eb116c78ae None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:53.547586 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693f0ff-435e-41e8-9881-38eb116c78ae None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:53.549513 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 213/414] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:53.555139 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f7e03-7527-4df7-9f12-c17a65460327 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:53.555426 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f7e03-7527-4df7-9f12-c17a65460327 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:53.555732 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f7e03-7527-4df7-9f12-c17a65460327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:53.587559 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-c97f7e03-7527-4df7-9f12-c17a65460327 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:53.588780 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-c97f7e03-7527-4df7-9f12-c17a65460327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:53.672405 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 214/415] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:53.683617 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea00c9-303f-4b8e-b6ec-ad2cb4157bae None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:53.683994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46570c1f-6140-4b89-a167-39bba19b2a85 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:53.684481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea00c9-303f-4b8e-b6ec-ad2cb4157bae None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:53.685042 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea00c9-303f-4b8e-b6ec-ad2cb4157bae None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:53.686908 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 215/416] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:53 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:53.693935 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6503e85-559a-445e-9b51-c3058ef2d293 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:53.694504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6503e85-559a-445e-9b51-c3058ef2d293 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:53.694988 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6503e85-559a-445e-9b51-c3058ef2d293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:53.719180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-d6503e85-559a-445e-9b51-c3058ef2d293 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:53.720730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-d6503e85-559a-445e-9b51-c3058ef2d293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:53.740171 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b3d0b-259e-4ab1-b5e7-f17673376d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:53.741335 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b3d0b-259e-4ab1-b5e7-f17673376d90 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:53.741621 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b3d0b-259e-4ab1-b5e7-f17673376d90 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:53.741893 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b3d0b-259e-4ab1-b5e7-f17673376d90 None admin] PATH_INFO: `/v3/projects/c760023a56dc4c499f942685a1652dbf` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:53.743084 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b3d0b-259e-4ab1-b5e7-f17673376d90 None admin] RBAC: Authorizing `identity:get_project(project_id=c760023a56dc4c499f942685a1652dbf)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:53.744550 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b3d0b-259e-4ab1-b5e7-f17673376d90 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:53.747353 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 202/417] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:53 2022] GET /identity/v3/projects/c760023a56dc4c499f942685a1652dbf => generated 344 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:53.748439 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b3d0b-259e-4ab1-b5e7-f17673376d90 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:53.780888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:53.804375 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 216/418] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:35:53.805217 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6503e85-559a-445e-9b51-c3058ef2d293 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:53.855035 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:53.895866 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b3d0b-259e-4ab1-b5e7-f17673376d90 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:53.934284 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6503e85-559a-445e-9b51-c3058ef2d293 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:53.939951 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821c0c6-81db-4085-8190-4beb481e3293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:53.940763 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821c0c6-81db-4085-8190-4beb481e3293 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:53.941043 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821c0c6-81db-4085-8190-4beb481e3293 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:53.941312 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821c0c6-81db-4085-8190-4beb481e3293 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:53.955897 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2821c0c6-81db-4085-8190-4beb481e3293 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:53.967787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-2821c0c6-81db-4085-8190-4beb481e3293 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:35:53.967787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:53.967787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:53.967787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:53.967787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:53.967787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:53.967787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:53.967787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:53.967787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:53.967787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:53.967787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:53.967787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:53.967787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:53.967787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:53.967787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:53.967787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:53.968756 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:53.968756 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:53.968756 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:53.968756 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:53.968756 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:53.968756 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:53.968756 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:53.968756 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:53.968756 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:53.968756 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:53.968756 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:53.968756 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:35:53.968756 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:53.968756 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:53.968756 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:53.968756 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:53.969550 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:53.969550 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:53.969550 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:53.969550 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:53.969550 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:53.969550 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:53.969550 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:53.969550 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:53.969550 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:53.969550 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:53.969550 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:35:53.969550 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:35:53.969550 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 203/419] 10.222.0.39 () {56 vars in 1114 bytes} [Mon May 23 15:35:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:53.970225 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821c0c6-81db-4085-8190-4beb481e3293 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:53.977325 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd344b-b1a2-4690-96c0-a337f77b185f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:53.978300 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd344b-b1a2-4690-96c0-a337f77b185f None admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:53.978659 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd344b-b1a2-4690-96c0-a337f77b185f None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:53.979006 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd344b-b1a2-4690-96c0-a337f77b185f None admin] PATH_INFO: `/v3/projects/c760023a56dc4c499f942685a1652dbf/groups/b4a3a438bf674f5e9c1fb3a45785a2cc/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:53.981177 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd344b-b1a2-4690-96c0-a337f77b185f None admin] RBAC: Authorizing `identity:create_grant(project_id=c760023a56dc4c499f942685a1652dbf, group_id=b4a3a438bf674f5e9c1fb3a45785a2cc, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:53.983373 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd344b-b1a2-4690-96c0-a337f77b185f None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:54.057646 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:54.077099 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 217/420] 10.222.0.39 () {58 vars in 1442 bytes} [Mon May 23 15:35:53 2022] PUT /identity/v3/projects/c760023a56dc4c499f942685a1652dbf/groups/b4a3a438bf674f5e9c1fb3a45785a2cc/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:35:54.078871 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd344b-b1a2-4690-96c0-a337f77b185f None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:54.090905 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821c0c6-81db-4085-8190-4beb481e3293 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:54.134045 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e4a30-251c-452e-b378-abcff6e2eef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:54.135200 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e4a30-251c-452e-b378-abcff6e2eef5 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:54.135738 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e4a30-251c-452e-b378-abcff6e2eef5 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:54.136258 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e4a30-251c-452e-b378-abcff6e2eef5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:54.154899 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e4a30-251c-452e-b378-abcff6e2eef5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:54.165515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-ff0e4a30-251c-452e-b378-abcff6e2eef5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:54.165515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:54.165515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:54.165515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:54.165515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:54.165515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:54.165515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:54.165515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:54.165515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:54.165515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:54.165515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:54.165515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:54.165515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:54.165515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:54.165515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:54.165515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:54.166434 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:54.166434 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:54.166434 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:54.166434 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:54.166434 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:54.166434 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:54.166434 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:54.166434 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:54.166434 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:54.166434 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:54.166434 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:54.166434 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:35:54.166434 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:54.166434 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:54.166434 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:54.166434 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:54.167848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:54.167848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:54.167848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:54.167848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:54.167848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:54.167848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:54.167848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:54.167848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:54.167848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:54.167848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:54.167848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:54.167848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:35:54.167848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 204/421] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:54.173702 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e4a30-251c-452e-b378-abcff6e2eef5 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:54.215098 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:54.227931 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd344b-b1a2-4690-96c0-a337f77b185f None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:54.305335 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc6339-bced-4b66-a5ad-70bdb0148079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:54.307040 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc6339-bced-4b66-a5ad-70bdb0148079 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:54.307904 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc6339-bced-4b66-a5ad-70bdb0148079 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:54.308716 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc6339-bced-4b66-a5ad-70bdb0148079 None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:54.313021 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc6339-bced-4b66-a5ad-70bdb0148079 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:54.313609 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc6339-bced-4b66-a5ad-70bdb0148079 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:54.315345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc6339-bced-4b66-a5ad-70bdb0148079 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:54.331426 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 218/422] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:35:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:54.341100 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc6339-bced-4b66-a5ad-70bdb0148079 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:54.371697 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e4a30-251c-452e-b378-abcff6e2eef5 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:54.415385 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f364e74-11ad-47c0-9ef7-24dc7bcb6297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:54.416458 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f364e74-11ad-47c0-9ef7-24dc7bcb6297 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:54.416959 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f364e74-11ad-47c0-9ef7-24dc7bcb6297 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:54.417425 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f364e74-11ad-47c0-9ef7-24dc7bcb6297 None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:54.418375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f364e74-11ad-47c0-9ef7-24dc7bcb6297 None admin] RBAC: Adding query filter params (name=member) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:54.419366 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f364e74-11ad-47c0-9ef7-24dc7bcb6297 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:54.421051 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f364e74-11ad-47c0-9ef7-24dc7bcb6297 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:54.430658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 205/423] 10.222.0.39 () {56 vars in 1101 bytes} [Mon May 23 15:35:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:54.436307 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f364e74-11ad-47c0-9ef7-24dc7bcb6297 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:54.442022 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:54.470108 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc6339-bced-4b66-a5ad-70bdb0148079 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:54.513916 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaab09d-649d-45a7-a715-19fc44837732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:54.514680 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaab09d-649d-45a7-a715-19fc44837732 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:54.514870 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaab09d-649d-45a7-a715-19fc44837732 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:54.515126 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaab09d-649d-45a7-a715-19fc44837732 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:54.559575 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:54.626480 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaab09d-649d-45a7-a715-19fc44837732 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:54.628123 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaab09d-649d-45a7-a715-19fc44837732 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:54.667947 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f364e74-11ad-47c0-9ef7-24dc7bcb6297 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:54.737881 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 219/424] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:35:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:35:54.746416 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaab09d-649d-45a7-a715-19fc44837732 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:54.758232 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea3a90-097e-4544-a576-e48250b5db5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:54.759173 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea3a90-097e-4544-a576-e48250b5db5a None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:54.759627 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea3a90-097e-4544-a576-e48250b5db5a None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:54.760039 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea3a90-097e-4544-a576-e48250b5db5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:54.818887 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:54.851382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaab09d-649d-45a7-a715-19fc44837732 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:54.894925 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952186ef-158e-43c6-b118-ab30ed388a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:54.895831 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952186ef-158e-43c6-b118-ab30ed388a3b None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:54.896117 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952186ef-158e-43c6-b118-ab30ed388a3b None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:54.896391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952186ef-158e-43c6-b118-ab30ed388a3b None admin] PATH_INFO: `/v3/projects/88c9c3d6e1924302b76cfeeb40525435` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:54.897806 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952186ef-158e-43c6-b118-ab30ed388a3b None admin] RBAC: Authorizing `identity:get_project(project_id=88c9c3d6e1924302b76cfeeb40525435)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:54.899261 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952186ef-158e-43c6-b118-ab30ed388a3b None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:54.902582 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 220/425] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:54 2022] GET /identity/v3/projects/88c9c3d6e1924302b76cfeeb40525435 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:54.908541 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952186ef-158e-43c6-b118-ab30ed388a3b None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:54.915843 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea3a90-097e-4544-a576-e48250b5db5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:54.917344 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea3a90-097e-4544-a576-e48250b5db5a None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:54.925865 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:55.084619 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 206/426] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:35:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:35:55.091229 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea3a90-097e-4544-a576-e48250b5db5a None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:55.107071 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952186ef-158e-43c6-b118-ab30ed388a3b None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:55.133599 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:55.145578 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f14ab-ee21-4989-8b0c-2158886c0340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:55.146449 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f14ab-ee21-4989-8b0c-2158886c0340 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:55.146731 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f14ab-ee21-4989-8b0c-2158886c0340 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:55.147011 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f14ab-ee21-4989-8b0c-2158886c0340 None admin] PATH_INFO: `/v3/groups/62b62d14c1654605893e0bd878fe71e0` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:55.148242 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f14ab-ee21-4989-8b0c-2158886c0340 None admin] RBAC: Authorizing `identity:get_group(group_id=62b62d14c1654605893e0bd878fe71e0)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:55.149720 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f14ab-ee21-4989-8b0c-2158886c0340 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:55.151645 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 221/427] 10.222.0.39 () {56 vars in 1180 bytes} [Mon May 23 15:35:54 2022] GET /identity/v3/groups/62b62d14c1654605893e0bd878fe71e0 => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:55.158076 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f14ab-ee21-4989-8b0c-2158886c0340 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:55.274223 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f14ab-ee21-4989-8b0c-2158886c0340 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:55.313546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc249b-1b19-4606-9884-d3ee66ee9201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:55.314212 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc249b-1b19-4606-9884-d3ee66ee9201 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:55.314496 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc249b-1b19-4606-9884-d3ee66ee9201 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:55.314777 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc249b-1b19-4606-9884-d3ee66ee9201 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:55.315624 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc249b-1b19-4606-9884-d3ee66ee9201 None admin] RBAC: Adding query filter params (group.id=62b62d14c1654605893e0bd878fe71e0, role.id=a487e8d6e71d4a399b050274528d8db7, scope.project.id=88c9c3d6e1924302b76cfeeb40525435) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:55.315947 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc249b-1b19-4606-9884-d3ee66ee9201 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:55.317403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc249b-1b19-4606-9884-d3ee66ee9201 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:55.328001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 222/428] 10.222.0.39 () {56 vars in 1376 bytes} [Mon May 23 15:35:55 2022] GET /identity/v3/role_assignments?group.id=62b62d14c1654605893e0bd878fe71e0&scope.project.id=88c9c3d6e1924302b76cfeeb40525435&role.id=a487e8d6e71d4a399b050274528d8db7 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:55.352069 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea3a90-097e-4544-a576-e48250b5db5a None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:55.367175 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:55.413264 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080dafff-5e14-47ff-b917-1e512be7cde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:55.414140 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dafff-5e14-47ff-b917-1e512be7cde9 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:55.414427 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dafff-5e14-47ff-b917-1e512be7cde9 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:55.414708 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dafff-5e14-47ff-b917-1e512be7cde9 None admin] PATH_INFO: `/v3/projects/88c9c3d6e1924302b76cfeeb40525435` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:55.415937 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080dafff-5e14-47ff-b917-1e512be7cde9 None admin] RBAC: Authorizing `identity:get_project(project_id=88c9c3d6e1924302b76cfeeb40525435)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:55.417409 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080dafff-5e14-47ff-b917-1e512be7cde9 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:55.429160 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc249b-1b19-4606-9884-d3ee66ee9201 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:55.430013 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 207/429] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:55 2022] GET /identity/v3/projects/88c9c3d6e1924302b76cfeeb40525435 => generated 298 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:35:55.529550 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:55.601492 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc249b-1b19-4606-9884-d3ee66ee9201 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:55.639963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea29b2-45fa-441c-a285-f1430717b63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:55.640746 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea29b2-45fa-441c-a285-f1430717b63e None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:55.641030 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea29b2-45fa-441c-a285-f1430717b63e None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:55.641308 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea29b2-45fa-441c-a285-f1430717b63e None admin] PATH_INFO: `/v3/groups/62b62d14c1654605893e0bd878fe71e0` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:55.643249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ea29b2-45fa-441c-a285-f1430717b63e None admin] RBAC: Authorizing `identity:get_group(group_id=62b62d14c1654605893e0bd878fe71e0)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:55.643997 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ea29b2-45fa-441c-a285-f1430717b63e None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:55.645923 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 223/430] 10.222.0.39 () {56 vars in 1180 bytes} [Mon May 23 15:35:55 2022] GET /identity/v3/groups/62b62d14c1654605893e0bd878fe71e0 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:55.651689 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080dafff-5e14-47ff-b917-1e512be7cde9 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:55.733182 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31011c6-93db-443b-89db-a53d6de1fe8e None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:55.733522 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31011c6-93db-443b-89db-a53d6de1fe8e None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:55.733742 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31011c6-93db-443b-89db-a53d6de1fe8e None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:55.735642 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 224/431] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:35:55.741322 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594aa0a-0361-405e-bebc-4ce6393c1131 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:55.741992 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594aa0a-0361-405e-bebc-4ce6393c1131 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:55.742301 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594aa0a-0361-405e-bebc-4ce6393c1131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:55.763054 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-b594aa0a-0361-405e-bebc-4ce6393c1131 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:55.764419 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-b594aa0a-0361-405e-bebc-4ce6393c1131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:55.767935 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080dafff-5e14-47ff-b917-1e512be7cde9 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:55.812317 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774d9a8-760e-4769-b7de-04ec678e178d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:55.813384 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774d9a8-760e-4769-b7de-04ec678e178d None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:55.813874 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774d9a8-760e-4769-b7de-04ec678e178d None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:55.814367 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774d9a8-760e-4769-b7de-04ec678e178d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:55.816018 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774d9a8-760e-4769-b7de-04ec678e178d None admin] RBAC: Adding query filter params (group.id=62b62d14c1654605893e0bd878fe71e0, role.id=c41a7cd1c92b45a7bff9632d07b48006, scope.project.id=88c9c3d6e1924302b76cfeeb40525435) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:55.816546 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774d9a8-760e-4769-b7de-04ec678e178d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:55.818900 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774d9a8-760e-4769-b7de-04ec678e178d None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:55.828178 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 208/432] 10.222.0.39 () {56 vars in 1376 bytes} [Mon May 23 15:35:55 2022] GET /identity/v3/role_assignments?group.id=62b62d14c1654605893e0bd878fe71e0&scope.project.id=88c9c3d6e1924302b76cfeeb40525435&role.id=c41a7cd1c92b45a7bff9632d07b48006 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:55.829743 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f1792-2f9b-4a27-97da-2040bfd6e787 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:55.830032 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f1792-2f9b-4a27-97da-2040bfd6e787 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:55.830339 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f1792-2f9b-4a27-97da-2040bfd6e787 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:55.835646 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 209/433] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:55.837155 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26b570-e1fc-4c50-b21f-11d0e60cdd4a None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:55.837439 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26b570-e1fc-4c50-b21f-11d0e60cdd4a None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:55.837719 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26b570-e1fc-4c50-b21f-11d0e60cdd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:55.857213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-4b26b570-e1fc-4c50-b21f-11d0e60cdd4a None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:55.858718 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-4b26b570-e1fc-4c50-b21f-11d0e60cdd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:55.875854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 225/434] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:35:55.894327 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:55.901957 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594aa0a-0361-405e-bebc-4ce6393c1131 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:55.939118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 210/435] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:55.962829 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26b570-e1fc-4c50-b21f-11d0e60cdd4a None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:55.995977 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:56.031239 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594aa0a-0361-405e-bebc-4ce6393c1131 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:56.077839 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c71c9-5555-4d5d-a1aa-1b3755c5d268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:56.078651 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c71c9-5555-4d5d-a1aa-1b3755c5d268 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:56.078930 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c71c9-5555-4d5d-a1aa-1b3755c5d268 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:56.079203 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c71c9-5555-4d5d-a1aa-1b3755c5d268 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:56.096211 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c71c9-5555-4d5d-a1aa-1b3755c5d268 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:56.097162 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26b570-e1fc-4c50-b21f-11d0e60cdd4a None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:56.104388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-298c71c9-5555-4d5d-a1aa-1b3755c5d268 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:35:56.104388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:56.104388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:56.104388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:56.104388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:56.104388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:56.104388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:56.104388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:56.104388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:56.104388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:56.104388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:56.104388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:56.104388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:56.104388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:56.104388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:56.104388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:56.105346 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:56.105346 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:56.105346 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:56.105346 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:56.105346 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:56.105346 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:56.105346 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:56.105346 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:56.105346 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:56.105346 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:56.105346 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:56.105346 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:35:56.105346 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:56.105346 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:56.105346 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:56.105346 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:56.106121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:56.106121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:56.106121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:56.106121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:56.106121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:56.106121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:56.106121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:56.106121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:56.106121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:56.106121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:56.106121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:35:56.106121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:35:56.106121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 226/436] 10.222.0.39 () {56 vars in 1114 bytes} [Mon May 23 15:35:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:56.112847 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c71c9-5555-4d5d-a1aa-1b3755c5d268 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:56.148462 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a38ab-4f56-4348-8551-59509eb4efe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:56.149692 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a38ab-4f56-4348-8551-59509eb4efe6 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:56.150270 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a38ab-4f56-4348-8551-59509eb4efe6 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:56.150558 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a38ab-4f56-4348-8551-59509eb4efe6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:56.167390 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a38ab-4f56-4348-8551-59509eb4efe6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:56.177460 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-c11a38ab-4f56-4348-8551-59509eb4efe6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:56.177460 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:56.177460 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:56.177460 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:56.177460 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:56.177460 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:56.177460 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:56.177460 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:56.177460 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:56.177460 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:56.177460 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:56.177460 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:56.177460 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:56.177460 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:56.177460 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:56.177460 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:56.178595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:56.178595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:56.178595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:56.178595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:56.178595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:56.178595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:56.178595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:56.178595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:56.178595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:56.178595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:56.178595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:56.178595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:35:56.178595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:56.178595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:56.178595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:56.178595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:56.179422 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:56.179422 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:56.179422 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:56.179422 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:56.179422 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:56.179422 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:56.179422 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:56.179422 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:56.179422 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:56.179422 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:56.179422 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:35:56.179422 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:35:56.179422 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 211/437] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:56.185852 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a38ab-4f56-4348-8551-59509eb4efe6 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:56.225461 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:56.262489 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c71c9-5555-4d5d-a1aa-1b3755c5d268 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:56.276765 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:56.310988 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbc35a-585d-4612-8302-d9b779f377b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:56.312530 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbc35a-585d-4612-8302-d9b779f377b2 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:56.312881 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbc35a-585d-4612-8302-d9b779f377b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:56.313226 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbc35a-585d-4612-8302-d9b779f377b2 None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:56.314052 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fbc35a-585d-4612-8302-d9b779f377b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:56.314368 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fbc35a-585d-4612-8302-d9b779f377b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:56.315776 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fbc35a-585d-4612-8302-d9b779f377b2 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:56.317270 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a38ab-4f56-4348-8551-59509eb4efe6 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:56.328586 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 227/438] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:35:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:35:56.335127 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbc35a-585d-4612-8302-d9b779f377b2 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:56.362142 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dbabc3-a6b7-4f1c-9b51-a5227bf790d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:56.363080 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbabc3-a6b7-4f1c-9b51-a5227bf790d7 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:56.363527 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbabc3-a6b7-4f1c-9b51-a5227bf790d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:56.363995 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbabc3-a6b7-4f1c-9b51-a5227bf790d7 None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:56.364753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dbabc3-a6b7-4f1c-9b51-a5227bf790d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:56.365064 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dbabc3-a6b7-4f1c-9b51-a5227bf790d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:56.366473 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dbabc3-a6b7-4f1c-9b51-a5227bf790d7 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:56.375766 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 212/439] 10.222.0.39 () {56 vars in 1101 bytes} [Mon May 23 15:35:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:35:56.381417 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dbabc3-a6b7-4f1c-9b51-a5227bf790d7 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:56.463880 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbc35a-585d-4612-8302-d9b779f377b2 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:56.494158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:56.513603 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86f946-d674-466c-a377-ecdc633296bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:56.514040 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86f946-d674-466c-a377-ecdc633296bd None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:56.514355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86f946-d674-466c-a377-ecdc633296bd None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:56.514639 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86f946-d674-466c-a377-ecdc633296bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:56.515141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dbabc3-a6b7-4f1c-9b51-a5227bf790d7 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:56.558919 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f94f7-fb7b-4c46-968a-6dd1395d6d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:56.560316 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f94f7-fb7b-4c46-968a-6dd1395d6d2b None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:56.560530 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f94f7-fb7b-4c46-968a-6dd1395d6d2b None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:56.560809 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f94f7-fb7b-4c46-968a-6dd1395d6d2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:56.573051 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:56.605560 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86f946-d674-466c-a377-ecdc633296bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:56.607083 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86f946-d674-466c-a377-ecdc633296bd None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:56.634545 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f94f7-fb7b-4c46-968a-6dd1395d6d2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:56.636057 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f94f7-fb7b-4c46-968a-6dd1395d6d2b None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:56.717099 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 228/440] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:35:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:35:56.718653 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc1d9f-6aa8-4737-9903-f94e9be4d73a None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:56.718940 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc1d9f-6aa8-4737-9903-f94e9be4d73a None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:56.719216 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc1d9f-6aa8-4737-9903-f94e9be4d73a None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:56.720645 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 229/441] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:35:56.724512 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc1d9f-6aa8-4737-9903-f94e9be4d73a None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:56.724958 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:56.737404 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 213/442] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:35:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:35:56.740258 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85e6c0-1c4b-47bf-92d4-9e59b5bd1203 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:56.740258 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85e6c0-1c4b-47bf-92d4-9e59b5bd1203 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:56.740258 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85e6c0-1c4b-47bf-92d4-9e59b5bd1203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:56.755289 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-9d85e6c0-1c4b-47bf-92d4-9e59b5bd1203 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:56.756508 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-9d85e6c0-1c4b-47bf-92d4-9e59b5bd1203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:56.794301 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:56.823400 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 214/443] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:35:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:35:56.824258 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85e6c0-1c4b-47bf-92d4-9e59b5bd1203 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:56.828060 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc1d9f-6aa8-4737-9903-f94e9be4d73a None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:56.862976 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b037793-8533-4bb7-9269-bf35ccdf0c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:56.863864 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b037793-8533-4bb7-9269-bf35ccdf0c08 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:56.864149 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b037793-8533-4bb7-9269-bf35ccdf0c08 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:56.864424 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b037793-8533-4bb7-9269-bf35ccdf0c08 None admin] PATH_INFO: `/v3/projects/f050448816e04bc3ace6d56d9ec83679` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:56.865599 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b037793-8533-4bb7-9269-bf35ccdf0c08 None admin] RBAC: Authorizing `identity:get_project(project_id=f050448816e04bc3ace6d56d9ec83679)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:56.867028 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b037793-8533-4bb7-9269-bf35ccdf0c08 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:56.868727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 230/444] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:56 2022] GET /identity/v3/projects/f050448816e04bc3ace6d56d9ec83679 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:56.869507 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b037793-8533-4bb7-9269-bf35ccdf0c08 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:56.934003 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85e6c0-1c4b-47bf-92d4-9e59b5bd1203 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:56.952339 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:56.966968 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b037793-8533-4bb7-9269-bf35ccdf0c08 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:56.968849 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312bca31-8248-424e-8f09-5efadfd2856b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:56.969655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312bca31-8248-424e-8f09-5efadfd2856b None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:56.969933 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312bca31-8248-424e-8f09-5efadfd2856b None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:56.970207 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312bca31-8248-424e-8f09-5efadfd2856b None admin] PATH_INFO: `/v3/projects/f050448816e04bc3ace6d56d9ec83679` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:56.971381 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312bca31-8248-424e-8f09-5efadfd2856b None admin] RBAC: Authorizing `identity:get_project(project_id=f050448816e04bc3ace6d56d9ec83679)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:56.972855 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312bca31-8248-424e-8f09-5efadfd2856b None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:56.974588 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 215/445] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:56 2022] GET /identity/v3/projects/f050448816e04bc3ace6d56d9ec83679 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:56.975278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312bca31-8248-424e-8f09-5efadfd2856b None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:57.003291 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b489bb-eddc-40bb-a09f-c81f450460e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:57.004107 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b489bb-eddc-40bb-a09f-c81f450460e1 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:57.004397 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b489bb-eddc-40bb-a09f-c81f450460e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:57.004677 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b489bb-eddc-40bb-a09f-c81f450460e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:57.012120 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:57.015289 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b489bb-eddc-40bb-a09f-c81f450460e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:35:57.022955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-28b489bb-eddc-40bb-a09f-c81f450460e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:35:57.022955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:35:57.022955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:35:57.022955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:35:57.022955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:35:57.022955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:35:57.022955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:35:57.022955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:35:57.022955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:35:57.022955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:35:57.022955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:35:57.022955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:35:57.022955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:35:57.022955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:35:57.022955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:35:57.022955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:35:57.027770 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:35:57.027770 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:35:57.027770 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:35:57.027770 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:35:57.027770 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:35:57.027770 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:35:57.027770 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:35:57.027770 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:35:57.027770 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:35:57.027770 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:35:57.027770 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:35:57.027770 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:35:57.027770 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:35:57.027770 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:35:57.027770 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:35:57.027770 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:35:57.028977 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:35:57.028977 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:35:57.028977 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:35:57.028977 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:35:57.028977 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:35:57.028977 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:35:57.028977 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:35:57.028977 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:35:57.028977 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:35:57.028977 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:35:57.028977 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:35:57.028977 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:35:57.028977 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 231/446] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:35:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:35:57.028977 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b489bb-eddc-40bb-a09f-c81f450460e1 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:57.080887 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312bca31-8248-424e-8f09-5efadfd2856b None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:57.117454 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16cc8a-2ee8-45a0-a99d-032780dfd793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:57.118295 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16cc8a-2ee8-45a0-a99d-032780dfd793 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:57.119074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16cc8a-2ee8-45a0-a99d-032780dfd793 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:57.119074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16cc8a-2ee8-45a0-a99d-032780dfd793 None admin] PATH_INFO: `/v3/groups/62b62d14c1654605893e0bd878fe71e0` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:57.120132 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16cc8a-2ee8-45a0-a99d-032780dfd793 None admin] RBAC: Authorizing `identity:get_group(group_id=62b62d14c1654605893e0bd878fe71e0)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:57.121604 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16cc8a-2ee8-45a0-a99d-032780dfd793 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:57.123575 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 216/447] 10.222.0.39 () {56 vars in 1180 bytes} [Mon May 23 15:35:56 2022] GET /identity/v3/groups/62b62d14c1654605893e0bd878fe71e0 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:57.124180 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16cc8a-2ee8-45a0-a99d-032780dfd793 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:57.130691 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b489bb-eddc-40bb-a09f-c81f450460e1 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:57.164609 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ee6f2-7a49-49a3-947a-d047c5ea718e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:57.165467 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ee6f2-7a49-49a3-947a-d047c5ea718e None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:57.165752 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ee6f2-7a49-49a3-947a-d047c5ea718e None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:57.166030 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ee6f2-7a49-49a3-947a-d047c5ea718e None admin] PATH_INFO: `/v3/groups/62b62d14c1654605893e0bd878fe71e0` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:57.167200 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ee6f2-7a49-49a3-947a-d047c5ea718e None admin] RBAC: Authorizing `identity:get_group(group_id=62b62d14c1654605893e0bd878fe71e0)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:57.169312 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ee6f2-7a49-49a3-947a-d047c5ea718e None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:57.171099 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 232/448] 10.222.0.39 () {56 vars in 1180 bytes} [Mon May 23 15:35:57 2022] GET /identity/v3/groups/62b62d14c1654605893e0bd878fe71e0 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:57.171803 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ee6f2-7a49-49a3-947a-d047c5ea718e None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:57.183394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:57.227787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16cc8a-2ee8-45a0-a99d-032780dfd793 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:57.237981 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:57.261788 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1f154-1237-481a-9789-8fdb623434d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:57.262487 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1f154-1237-481a-9789-8fdb623434d9 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:57.262773 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1f154-1237-481a-9789-8fdb623434d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:57.263138 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1f154-1237-481a-9789-8fdb623434d9 None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:57.263918 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee1f154-1237-481a-9789-8fdb623434d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:57.264224 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee1f154-1237-481a-9789-8fdb623434d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:57.265710 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee1f154-1237-481a-9789-8fdb623434d9 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:57.271496 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ee6f2-7a49-49a3-947a-d047c5ea718e None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:57.273864 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 217/449] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:35:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:57.274637 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1f154-1237-481a-9789-8fdb623434d9 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:57.310223 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec286db-6a1c-4b5f-8c2a-98d3ff9e6762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:57.310886 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec286db-6a1c-4b5f-8c2a-98d3ff9e6762 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:57.311171 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec286db-6a1c-4b5f-8c2a-98d3ff9e6762 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:57.311469 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec286db-6a1c-4b5f-8c2a-98d3ff9e6762 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:57.312331 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec286db-6a1c-4b5f-8c2a-98d3ff9e6762 None admin] RBAC: Adding query filter params (group.id=62b62d14c1654605893e0bd878fe71e0, role.id=a487e8d6e71d4a399b050274528d8db7, scope.project.id=f050448816e04bc3ace6d56d9ec83679) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:57.312651 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec286db-6a1c-4b5f-8c2a-98d3ff9e6762 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:57.314126 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec286db-6a1c-4b5f-8c2a-98d3ff9e6762 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:57.319989 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 233/450] 10.222.0.39 () {56 vars in 1376 bytes} [Mon May 23 15:35:57 2022] GET /identity/v3/role_assignments?group.id=62b62d14c1654605893e0bd878fe71e0&scope.project.id=f050448816e04bc3ace6d56d9ec83679&role.id=a487e8d6e71d4a399b050274528d8db7 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:57.320773 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec286db-6a1c-4b5f-8c2a-98d3ff9e6762 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:57.383045 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1f154-1237-481a-9789-8fdb623434d9 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:57.402523 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:57.423948 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73695a-7843-4207-afd4-89d9d0dfa588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:57.424736 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73695a-7843-4207-afd4-89d9d0dfa588 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:57.425023 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73695a-7843-4207-afd4-89d9d0dfa588 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:57.425392 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73695a-7843-4207-afd4-89d9d0dfa588 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:57.426325 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73695a-7843-4207-afd4-89d9d0dfa588 None admin] RBAC: Adding query filter params (group.id=62b62d14c1654605893e0bd878fe71e0, role.id=c41a7cd1c92b45a7bff9632d07b48006, scope.project.id=f050448816e04bc3ace6d56d9ec83679) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:57.426638 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73695a-7843-4207-afd4-89d9d0dfa588 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:57.428151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73695a-7843-4207-afd4-89d9d0dfa588 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:57.435034 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 218/451] 10.222.0.39 () {56 vars in 1376 bytes} [Mon May 23 15:35:57 2022] GET /identity/v3/role_assignments?group.id=62b62d14c1654605893e0bd878fe71e0&scope.project.id=f050448816e04bc3ace6d56d9ec83679&role.id=c41a7cd1c92b45a7bff9632d07b48006 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:57.442488 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec286db-6a1c-4b5f-8c2a-98d3ff9e6762 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:57.477319 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:57.484992 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30819f1-339d-474d-a231-e27c6edc30f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:57.485835 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30819f1-339d-474d-a231-e27c6edc30f2 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:57.486122 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30819f1-339d-474d-a231-e27c6edc30f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:57.486400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30819f1-339d-474d-a231-e27c6edc30f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:57.577228 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30819f1-339d-474d-a231-e27c6edc30f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:57.578754 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30819f1-339d-474d-a231-e27c6edc30f2 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:57.682251 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 234/452] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:35:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:35:57.688062 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73695a-7843-4207-afd4-89d9d0dfa588 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:57.793598 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73695a-7843-4207-afd4-89d9d0dfa588 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:57.830482 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49130a-f9d6-4614-9ccb-77d647e22a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:57.831347 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49130a-f9d6-4614-9ccb-77d647e22a24 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:57.831656 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49130a-f9d6-4614-9ccb-77d647e22a24 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:57.831939 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49130a-f9d6-4614-9ccb-77d647e22a24 None admin] PATH_INFO: `/v3/projects/c760023a56dc4c499f942685a1652dbf` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:57.833129 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49130a-f9d6-4614-9ccb-77d647e22a24 None admin] RBAC: Authorizing `identity:get_project(project_id=c760023a56dc4c499f942685a1652dbf)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:57.834590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49130a-f9d6-4614-9ccb-77d647e22a24 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:57.836492 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 219/453] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:35:57 2022] GET /identity/v3/projects/c760023a56dc4c499f942685a1652dbf => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:57.842667 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30819f1-339d-474d-a231-e27c6edc30f2 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:57.874905 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:57.945369 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30819f1-339d-474d-a231-e27c6edc30f2 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:57.979980 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31c6ab-056b-4b56-a322-e9452860cb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:57.980818 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31c6ab-056b-4b56-a322-e9452860cb5e None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:57.981674 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31c6ab-056b-4b56-a322-e9452860cb5e None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:57.982278 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31c6ab-056b-4b56-a322-e9452860cb5e None admin] PATH_INFO: `/v3/groups/b4a3a438bf674f5e9c1fb3a45785a2cc` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:57.983271 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc31c6ab-056b-4b56-a322-e9452860cb5e None admin] RBAC: Authorizing `identity:get_group(group_id=b4a3a438bf674f5e9c1fb3a45785a2cc)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:57.984782 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc31c6ab-056b-4b56-a322-e9452860cb5e None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:57.986628 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 235/454] 10.222.0.39 () {56 vars in 1180 bytes} [Mon May 23 15:35:57 2022] GET /identity/v3/groups/b4a3a438bf674f5e9c1fb3a45785a2cc => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:35:57.992431 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49130a-f9d6-4614-9ccb-77d647e22a24 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:58.042207 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:58.093623 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49130a-f9d6-4614-9ccb-77d647e22a24 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:58.127062 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ef281-a0f4-42f7-a423-2ffa0e5339aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:58.127727 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ef281-a0f4-42f7-a423-2ffa0e5339aa None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:58.128016 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ef281-a0f4-42f7-a423-2ffa0e5339aa None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:58.128297 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ef281-a0f4-42f7-a423-2ffa0e5339aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:58.129127 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ef281-a0f4-42f7-a423-2ffa0e5339aa None admin] RBAC: Adding query filter params (group.id=b4a3a438bf674f5e9c1fb3a45785a2cc, role.id=3ab888f5f68740bd8f9df4447f4f5a7a, scope.project.id=c760023a56dc4c499f942685a1652dbf) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:35:58.129447 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ef281-a0f4-42f7-a423-2ffa0e5339aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:58.130913 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ef281-a0f4-42f7-a423-2ffa0e5339aa None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:58.136629 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 220/455] 10.222.0.39 () {56 vars in 1376 bytes} [Mon May 23 15:35:57 2022] GET /identity/v3/role_assignments?group.id=b4a3a438bf674f5e9c1fb3a45785a2cc&scope.project.id=c760023a56dc4c499f942685a1652dbf&role.id=3ab888f5f68740bd8f9df4447f4f5a7a => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:00.868865 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b059343-62de-46dd-9154-031b4bd7b556 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:00.869389 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b059343-62de-46dd-9154-031b4bd7b556 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:00.869389 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b059343-62de-46dd-9154-031b4bd7b556 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:00.871121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 236/456] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:00.877209 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a724c-0f4e-40f5-9eb5-18b7291646b5 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:00.877694 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a724c-0f4e-40f5-9eb5-18b7291646b5 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:00.877768 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a724c-0f4e-40f5-9eb5-18b7291646b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:00.900602 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-a22a724c-0f4e-40f5-9eb5-18b7291646b5 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:00.901806 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-a22a724c-0f4e-40f5-9eb5-18b7291646b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:00.956553 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a8181-6eca-4b8d-a0f8-7dd978361400 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:00.956834 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a8181-6eca-4b8d-a0f8-7dd978361400 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:00.957280 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a8181-6eca-4b8d-a0f8-7dd978361400 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:00.959173 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 237/457] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:00.985680 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6448400-8bc8-4200-a2d3-412f89da0acd None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:00.986351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6448400-8bc8-4200-a2d3-412f89da0acd None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:00.986846 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6448400-8bc8-4200-a2d3-412f89da0acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:00.991195 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 221/458] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:36:01.015720 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a724c-0f4e-40f5-9eb5-18b7291646b5 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:01.024639 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-b6448400-8bc8-4200-a2d3-412f89da0acd None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:01.025852 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-b6448400-8bc8-4200-a2d3-412f89da0acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:01.062625 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:01.124958 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a724c-0f4e-40f5-9eb5-18b7291646b5 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:01.155548 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 238/459] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 23 15:36:01.157260 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c1261-e37d-4e05-b336-545dd4ee02ee None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:01.157765 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c1261-e37d-4e05-b336-545dd4ee02ee None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:01.158234 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c1261-e37d-4e05-b336-545dd4ee02ee None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:01.163749 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 239/460] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:01.165125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57668a-4d05-4025-a2c0-15515200336b None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:01.165630 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57668a-4d05-4025-a2c0-15515200336b None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:01.166114 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57668a-4d05-4025-a2c0-15515200336b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:01.169277 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96742ff-3e95-42f1-9fab-b179c002765d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:01.170477 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96742ff-3e95-42f1-9fab-b179c002765d None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:01.171049 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96742ff-3e95-42f1-9fab-b179c002765d None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:01.171591 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96742ff-3e95-42f1-9fab-b179c002765d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:01.183376 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96742ff-3e95-42f1-9fab-b179c002765d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:01.185881 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96742ff-3e95-42f1-9fab-b179c002765d None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:01.203502 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-de57668a-4d05-4025-a2c0-15515200336b None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:01.204750 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-de57668a-4d05-4025-a2c0-15515200336b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:01.216156 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-e96742ff-3e95-42f1-9fab-b179c002765d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:01.216156 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:01.216156 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:01.216156 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:01.216156 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:01.216156 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:01.216156 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:01.216156 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:01.216156 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:01.216156 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:01.216156 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:01.216156 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:01.216156 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:01.216156 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:01.216156 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:01.217014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:01.217014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:01.217014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:01.217014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:01.217014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:01.217014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:01.217014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:01.217014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:01.217014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:01.217014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:01.217014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:01.217014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:01.217014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:01.217014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:01.217014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:01.217014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:01.217014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:01.217848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:01.217848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:01.217848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:01.217848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:01.217848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 222/461] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:36:01.218567 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96742ff-3e95-42f1-9fab-b179c002765d None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:01.239460 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:01.307629 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 240/462] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:36:01.307629 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57668a-4d05-4025-a2c0-15515200336b None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:01.353437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:01.361009 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96742ff-3e95-42f1-9fab-b179c002765d None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:01.408888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb4a16-7a14-41e7-9d3e-e4b50509350a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:01.410125 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb4a16-7a14-41e7-9d3e-e4b50509350a None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:01.410419 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb4a16-7a14-41e7-9d3e-e4b50509350a None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:01.410694 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb4a16-7a14-41e7-9d3e-e4b50509350a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:01.424803 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb4a16-7a14-41e7-9d3e-e4b50509350a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:01.426006 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57668a-4d05-4025-a2c0-15515200336b None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:01.426759 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb4a16-7a14-41e7-9d3e-e4b50509350a None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:01.444939 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-b7bb4a16-7a14-41e7-9d3e-e4b50509350a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:01.444939 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:01.444939 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:01.444939 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:01.444939 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:01.444939 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:01.444939 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:01.444939 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:01.444939 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:01.444939 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:01.444939 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:01.444939 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:01.444939 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:01.444939 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:01.444939 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:01.445824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:01.445824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:01.445824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:01.445824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:01.445824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:01.445824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:01.445824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:01.445824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:01.445824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:01.445824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:01.445824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:01.445824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:01.445824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:01.445824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:01.445824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:01.445824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:01.445824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:01.446645 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:01.446645 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:01.446645 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:01.446645 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:01.448571 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 223/463] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:01.454779 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb4a16-7a14-41e7-9d3e-e4b50509350a None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:01.467005 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6844f7-49f4-4edd-8513-e945488530b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:01.468110 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6844f7-49f4-4edd-8513-e945488530b0 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:01.468408 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6844f7-49f4-4edd-8513-e945488530b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:01.468690 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6844f7-49f4-4edd-8513-e945488530b0 None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:01.469534 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6844f7-49f4-4edd-8513-e945488530b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:01.470112 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6844f7-49f4-4edd-8513-e945488530b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:01.471663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6844f7-49f4-4edd-8513-e945488530b0 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:01.486991 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 241/464] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:01.488134 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6844f7-49f4-4edd-8513-e945488530b0 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:01.509672 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:01.586108 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb4a16-7a14-41e7-9d3e-e4b50509350a None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:01.600582 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6844f7-49f4-4edd-8513-e945488530b0 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:01.625710 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12a488-e4d9-45ab-92a5-c9f3062f5262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:01.626522 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12a488-e4d9-45ab-92a5-c9f3062f5262 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:01.626833 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12a488-e4d9-45ab-92a5-c9f3062f5262 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:01.627365 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12a488-e4d9-45ab-92a5-c9f3062f5262 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:01.638543 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc189a-0707-48be-bfe0-07d5c0421fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:01.639171 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12a488-e4d9-45ab-92a5-c9f3062f5262 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:01.639805 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc189a-0707-48be-bfe0-07d5c0421fea None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:01.640282 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc189a-0707-48be-bfe0-07d5c0421fea None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:01.640697 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12a488-e4d9-45ab-92a5-c9f3062f5262 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:01.640979 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc189a-0707-48be-bfe0-07d5c0421fea None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:01.641887 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc189a-0707-48be-bfe0-07d5c0421fea None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:01.642384 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc189a-0707-48be-bfe0-07d5c0421fea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:01.643979 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc189a-0707-48be-bfe0-07d5c0421fea None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:01.648063 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:01.667290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-af12a488-e4d9-45ab-92a5-c9f3062f5262 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:01.667290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:01.667290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:01.667290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:01.667290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:01.667290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:01.667290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:01.667290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:01.667290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:01.667290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:01.667290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:01.667290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:01.667290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:01.667290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:01.667290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:01.668359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:01.668359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:01.668359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:01.668359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:01.668359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:01.668359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:01.668359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:01.668359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:01.668359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:01.668359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:01.668359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:01.668359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:01.668359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:01.668359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:01.668359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:01.668359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:01.668359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:01.669269 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:01.669269 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:01.669269 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:01.669269 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:01.669474 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 242/466] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:01.669474 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc189a-0707-48be-bfe0-07d5c0421fea None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:01.669630 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 224/466] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:01.669630 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12a488-e4d9-45ab-92a5-c9f3062f5262 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:01.748591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:01.769883 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc189a-0707-48be-bfe0-07d5c0421fea None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:01.776999 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12a488-e4d9-45ab-92a5-c9f3062f5262 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:01.806040 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5c98d-6170-46a4-b156-0565a6588ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:01.806706 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5c98d-6170-46a4-b156-0565a6588ecc None admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:01.806989 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5c98d-6170-46a4-b156-0565a6588ecc None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:01.807266 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5c98d-6170-46a4-b156-0565a6588ecc None admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:01.808003 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5c98d-6170-46a4-b156-0565a6588ecc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:01.809437 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5c98d-6170-46a4-b156-0565a6588ecc None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:01.813057 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4aa52-21ed-4c22-9038-1afb65c82aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:01.813726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4aa52-21ed-4c22-9038-1afb65c82aa6 None admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:01.814010 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4aa52-21ed-4c22-9038-1afb65c82aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:01.814286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4aa52-21ed-4c22-9038-1afb65c82aa6 None admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:01.814993 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4aa52-21ed-4c22-9038-1afb65c82aa6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:01.816461 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4aa52-21ed-4c22-9038-1afb65c82aa6 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:01.915089 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 243/467] 10.222.0.39 () {60 vars in 1132 bytes} [Mon May 23 15:36:01 2022] POST /identity/v3/users => generated 246 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:36:01.916075 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5c98d-6170-46a4-b156-0565a6588ecc None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:01.945356 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 225/468] 10.222.0.39 () {60 vars in 1132 bytes} [Mon May 23 15:36:01 2022] POST /identity/v3/users => generated 248 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:36:01.947655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86750f7-5165-4a77-9a5d-78555e2ede70 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:01.948219 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86750f7-5165-4a77-9a5d-78555e2ede70 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:01.948767 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86750f7-5165-4a77-9a5d-78555e2ede70 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:01.951326 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 226/469] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:01.958667 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c1c71-5cd7-4d66-911e-d38e8c492083 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:01.959938 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c1c71-5cd7-4d66-911e-d38e8c492083 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:01.960734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c1c71-5cd7-4d66-911e-d38e8c492083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:01.985320 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-bb4c1c71-5cd7-4d66-911e-d38e8c492083 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:01.987825 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-bb4c1c71-5cd7-4d66-911e-d38e8c492083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:02.057035 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5c98d-6170-46a4-b156-0565a6588ecc None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:02.061513 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:02.087747 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 227/470] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:36:02.102690 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474e911-66c3-4ff8-b018-5904add3df2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:02.103431 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474e911-66c3-4ff8-b018-5904add3df2a None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:02.103755 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474e911-66c3-4ff8-b018-5904add3df2a None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:02.104042 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474e911-66c3-4ff8-b018-5904add3df2a None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:02.104785 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1474e911-66c3-4ff8-b018-5904add3df2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:02.105130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1474e911-66c3-4ff8-b018-5904add3df2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:02.106572 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1474e911-66c3-4ff8-b018-5904add3df2a None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:02.108434 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:02.114916 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c1c71-5cd7-4d66-911e-d38e8c492083 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:02.123555 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 244/471] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:02.129309 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487ce89-2a53-498c-9d2c-3e3c2e7d57f8 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:02.129649 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487ce89-2a53-498c-9d2c-3e3c2e7d57f8 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:02.129864 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487ce89-2a53-498c-9d2c-3e3c2e7d57f8 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:02.131530 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 245/472] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:02.136452 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487ce89-2a53-498c-9d2c-3e3c2e7d57f8 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:02.262516 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487ce89-2a53-498c-9d2c-3e3c2e7d57f8 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:02.272242 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c1c71-5cd7-4d66-911e-d38e8c492083 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:02.314627 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77ec68-0863-46c6-a010-cc4773b00718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:02.315706 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77ec68-0863-46c6-a010-cc4773b00718 None admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:02.316199 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77ec68-0863-46c6-a010-cc4773b00718 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:02.316718 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77ec68-0863-46c6-a010-cc4773b00718 None admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:02.317605 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77ec68-0863-46c6-a010-cc4773b00718 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:02.318439 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23213687-36d1-477d-9cab-41cdfd371876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:02.319084 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77ec68-0863-46c6-a010-cc4773b00718 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:02.319241 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23213687-36d1-477d-9cab-41cdfd371876 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:02.319512 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23213687-36d1-477d-9cab-41cdfd371876 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:02.319829 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23213687-36d1-477d-9cab-41cdfd371876 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:02.332557 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23213687-36d1-477d-9cab-41cdfd371876 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:02.334202 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23213687-36d1-477d-9cab-41cdfd371876 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:02.352943 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-23213687-36d1-477d-9cab-41cdfd371876 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:02.352943 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:02.352943 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:02.352943 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:02.352943 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:02.352943 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:02.352943 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:02.352943 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:02.352943 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:02.352943 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:02.352943 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:02.352943 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:02.352943 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:02.352943 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:02.352943 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:02.353832 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:02.353832 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:02.353832 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:02.353832 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:02.353832 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:02.353832 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:02.353832 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:02.353832 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:02.353832 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:02.353832 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:02.353832 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:02.353832 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:02.353832 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:02.353832 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:02.353832 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:02.353832 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:02.353832 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:02.354664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:02.354664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:02.354664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:02.354664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:02.354664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 228/473] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:02.363085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9c801-c9d2-406c-8bc7-0e6887e6d2aa None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:02.363085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9c801-c9d2-406c-8bc7-0e6887e6d2aa None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:02.363085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9c801-c9d2-406c-8bc7-0e6887e6d2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:02.381878 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-3be9c801-c9d2-406c-8bc7-0e6887e6d2aa None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:02.383086 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-3be9c801-c9d2-406c-8bc7-0e6887e6d2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:02.413782 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:02.435962 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 246/474] 10.222.0.39 () {60 vars in 1132 bytes} [Mon May 23 15:36:02 2022] POST /identity/v3/users => generated 248 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:36:02.437539 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77ec68-0863-46c6-a010-cc4773b00718 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:02.456260 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 229/475] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:36:02.494252 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9c801-c9d2-406c-8bc7-0e6887e6d2aa None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:02.510768 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:02.575014 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77ec68-0863-46c6-a010-cc4773b00718 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:02.622207 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d2585-3011-4405-8564-40eefc90eb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:02.623138 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d2585-3011-4405-8564-40eefc90eb89 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:02.623567 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d2585-3011-4405-8564-40eefc90eb89 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:02.624008 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d2585-3011-4405-8564-40eefc90eb89 None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:02.625055 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d2585-3011-4405-8564-40eefc90eb89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:02.625654 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d2585-3011-4405-8564-40eefc90eb89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:02.627558 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d2585-3011-4405-8564-40eefc90eb89 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:02.643878 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 247/476] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:02.649686 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d2585-3011-4405-8564-40eefc90eb89 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:02.705894 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9c801-c9d2-406c-8bc7-0e6887e6d2aa None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:02.746433 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be4a00-8156-4536-b477-0f3f6037bcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:02.747523 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be4a00-8156-4536-b477-0f3f6037bcdd None admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:02.747845 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be4a00-8156-4536-b477-0f3f6037bcdd None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:02.748118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be4a00-8156-4536-b477-0f3f6037bcdd None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:02.749008 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be4a00-8156-4536-b477-0f3f6037bcdd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:02.750383 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be4a00-8156-4536-b477-0f3f6037bcdd None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:02.788889 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.sql.core [None req-b6be4a00-8156-4536-b477-0f3f6037bcdd None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 23 15:36:02.788889 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 23 15:36:02.788889 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [parameters: {'id': 'fb4b1e417a95450f8fc2193e958dad6c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 23 15:36:02.788889 dv-cinder-842119-2-smb devstack@keystone.service[87192]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87192) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 23 15:36:02.795473 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d2585-3011-4405-8564-40eefc90eb89 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:02.805899 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-b6be4a00-8156-4536-b477-0f3f6037bcdd None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 23 15:36:02.805899 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:02.805899 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 15:36:02.805899 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 15:36:02.805899 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 15:36:02.805899 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 15:36:02.805899 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 15:36:02.805899 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application result = self._query(query) May 23 15:36:02.805899 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 15:36:02.805899 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application conn.query(q) May 23 15:36:02.805899 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 15:36:02.805899 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 15:36:02.805899 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 15:36:02.805899 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application result.read() May 23 15:36:02.805899 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 15:36:02.806811 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 15:36:02.806811 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 15:36:02.806811 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 15:36:02.806811 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 15:36:02.806811 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 15:36:02.806811 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 15:36:02.806811 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 15:36:02.806811 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 23 15:36:02.806811 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:02.806811 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 23 15:36:02.806811 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:02.806811 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:02.806811 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 23 15:36:02.806811 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 23 15:36:02.806811 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 23 15:36:02.806811 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return ref.to_dict() May 23 15:36:02.806811 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 15:36:02.806811 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application next(self.gen) May 23 15:36:02.807720 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 23 15:36:02.807720 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application yield resource May 23 15:36:02.807720 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 15:36:02.807720 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application next(self.gen) May 23 15:36:02.807720 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 23 15:36:02.807720 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self.session.rollback() May 23 15:36:02.807720 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 23 15:36:02.807720 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self.force_reraise() May 23 15:36:02.807720 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 23 15:36:02.807720 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise self.value May 23 15:36:02.807720 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 23 15:36:02.807720 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 23 15:36:02.807720 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 23 15:36:02.807720 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application session.commit() May 23 15:36:02.807720 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 23 15:36:02.807720 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 23 15:36:02.807720 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 23 15:36:02.808580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self._prepare_impl() May 23 15:36:02.808580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 23 15:36:02.808580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self.session.flush() May 23 15:36:02.808580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 23 15:36:02.808580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self._flush(objects) May 23 15:36:02.808580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 23 15:36:02.808580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 23 15:36:02.808580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 23 15:36:02.808580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application compat.raise_( May 23 15:36:02.808580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 15:36:02.808580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception May 23 15:36:02.808580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 23 15:36:02.808580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application flush_context.execute() May 23 15:36:02.808580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 23 15:36:02.808580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rec.execute(self) May 23 15:36:02.808580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 23 15:36:02.808580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 23 15:36:02.809456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 23 15:36:02.809456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application _emit_insert_statements( May 23 15:36:02.809456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 23 15:36:02.809456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application c = connection._execute_20( May 23 15:36:02.809456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 23 15:36:02.809456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 23 15:36:02.809456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 23 15:36:02.809456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 23 15:36:02.809456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 23 15:36:02.809456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ret = self._execute_context( May 23 15:36:02.809456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 23 15:36:02.809456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 23 15:36:02.809456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 23 15:36:02.809456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 23 15:36:02.809456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 15:36:02.809456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception May 23 15:36:02.810786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 15:36:02.810786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 15:36:02.810786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 15:36:02.810786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 15:36:02.810786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 15:36:02.810786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application result = self._query(query) May 23 15:36:02.810786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 15:36:02.810786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application conn.query(q) May 23 15:36:02.810786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 15:36:02.810786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 15:36:02.810786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 15:36:02.810786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application result.read() May 23 15:36:02.810786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 15:36:02.810786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 15:36:02.810786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 15:36:02.810786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 15:36:02.811559 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 15:36:02.811559 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 15:36:02.811559 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 15:36:02.811559 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 15:36:02.811559 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 23 15:36:02.811559 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 23 15:36:02.811559 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [parameters: {'id': 'fb4b1e417a95450f8fc2193e958dad6c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 23 15:36:02.811559 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 23 15:36:02.811559 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:02.811559 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:36:02.811559 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:02.811559 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:02.811559 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:02.811559 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:02.811559 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:02.811559 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:02.814796 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:02.814796 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:02.814796 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:02.814796 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:02.814796 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:02.814796 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:02.814796 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 23 15:36:02.814796 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 23 15:36:02.814796 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:02.814796 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:02.814796 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 23 15:36:02.814796 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 23 15:36:02.814796 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 23 15:36:02.814796 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 23 15:36:02.814796 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 23 15:36:02.814796 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:02.816943 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:02.817017 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 230/477] 10.222.0.39 () {60 vars in 1131 bytes} [Mon May 23 15:36:02 2022] POST /identity/v3/roles => generated 144 bytes in 321 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 23 15:36:02.817017 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be4a00-8156-4536-b477-0f3f6037bcdd None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:02.845030 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f52b9-e801-4aee-a5fe-151f10118913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:02.846105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f52b9-e801-4aee-a5fe-151f10118913 None admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:02.846389 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f52b9-e801-4aee-a5fe-151f10118913 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:02.846744 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f52b9-e801-4aee-a5fe-151f10118913 None admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:02.847615 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f52b9-e801-4aee-a5fe-151f10118913 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:02.849739 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f52b9-e801-4aee-a5fe-151f10118913 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:02.862164 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:02.935389 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 248/478] 10.222.0.39 () {60 vars in 1132 bytes} [Mon May 23 15:36:02 2022] POST /identity/v3/users => generated 249 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:36:02.944030 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be4a00-8156-4536-b477-0f3f6037bcdd None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:02.997385 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110730b-9bad-4d80-8833-b3aa3f0ab904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:03.003135 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110730b-9bad-4d80-8833-b3aa3f0ab904 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:03.003680 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110730b-9bad-4d80-8833-b3aa3f0ab904 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:03.004110 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110730b-9bad-4d80-8833-b3aa3f0ab904 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:03.017601 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f110730b-9bad-4d80-8833-b3aa3f0ab904 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:36:03.026357 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-f110730b-9bad-4d80-8833-b3aa3f0ab904 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:36:03.026357 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:03.026357 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:03.026357 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:03.026357 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:03.026357 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:03.026357 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:03.026357 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:03.026357 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:03.026357 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:03.026357 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:03.026357 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:03.026357 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:36:03.026357 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:36:03.026357 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:36:03.026357 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:36:03.027519 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:36:03.027519 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:36:03.027519 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:36:03.027519 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:36:03.027519 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:03.027519 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:03.027519 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:03.027519 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:03.027519 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:03.027519 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:03.027519 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:03.027519 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:03.027519 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:03.027519 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:03.027519 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:03.027519 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:03.028605 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:03.028605 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:03.028605 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:03.028605 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:03.028605 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:36:03.028605 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:36:03.028605 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:36:03.028605 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:36:03.028605 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:36:03.028605 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:36:03.028605 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:36:03.028605 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:03.031241 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 231/479] 10.222.0.39 () {56 vars in 1114 bytes} [Mon May 23 15:36:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:03.039748 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f52b9-e801-4aee-a5fe-151f10118913 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:03.181208 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f52b9-e801-4aee-a5fe-151f10118913 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:03.227219 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c6e76-700f-4972-a6e8-8b1a9cd37deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:03.228187 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c6e76-700f-4972-a6e8-8b1a9cd37deb None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:03.228623 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c6e76-700f-4972-a6e8-8b1a9cd37deb None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:03.229064 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c6e76-700f-4972-a6e8-8b1a9cd37deb None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:03.229961 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8c6e76-700f-4972-a6e8-8b1a9cd37deb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:03.230422 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8c6e76-700f-4972-a6e8-8b1a9cd37deb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:03.232689 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8c6e76-700f-4972-a6e8-8b1a9cd37deb None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:03.241985 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 249/480] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:36:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:04.632014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c4858-1fae-4028-8e7b-106586fdfd8b None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:04.632565 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c4858-1fae-4028-8e7b-106586fdfd8b None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:04.632565 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c4858-1fae-4028-8e7b-106586fdfd8b None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:04.634205 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 232/481] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:04.639668 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd818d-9931-40bb-a8d0-3b37fa2fc3ad None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:04.640069 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd818d-9931-40bb-a8d0-3b37fa2fc3ad None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:04.640238 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd818d-9931-40bb-a8d0-3b37fa2fc3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:04.661670 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-f7cd818d-9931-40bb-a8d0-3b37fa2fc3ad None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:04.663001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-f7cd818d-9931-40bb-a8d0-3b37fa2fc3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:04.698346 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1d944-57bf-49a2-99b0-c9e9e22dbf74 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:04.698961 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1d944-57bf-49a2-99b0-c9e9e22dbf74 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:04.699446 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:04.699969 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1d944-57bf-49a2-99b0-c9e9e22dbf74 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:04.703972 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 233/482] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:04.708434 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc224755-9fdf-4c3e-b34e-2a96d2f0cbde None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:04.708956 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc224755-9fdf-4c3e-b34e-2a96d2f0cbde None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:04.709435 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc224755-9fdf-4c3e-b34e-2a96d2f0cbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:04.738523 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-fc224755-9fdf-4c3e-b34e-2a96d2f0cbde None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:04.743429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-fc224755-9fdf-4c3e-b34e-2a96d2f0cbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:04.788777 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 250/483] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:36:04.830243 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd818d-9931-40bb-a8d0-3b37fa2fc3ad None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:04.867785 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 234/484] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:36:04.918220 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc224755-9fdf-4c3e-b34e-2a96d2f0cbde None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:04.943224 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:05.037585 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc224755-9fdf-4c3e-b34e-2a96d2f0cbde None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:05.053827 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd818d-9931-40bb-a8d0-3b37fa2fc3ad None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:05.084978 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307e18c-0b5b-4434-a281-92beb5035c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:05.085785 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307e18c-0b5b-4434-a281-92beb5035c87 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:05.086074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307e18c-0b5b-4434-a281-92beb5035c87 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:05.086352 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307e18c-0b5b-4434-a281-92beb5035c87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:05.115193 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307e18c-0b5b-4434-a281-92beb5035c87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:36:05.121639 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e04356-30c8-4f61-8214-413b549061d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:05.123554 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e04356-30c8-4f61-8214-413b549061d3 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:05.124525 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e04356-30c8-4f61-8214-413b549061d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:05.124525 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e04356-30c8-4f61-8214-413b549061d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:05.133085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-d307e18c-0b5b-4434-a281-92beb5035c87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:05.133085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:05.133085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:05.133085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:05.133085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:05.133085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:05.133085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:05.133085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:05.133085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:05.133085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:05.133085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:05.133085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:05.133085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:36:05.133085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:36:05.133085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:36:05.133085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:36:05.134023 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:36:05.134023 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:36:05.134023 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:36:05.134023 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:36:05.134023 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:05.134023 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:05.134023 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:05.134023 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:05.134023 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:05.134023 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:05.134023 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:05.134023 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:05.134023 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:05.134023 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:05.134023 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:05.134023 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:05.134814 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:05.134814 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:05.134814 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:05.134814 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:05.134814 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:36:05.134814 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:36:05.134814 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:36:05.134814 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:36:05.134814 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:36:05.134814 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:36:05.134814 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:05.134814 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:05.136524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 235/485] 10.222.0.39 () {56 vars in 1102 bytes} [Mon May 23 15:36:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:36:05.141429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307e18c-0b5b-4434-a281-92beb5035c87 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:05.143032 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e04356-30c8-4f61-8214-413b549061d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:36:05.150854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-98e04356-30c8-4f61-8214-413b549061d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:05.150854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:05.150854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:05.150854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:05.150854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:05.150854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:05.150854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:05.150854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:05.150854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:05.150854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:05.150854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:05.150854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:05.150854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:36:05.150854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:36:05.150854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:36:05.150854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:36:05.151730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:36:05.151730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:36:05.151730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:36:05.151730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:36:05.151730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:05.151730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:05.151730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:05.151730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:05.151730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:05.151730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:05.151730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:05.151730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:05.151730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:05.151730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:05.151730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:05.151730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:05.152532 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:05.152532 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:05.152532 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:05.152532 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:05.152532 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:36:05.152532 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:36:05.152532 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:36:05.152532 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:36:05.152532 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:36:05.152532 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:36:05.152532 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:05.152532 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:05.154924 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 251/486] 10.222.0.39 () {56 vars in 1102 bytes} [Mon May 23 15:36:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:36:05.170826 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e04356-30c8-4f61-8214-413b549061d3 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:05.219305 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:05.288788 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:05.330315 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307e18c-0b5b-4434-a281-92beb5035c87 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:05.345517 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e04356-30c8-4f61-8214-413b549061d3 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:05.377048 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0333eca-30d6-4f15-979a-e7088438e55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:05.377716 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0333eca-30d6-4f15-979a-e7088438e55b None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:05.377997 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0333eca-30d6-4f15-979a-e7088438e55b None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:05.378272 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0333eca-30d6-4f15-979a-e7088438e55b None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:05.379019 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0333eca-30d6-4f15-979a-e7088438e55b None admin] RBAC: Adding query filter params (name=service) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:05.379324 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0333eca-30d6-4f15-979a-e7088438e55b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:05.380757 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0333eca-30d6-4f15-979a-e7088438e55b None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:05.386391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13d815-2fbd-4c8f-94d7-26b3756e3996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:05.387057 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13d815-2fbd-4c8f-94d7-26b3756e3996 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:05.387343 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13d815-2fbd-4c8f-94d7-26b3756e3996 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:05.388236 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13d815-2fbd-4c8f-94d7-26b3756e3996 None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:05.388994 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13d815-2fbd-4c8f-94d7-26b3756e3996 None admin] RBAC: Adding query filter params (name=service) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:05.389304 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13d815-2fbd-4c8f-94d7-26b3756e3996 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:05.390110 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 236/487] 10.222.0.39 () {56 vars in 1103 bytes} [Mon May 23 15:36:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:05.390781 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13d815-2fbd-4c8f-94d7-26b3756e3996 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:05.391402 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ba986-ca41-42c7-a35c-c4104170101c None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:05.391735 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ba986-ca41-42c7-a35c-c4104170101c None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:05.392011 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ba986-ca41-42c7-a35c-c4104170101c None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:05.393469 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 237/488] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:05.399416 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ba986-ca41-42c7-a35c-c4104170101c None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:05.403471 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 252/489] 10.222.0.39 () {56 vars in 1103 bytes} [Mon May 23 15:36:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:05.404925 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08dd01-c189-4eb9-be50-8b16c11afe32 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:05.405224 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08dd01-c189-4eb9-be50-8b16c11afe32 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:05.405501 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08dd01-c189-4eb9-be50-8b16c11afe32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:05.423777 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-7a08dd01-c189-4eb9-be50-8b16c11afe32 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:05.424890 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-7a08dd01-c189-4eb9-be50-8b16c11afe32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:05.503994 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 253/490] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:36:05.504940 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ba986-ca41-42c7-a35c-c4104170101c None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:05.505057 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08dd01-c189-4eb9-be50-8b16c11afe32 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:05.529809 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:05.542453 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eab236-d210-4a90-ba6f-234e27a9d3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:05.543340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eab236-d210-4a90-ba6f-234e27a9d3a3 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:05.543838 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eab236-d210-4a90-ba6f-234e27a9d3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:05.544716 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eab236-d210-4a90-ba6f-234e27a9d3a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:05.556184 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eab236-d210-4a90-ba6f-234e27a9d3a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:05.557699 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eab236-d210-4a90-ba6f-234e27a9d3a3 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:05.560756 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:05.578391 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-d5eab236-d210-4a90-ba6f-234e27a9d3a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:05.578391 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:05.578391 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:05.578391 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:05.578391 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:05.578391 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:05.578391 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:05.578391 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:05.578391 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:05.578391 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:05.578391 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:05.578391 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:05.578391 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:05.578391 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:05.578391 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:05.579296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:05.579296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:05.579296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:05.579296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:05.579296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:05.579296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:05.579296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:05.579296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:05.579296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:05.579296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:05.579296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:05.579296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:05.579296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:05.579296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:05.579296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:05.579296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:05.579296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:05.580397 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:05.580397 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:05.580397 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:05.580397 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:05.580397 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 238/491] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:05.581177 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eab236-d210-4a90-ba6f-234e27a9d3a3 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:05.634005 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08dd01-c189-4eb9-be50-8b16c11afe32 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:05.672327 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096988f-29de-48f2-ab79-51758562c7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:05.673126 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096988f-29de-48f2-ab79-51758562c7d1 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:05.673412 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096988f-29de-48f2-ab79-51758562c7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:05.673687 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096988f-29de-48f2-ab79-51758562c7d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:05.685222 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096988f-29de-48f2-ab79-51758562c7d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:05.686610 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096988f-29de-48f2-ab79-51758562c7d1 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:05.691114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eab236-d210-4a90-ba6f-234e27a9d3a3 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:05.707073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-c096988f-29de-48f2-ab79-51758562c7d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:05.707073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:05.707073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:05.707073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:05.707073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:05.707073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:05.707073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:05.707073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:05.707073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:05.707073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:05.707073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:05.707073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:05.707073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:05.707073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:05.707073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:05.709081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:05.709081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:05.709081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:05.709081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:05.709081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:05.709081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:05.709081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:05.709081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:05.709081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:05.709081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:05.709081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:05.709081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:05.709081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:05.709081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:05.709081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:05.709081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:05.709081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:05.711407 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:05.711407 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:05.711407 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:05.711407 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:05.711407 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 254/492] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:05.711407 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096988f-29de-48f2-ab79-51758562c7d1 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:05.728137 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4c05d-96e4-4139-b0b5-a8246461dc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:05.729013 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4c05d-96e4-4139-b0b5-a8246461dc36 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:05.729292 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4c05d-96e4-4139-b0b5-a8246461dc36 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:05.729563 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4c05d-96e4-4139-b0b5-a8246461dc36 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:05.745082 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4c05d-96e4-4139-b0b5-a8246461dc36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:36:05.753983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-49b4c05d-96e4-4139-b0b5-a8246461dc36 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:05.753983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:05.753983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:05.753983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:05.753983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:05.753983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:05.753983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:05.753983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:05.753983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:05.753983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:05.753983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:05.753983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:05.753983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:36:05.753983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:36:05.753983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:36:05.753983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:36:05.756234 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:36:05.756234 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:36:05.756234 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:36:05.756234 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:36:05.756234 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:05.756234 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:05.756234 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:05.756234 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:05.756234 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:05.756234 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:05.756234 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:05.756234 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:05.756234 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:05.756234 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:05.756234 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:05.756234 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:05.758454 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:05.758454 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:05.758454 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:05.758454 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:05.758454 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:36:05.758454 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:36:05.758454 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:36:05.758454 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:36:05.758454 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:36:05.758454 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:36:05.758454 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:05.758454 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:05.758454 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 239/493] 10.222.0.39 () {56 vars in 1102 bytes} [Mon May 23 15:36:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:05.758454 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4c05d-96e4-4139-b0b5-a8246461dc36 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:05.785289 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:05.817151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:05.829023 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096988f-29de-48f2-ab79-51758562c7d1 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:05.868829 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee25a8-5417-4c27-8048-d7cac64c4ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:05.869514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee25a8-5417-4c27-8048-d7cac64c4ada None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:05.869798 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee25a8-5417-4c27-8048-d7cac64c4ada None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:05.870075 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee25a8-5417-4c27-8048-d7cac64c4ada None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:05.870821 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee25a8-5417-4c27-8048-d7cac64c4ada None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:05.871136 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee25a8-5417-4c27-8048-d7cac64c4ada None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:05.871713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4c05d-96e4-4139-b0b5-a8246461dc36 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:05.873457 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee25a8-5417-4c27-8048-d7cac64c4ada None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:05.886969 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 255/494] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:05.888172 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee25a8-5417-4c27-8048-d7cac64c4ada None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:05.911060 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19f5a0-8eb8-4153-b028-ab56b69e9c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:05.912140 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19f5a0-8eb8-4153-b028-ab56b69e9c59 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:05.912599 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19f5a0-8eb8-4153-b028-ab56b69e9c59 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:05.913071 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19f5a0-8eb8-4153-b028-ab56b69e9c59 None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:05.913960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19f5a0-8eb8-4153-b028-ab56b69e9c59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:05.914538 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19f5a0-8eb8-4153-b028-ab56b69e9c59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:05.916311 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19f5a0-8eb8-4153-b028-ab56b69e9c59 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:05.930395 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 240/495] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:05.931674 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19f5a0-8eb8-4153-b028-ab56b69e9c59 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:05.994475 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee25a8-5417-4c27-8048-d7cac64c4ada None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:06.017000 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:06.029190 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079e30a-b50c-4e5d-9067-be064396c72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:06.029859 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079e30a-b50c-4e5d-9067-be064396c72c None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:06.030145 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079e30a-b50c-4e5d-9067-be064396c72c None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:06.030425 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079e30a-b50c-4e5d-9067-be064396c72c None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:06.031230 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1079e30a-b50c-4e5d-9067-be064396c72c None admin] RBAC: Adding query filter params (name=service) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:06.031478 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1079e30a-b50c-4e5d-9067-be064396c72c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:06.032881 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1079e30a-b50c-4e5d-9067-be064396c72c None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:06.041160 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19f5a0-8eb8-4153-b028-ab56b69e9c59 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:06.041411 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 256/496] 10.222.0.39 () {56 vars in 1103 bytes} [Mon May 23 15:36:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:06.044637 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079e30a-b50c-4e5d-9067-be064396c72c None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:06.058781 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:06.079302 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b170bea7-b39a-4aa4-9ba1-1efe07873fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:06.080120 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170bea7-b39a-4aa4-9ba1-1efe07873fc2 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:06.080405 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170bea7-b39a-4aa4-9ba1-1efe07873fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:06.080675 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170bea7-b39a-4aa4-9ba1-1efe07873fc2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:06.087743 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b170bea7-b39a-4aa4-9ba1-1efe07873fc2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:06.089582 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b170bea7-b39a-4aa4-9ba1-1efe07873fc2 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:06.107355 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-b170bea7-b39a-4aa4-9ba1-1efe07873fc2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 23 15:36:06.107355 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:06.107355 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:06.107355 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:06.107355 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:06.107355 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:06.107355 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:06.107355 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:06.107355 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:06.107355 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:06.107355 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:06.107355 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:06.107355 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:36:06.107355 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:36:06.107355 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:36:06.107355 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:36:06.108482 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:06.108482 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:06.108482 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:36:06.108482 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:06.108482 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:36:06.108482 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:06.108482 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:06.108482 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:06.108482 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:06.108482 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:06.108482 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:06.108482 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:06.108482 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:06.108482 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:06.108482 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:06.108482 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:06.108482 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:06.108482 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:06.109483 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:06.109483 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:06.109483 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:36:06.109483 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:36:06.109483 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:36:06.109483 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:36:06.109483 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:36:06.109483 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:36:06.109483 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 23 15:36:06.109483 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:06.109483 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 241/497] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:36:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:06.110297 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8e971-7cb4-470c-8c2e-f7e67996f82e None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:06.110371 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8e971-7cb4-470c-8c2e-f7e67996f82e None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:06.110594 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8e971-7cb4-470c-8c2e-f7e67996f82e None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:06.112144 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 242/498] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:06.112855 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8e971-7cb4-470c-8c2e-f7e67996f82e None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:06.156553 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079e30a-b50c-4e5d-9067-be064396c72c None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:06.190667 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833550c3-e5c8-4e1b-b1f5-3b5aca5d08cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:06.191548 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833550c3-e5c8-4e1b-b1f5-3b5aca5d08cc None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:06.191868 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833550c3-e5c8-4e1b-b1f5-3b5aca5d08cc None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:06.192145 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833550c3-e5c8-4e1b-b1f5-3b5aca5d08cc None admin] PATH_INFO: `/v3/users/nova` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:06.202895 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833550c3-e5c8-4e1b-b1f5-3b5aca5d08cc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:06.204384 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833550c3-e5c8-4e1b-b1f5-3b5aca5d08cc None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:06.214081 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8e971-7cb4-470c-8c2e-f7e67996f82e None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:06.220665 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-833550c3-e5c8-4e1b-b1f5-3b5aca5d08cc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 15:36:06.220665 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:06.220665 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:06.220665 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:06.220665 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:06.220665 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:06.220665 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:06.220665 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:06.220665 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:06.220665 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:06.220665 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:06.220665 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:06.220665 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:36:06.220665 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:36:06.220665 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:36:06.220665 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:36:06.221614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:06.221614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:06.221614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:36:06.221614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:06.221614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:36:06.221614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:06.221614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:06.221614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:06.221614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:06.221614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:06.221614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:06.221614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:06.221614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:06.221614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:06.221614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:06.221614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:06.221614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:06.221614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:06.222484 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:06.222484 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:06.222484 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:36:06.222484 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:36:06.222484 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:36:06.222484 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:36:06.222484 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:36:06.222484 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:36:06.222484 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 15:36:06.222484 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:06.222484 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 257/499] 10.222.0.39 () {56 vars in 1093 bytes} [Mon May 23 15:36:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:06.223196 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cb47d-d83c-4572-802f-aaf080cd8e97 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:06.223372 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cb47d-d83c-4572-802f-aaf080cd8e97 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:06.223668 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cb47d-d83c-4572-802f-aaf080cd8e97 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:06.224917 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 258/500] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:06.225604 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cb47d-d83c-4572-802f-aaf080cd8e97 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:06.251145 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59168334-fb42-453a-90ce-58f791584caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:06.251878 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59168334-fb42-453a-90ce-58f791584caf None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:06.252162 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59168334-fb42-453a-90ce-58f791584caf None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:06.252437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59168334-fb42-453a-90ce-58f791584caf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:06.262170 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59168334-fb42-453a-90ce-58f791584caf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:06.263839 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59168334-fb42-453a-90ce-58f791584caf None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:06.272475 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:06.281437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-59168334-fb42-453a-90ce-58f791584caf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:06.281437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:06.281437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:06.281437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:06.281437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:06.281437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:06.281437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:06.281437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:06.281437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:06.281437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:06.281437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:06.281437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:06.281437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:06.281437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:06.281437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:06.282505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:06.282505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:06.282505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:06.282505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:06.282505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:06.282505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:06.282505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:06.282505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:06.282505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:06.282505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:06.282505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:06.282505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:06.282505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:06.282505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:06.282505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:06.282505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:06.282505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:06.283366 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:06.283366 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:06.283366 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:06.283366 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:06.287123 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 243/501] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:06.288297 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42966893-ebc7-40ce-911b-63e702923e35 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:06.288586 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42966893-ebc7-40ce-911b-63e702923e35 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:06.288864 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42966893-ebc7-40ce-911b-63e702923e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:06.305623 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-42966893-ebc7-40ce-911b-63e702923e35 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:06.306787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-42966893-ebc7-40ce-911b-63e702923e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:06.327241 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:06.328630 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cb47d-d83c-4572-802f-aaf080cd8e97 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:06.363085 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd710ae-a5e0-4707-ad74-fa8b3503353a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:06.363768 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd710ae-a5e0-4707-ad74-fa8b3503353a None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:06.364050 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd710ae-a5e0-4707-ad74-fa8b3503353a None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:06.364322 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd710ae-a5e0-4707-ad74-fa8b3503353a None admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:06.365145 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd710ae-a5e0-4707-ad74-fa8b3503353a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:06.365451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd710ae-a5e0-4707-ad74-fa8b3503353a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:06.366877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd710ae-a5e0-4707-ad74-fa8b3503353a None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:06.373783 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 244/502] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:36:06.374609 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42966893-ebc7-40ce-911b-63e702923e35 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:06.405139 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 259/503] 10.222.0.39 () {56 vars in 1137 bytes} [Mon May 23 15:36:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:06.406234 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c6d43-9ed8-4594-a2ba-99caef2111f6 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:06.406521 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c6d43-9ed8-4594-a2ba-99caef2111f6 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:06.406794 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c6d43-9ed8-4594-a2ba-99caef2111f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:06.422533 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-959c6d43-9ed8-4594-a2ba-99caef2111f6 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:06.423747 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-959c6d43-9ed8-4594-a2ba-99caef2111f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:06.482382 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42966893-ebc7-40ce-911b-63e702923e35 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:06.490003 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 260/504] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:36:06.490828 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c6d43-9ed8-4594-a2ba-99caef2111f6 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:06.523151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf1507-7a1b-4df6-b098-eb42450123b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:06.523339 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:06.523804 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf1507-7a1b-4df6-b098-eb42450123b5 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:06.524148 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf1507-7a1b-4df6-b098-eb42450123b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:06.524340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf1507-7a1b-4df6-b098-eb42450123b5 None admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:06.525188 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf1507-7a1b-4df6-b098-eb42450123b5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:06.525504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf1507-7a1b-4df6-b098-eb42450123b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:06.526946 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf1507-7a1b-4df6-b098-eb42450123b5 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:06.563125 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 245/505] 10.222.0.39 () {56 vars in 1133 bytes} [Mon May 23 15:36:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:06.564157 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf1507-7a1b-4df6-b098-eb42450123b5 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:06.580309 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:06.592512 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c6d43-9ed8-4594-a2ba-99caef2111f6 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:06.627697 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab9df7-978a-4343-8c2b-aacc35d2caf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:06.628359 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab9df7-978a-4343-8c2b-aacc35d2caf8 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:06.628637 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab9df7-978a-4343-8c2b-aacc35d2caf8 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:06.628907 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab9df7-978a-4343-8c2b-aacc35d2caf8 None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:06.629629 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab9df7-978a-4343-8c2b-aacc35d2caf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:06.629936 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab9df7-978a-4343-8c2b-aacc35d2caf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:06.631308 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab9df7-978a-4343-8c2b-aacc35d2caf8 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:06.644510 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 261/506] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:06.645330 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab9df7-978a-4343-8c2b-aacc35d2caf8 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:06.667921 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf1507-7a1b-4df6-b098-eb42450123b5 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:06.704079 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba338393-2e39-4c3a-8567-e459623ce09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:06.704866 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba338393-2e39-4c3a-8567-e459623ce09f None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:06.705140 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba338393-2e39-4c3a-8567-e459623ce09f None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:06.705417 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba338393-2e39-4c3a-8567-e459623ce09f None admin] PATH_INFO: `/v3/roles/service` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:06.715914 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba338393-2e39-4c3a-8567-e459623ce09f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:36:06.723490 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-ba338393-2e39-4c3a-8567-e459623ce09f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:06.723490 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:06.723490 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:06.723490 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:06.723490 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:06.723490 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:06.723490 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:06.723490 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:06.723490 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:06.723490 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:06.723490 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:06.723490 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:06.723490 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:36:06.723490 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:36:06.723490 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:36:06.723490 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:36:06.724394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:36:06.724394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:36:06.724394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:36:06.724394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:36:06.724394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:06.724394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:06.724394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:06.724394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:06.724394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:06.724394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:06.724394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:06.724394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:06.724394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:06.724394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:06.724394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:06.724394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:06.725177 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:06.725177 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:06.725177 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:06.725177 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:06.725177 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:36:06.725177 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:36:06.725177 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:36:06.725177 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:36:06.725177 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:36:06.725177 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:36:06.725177 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:06.725177 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:06.725177 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 246/507] 10.222.0.39 () {56 vars in 1102 bytes} [Mon May 23 15:36:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:06.725823 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba338393-2e39-4c3a-8567-e459623ce09f None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:06.739756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:06.748581 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab9df7-978a-4343-8c2b-aacc35d2caf8 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:06.783683 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8a3b2-a0ba-48b7-8456-33e6c78d7762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:06.784278 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8a3b2-a0ba-48b7-8456-33e6c78d7762 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:06.784559 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8a3b2-a0ba-48b7-8456-33e6c78d7762 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:06.784834 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8a3b2-a0ba-48b7-8456-33e6c78d7762 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:06.801007 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:06.825191 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba338393-2e39-4c3a-8567-e459623ce09f None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:06.852274 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe8a3b2-a0ba-48b7-8456-33e6c78d7762 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:06.853737 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe8a3b2-a0ba-48b7-8456-33e6c78d7762 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:06.859829 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34761846-910c-44c9-ae7a-632d99586de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:06.860632 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34761846-910c-44c9-ae7a-632d99586de1 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:06.860917 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34761846-910c-44c9-ae7a-632d99586de1 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:06.861196 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34761846-910c-44c9-ae7a-632d99586de1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:06.871480 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34761846-910c-44c9-ae7a-632d99586de1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:06.873503 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34761846-910c-44c9-ae7a-632d99586de1 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:06.890417 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-34761846-910c-44c9-ae7a-632d99586de1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:06.890417 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:06.890417 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:06.890417 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:06.890417 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:06.890417 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:06.890417 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:06.890417 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:06.890417 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:06.890417 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:06.890417 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:06.890417 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:06.890417 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:06.890417 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:06.890417 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:06.891421 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:06.891421 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:06.891421 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:06.891421 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:06.891421 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:06.891421 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:06.891421 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:06.891421 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:06.891421 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:06.891421 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:06.891421 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:06.891421 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:06.891421 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:06.891421 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:06.891421 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:06.891421 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:06.891421 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:06.892485 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:06.892485 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:06.892485 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:06.892485 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:06.892485 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 247/508] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:06.892926 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34761846-910c-44c9-ae7a-632d99586de1 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:06.943848 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:06.954209 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 262/509] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:36:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:36:06.955016 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8a3b2-a0ba-48b7-8456-33e6c78d7762 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:06.998098 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34761846-910c-44c9-ae7a-632d99586de1 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:07.022325 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:07.031093 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488572ae-f442-4f67-a8b9-1258b7f9c72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:07.031769 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488572ae-f442-4f67-a8b9-1258b7f9c72b None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:07.032049 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488572ae-f442-4f67-a8b9-1258b7f9c72b None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:07.038420 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488572ae-f442-4f67-a8b9-1258b7f9c72b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:07.056976 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8a3b2-a0ba-48b7-8456-33e6c78d7762 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:07.091083 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243c031-cdbe-4613-bb9a-243b2a53ab62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:07.091888 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243c031-cdbe-4613-bb9a-243b2a53ab62 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:07.092169 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243c031-cdbe-4613-bb9a-243b2a53ab62 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:07.092437 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243c031-cdbe-4613-bb9a-243b2a53ab62 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:07.099646 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488572ae-f442-4f67-a8b9-1258b7f9c72b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:07.100140 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d243c031-cdbe-4613-bb9a-243b2a53ab62 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:07.101120 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488572ae-f442-4f67-a8b9-1258b7f9c72b None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:07.101564 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d243c031-cdbe-4613-bb9a-243b2a53ab62 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:07.115896 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-d243c031-cdbe-4613-bb9a-243b2a53ab62 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 15:36:07.115896 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:07.115896 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:07.115896 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:07.115896 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:07.115896 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:07.115896 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:07.115896 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:07.115896 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:07.115896 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:07.115896 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:07.115896 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:07.115896 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:36:07.115896 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:36:07.115896 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:36:07.115896 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:36:07.116885 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:07.116885 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:07.116885 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:36:07.116885 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:07.116885 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:36:07.116885 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:07.116885 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:07.116885 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:07.116885 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:07.116885 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:07.116885 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:07.116885 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:07.116885 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:07.116885 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:07.116885 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:07.116885 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:07.116885 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:07.116885 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:07.117772 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:07.117772 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:07.117772 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:36:07.117772 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:36:07.117772 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:36:07.117772 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:36:07.117772 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:36:07.117772 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:36:07.117772 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 15:36:07.117772 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:07.117772 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 263/510] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:36:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:07.118546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243c031-cdbe-4613-bb9a-243b2a53ab62 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:07.171177 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:07.206688 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 248/511] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:36:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:36:07.207540 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488572ae-f442-4f67-a8b9-1258b7f9c72b None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:07.222257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243c031-cdbe-4613-bb9a-243b2a53ab62 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:07.236659 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:07.255779 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5e769-2235-46c6-8452-96daaeacb735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:07.256536 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5e769-2235-46c6-8452-96daaeacb735 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:07.256820 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5e769-2235-46c6-8452-96daaeacb735 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:07.257100 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5e769-2235-46c6-8452-96daaeacb735 None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:07.257845 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5e769-2235-46c6-8452-96daaeacb735 None admin] RBAC: Adding query filter params (name=service) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:07.258156 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5e769-2235-46c6-8452-96daaeacb735 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:07.259532 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5e769-2235-46c6-8452-96daaeacb735 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:07.271636 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 264/512] 10.222.0.39 () {56 vars in 1103 bytes} [Mon May 23 15:36:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:07.271636 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5e769-2235-46c6-8452-96daaeacb735 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:07.309110 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488572ae-f442-4f67-a8b9-1258b7f9c72b None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:07.343208 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f372de-67a7-4f4a-a5cb-9ab5b063cf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:07.343886 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f372de-67a7-4f4a-a5cb-9ab5b063cf04 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:07.344168 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f372de-67a7-4f4a-a5cb-9ab5b063cf04 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:07.344437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f372de-67a7-4f4a-a5cb-9ab5b063cf04 None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:07.345147 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f372de-67a7-4f4a-a5cb-9ab5b063cf04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:07.345451 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f372de-67a7-4f4a-a5cb-9ab5b063cf04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:07.346828 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f372de-67a7-4f4a-a5cb-9ab5b063cf04 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:07.357912 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 249/513] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:07.358765 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f372de-67a7-4f4a-a5cb-9ab5b063cf04 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:07.367613 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5e769-2235-46c6-8452-96daaeacb735 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:07.382047 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:07.401532 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4c09f-2396-4835-9966-018f10ac90b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:07.402358 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4c09f-2396-4835-9966-018f10ac90b5 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:07.402637 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4c09f-2396-4835-9966-018f10ac90b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:07.402918 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4c09f-2396-4835-9966-018f10ac90b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:07.413937 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4c09f-2396-4835-9966-018f10ac90b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:07.415381 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4c09f-2396-4835-9966-018f10ac90b5 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:07.432976 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-68c4c09f-2396-4835-9966-018f10ac90b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:07.432976 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:07.432976 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:07.432976 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:07.432976 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:07.432976 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:07.432976 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:07.432976 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:07.432976 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:07.432976 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:07.432976 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:07.432976 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:07.432976 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:07.432976 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:07.432976 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:07.433849 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:07.433849 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:07.433849 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:07.433849 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:07.433849 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:07.433849 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:07.433849 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:07.433849 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:07.433849 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:07.433849 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:07.433849 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:07.433849 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:07.433849 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:07.433849 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:07.433849 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:07.433849 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:07.433849 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:07.434745 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:07.434745 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:07.434745 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:07.434745 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:07.434745 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 265/514] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:07.435395 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4c09f-2396-4835-9966-018f10ac90b5 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:07.443224 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:07.458269 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f372de-67a7-4f4a-a5cb-9ab5b063cf04 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:07.491608 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7942ad-cf3f-499a-9f92-6baafc222c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:07.492280 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7942ad-cf3f-499a-9f92-6baafc222c1f None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:07.492569 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7942ad-cf3f-499a-9f92-6baafc222c1f None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:07.492845 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7942ad-cf3f-499a-9f92-6baafc222c1f None admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:07.493670 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7942ad-cf3f-499a-9f92-6baafc222c1f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:07.493982 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7942ad-cf3f-499a-9f92-6baafc222c1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:07.495405 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7942ad-cf3f-499a-9f92-6baafc222c1f None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:07.517184 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 250/515] 10.222.0.39 () {56 vars in 1137 bytes} [Mon May 23 15:36:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:07.517184 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7942ad-cf3f-499a-9f92-6baafc222c1f None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:07.540050 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4c09f-2396-4835-9966-018f10ac90b5 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:07.574343 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2700a-ed51-4823-8fbd-13b8401d3a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:07.575562 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2700a-ed51-4823-8fbd-13b8401d3a1e None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:07.575874 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2700a-ed51-4823-8fbd-13b8401d3a1e None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:07.576146 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2700a-ed51-4823-8fbd-13b8401d3a1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:07.586565 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d2700a-ed51-4823-8fbd-13b8401d3a1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:07.588069 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d2700a-ed51-4823-8fbd-13b8401d3a1e None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:07.605481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-89d2700a-ed51-4823-8fbd-13b8401d3a1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:07.605481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:07.605481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:07.605481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:07.605481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:07.605481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:07.605481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:07.605481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:07.605481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:07.605481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:07.605481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:07.605481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:07.605481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:07.605481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:07.605481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:07.606553 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:07.606553 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:07.606553 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:07.606553 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:07.606553 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:07.606553 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:07.606553 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:07.606553 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:07.606553 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:07.606553 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:07.606553 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:07.606553 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:07.606553 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:07.606553 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:07.606553 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:07.606553 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:07.606553 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:07.607402 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:07.607402 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:07.607402 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:07.607402 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:07.611502 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 266/516] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:07.612254 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2700a-ed51-4823-8fbd-13b8401d3a1e None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:07.613802 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7942ad-cf3f-499a-9f92-6baafc222c1f None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:07.630942 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:07.648498 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942573af-4141-4020-bfc3-5f7eaf0638ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:07.649288 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942573af-4141-4020-bfc3-5f7eaf0638ef None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:07.649569 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942573af-4141-4020-bfc3-5f7eaf0638ef None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:07.649843 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942573af-4141-4020-bfc3-5f7eaf0638ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:07.662683 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942573af-4141-4020-bfc3-5f7eaf0638ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:07.664168 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942573af-4141-4020-bfc3-5f7eaf0638ef None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:07.666617 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:07.682706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-942573af-4141-4020-bfc3-5f7eaf0638ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:07.682706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:07.682706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:07.682706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:07.682706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:07.682706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:07.682706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:07.682706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:07.682706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:07.682706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:07.682706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:07.682706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:07.682706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:07.682706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:07.682706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:07.683785 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:07.683785 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:07.683785 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:07.683785 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:07.683785 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:07.683785 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:07.683785 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:07.683785 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:07.683785 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:07.683785 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:07.683785 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:07.683785 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:07.683785 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:07.683785 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:07.683785 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:07.683785 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:07.683785 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:07.685294 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:07.685294 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:07.685294 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:07.685294 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:07.685294 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 251/517] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:07.685294 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942573af-4141-4020-bfc3-5f7eaf0638ef None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:07.713489 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2700a-ed51-4823-8fbd-13b8401d3a1e None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:07.748969 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5ab99-602c-40e2-af2d-7e3bd0e9f302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:07.749633 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5ab99-602c-40e2-af2d-7e3bd0e9f302 None admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:07.749909 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5ab99-602c-40e2-af2d-7e3bd0e9f302 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:07.750196 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5ab99-602c-40e2-af2d-7e3bd0e9f302 None admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:07.750896 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf5ab99-602c-40e2-af2d-7e3bd0e9f302 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:07.752387 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf5ab99-602c-40e2-af2d-7e3bd0e9f302 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:07.783466 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942573af-4141-4020-bfc3-5f7eaf0638ef None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:07.816747 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbab0ef-1d8e-4519-82a4-e23fa4e78f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:07.817400 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbab0ef-1d8e-4519-82a4-e23fa4e78f1d None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:07.817680 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbab0ef-1d8e-4519-82a4-e23fa4e78f1d None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:07.817955 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbab0ef-1d8e-4519-82a4-e23fa4e78f1d None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:07.818664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbab0ef-1d8e-4519-82a4-e23fa4e78f1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:07.819018 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbab0ef-1d8e-4519-82a4-e23fa4e78f1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:07.820419 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbab0ef-1d8e-4519-82a4-e23fa4e78f1d None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:07.826220 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 267/518] 10.222.0.39 () {60 vars in 1132 bytes} [Mon May 23 15:36:07 2022] POST /identity/v3/users => generated 247 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:36:07.827665 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5ab99-602c-40e2-af2d-7e3bd0e9f302 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:07.847253 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 252/519] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:07.847933 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbab0ef-1d8e-4519-82a4-e23fa4e78f1d None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:07.917712 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:07.918947 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:07.947742 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5ab99-602c-40e2-af2d-7e3bd0e9f302 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:07.972265 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbab0ef-1d8e-4519-82a4-e23fa4e78f1d None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:07.989333 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033c52f-ab7a-4b03-beec-3245ddf14fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:07.990397 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033c52f-ab7a-4b03-beec-3245ddf14fe8 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:07.990977 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033c52f-ab7a-4b03-beec-3245ddf14fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:07.991578 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033c52f-ab7a-4b03-beec-3245ddf14fe8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:08.011189 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f789e8-3943-4822-9cc1-69cb2e2d5d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:08.011887 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f789e8-3943-4822-9cc1-69cb2e2d5d68 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:08.012181 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f789e8-3943-4822-9cc1-69cb2e2d5d68 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:08.012483 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f789e8-3943-4822-9cc1-69cb2e2d5d68 None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:08.013788 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f789e8-3943-4822-9cc1-69cb2e2d5d68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:08.013788 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f789e8-3943-4822-9cc1-69cb2e2d5d68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:08.014957 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f789e8-3943-4822-9cc1-69cb2e2d5d68 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:08.029398 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 253/520] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:08.030354 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f789e8-3943-4822-9cc1-69cb2e2d5d68 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:08.076519 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033c52f-ab7a-4b03-beec-3245ddf14fe8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:08.077923 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033c52f-ab7a-4b03-beec-3245ddf14fe8 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:08.141738 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f789e8-3943-4822-9cc1-69cb2e2d5d68 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:08.159053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:08.160594 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:08.179426 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9d9f5-932d-432c-9d96-fb1319f9e3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:08.180367 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9d9f5-932d-432c-9d96-fb1319f9e3c3 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:08.180652 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9d9f5-932d-432c-9d96-fb1319f9e3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:08.180927 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9d9f5-932d-432c-9d96-fb1319f9e3c3 None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:08.181650 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9d9f5-932d-432c-9d96-fb1319f9e3c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:08.181955 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9d9f5-932d-432c-9d96-fb1319f9e3c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:08.183343 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9d9f5-932d-432c-9d96-fb1319f9e3c3 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:08.186454 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 268/521] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:36:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:36:08.187641 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033c52f-ab7a-4b03-beec-3245ddf14fe8 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:08.199694 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 254/522] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:08.199694 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9d9f5-932d-432c-9d96-fb1319f9e3c3 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:08.305075 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033c52f-ab7a-4b03-beec-3245ddf14fe8 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:08.305486 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9d9f5-932d-432c-9d96-fb1319f9e3c3 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:08.339880 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3e0d2-47ea-4b36-b114-16a40eff8afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:08.340648 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3e0d2-47ea-4b36-b114-16a40eff8afa None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:08.340935 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3e0d2-47ea-4b36-b114-16a40eff8afa None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:08.341292 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3e0d2-47ea-4b36-b114-16a40eff8afa None admin] PATH_INFO: `/v3/projects/service` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:08.342742 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a41421-7a2b-41f8-b34f-699130b1e759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:08.343674 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a41421-7a2b-41f8-b34f-699130b1e759 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:08.344070 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a41421-7a2b-41f8-b34f-699130b1e759 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:08.344344 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a41421-7a2b-41f8-b34f-699130b1e759 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:08.348895 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d3e0d2-47ea-4b36-b114-16a40eff8afa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:08.350505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d3e0d2-47ea-4b36-b114-16a40eff8afa None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:08.351109 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a41421-7a2b-41f8-b34f-699130b1e759 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:08.352587 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a41421-7a2b-41f8-b34f-699130b1e759 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:08.366810 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-b2d3e0d2-47ea-4b36-b114-16a40eff8afa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:08.366810 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:08.366810 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:08.366810 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:08.366810 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:08.366810 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:08.366810 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:08.366810 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:08.366810 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:08.366810 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:08.366810 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:08.366810 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:08.366810 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:36:08.366810 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:36:08.366810 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:36:08.367789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:36:08.367789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:08.367789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:08.367789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:08.367789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:08.367789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:08.367789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:08.367789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:08.367789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:08.367789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:08.367789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:08.367789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:08.367789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:08.367789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:08.367789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:08.367789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:08.367789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:08.368640 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:36:08.368640 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:36:08.368640 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:36:08.368640 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:36:08.368640 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:36:08.368640 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:36:08.368640 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:08.368640 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:08.369546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-f2a41421-7a2b-41f8-b34f-699130b1e759 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:08.369546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:08.369546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:08.369546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:08.369546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:08.369546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:08.369546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:08.369546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:08.369546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:08.369546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:08.369546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:08.369546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:08.369546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:36:08.369546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:36:08.369546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:36:08.370547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:36:08.370547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:08.370547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:08.370547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:08.370547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:08.370547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:08.370547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:08.370547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:08.370547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:08.370547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:08.370547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:08.370547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:08.370547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:08.370547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:08.370547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:08.370547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:08.370547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:08.371382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:36:08.371382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:36:08.371382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:36:08.371382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:36:08.371382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:36:08.371382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:36:08.371382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:08.371382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:08.371891 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 255/523] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:36:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:08.371891 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3e0d2-47ea-4b36-b114-16a40eff8afa None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:08.378137 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 269/524] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:36:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:08.378137 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a41421-7a2b-41f8-b34f-699130b1e759 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:08.408908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:08.413171 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:08.477509 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3e0d2-47ea-4b36-b114-16a40eff8afa None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:08.484773 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a41421-7a2b-41f8-b34f-699130b1e759 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:08.512163 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444f8af-b53a-41d7-bcc4-83ebf1079525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:08.513175 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444f8af-b53a-41d7-bcc4-83ebf1079525 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:08.513456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444f8af-b53a-41d7-bcc4-83ebf1079525 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:08.513730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444f8af-b53a-41d7-bcc4-83ebf1079525 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:08.520527 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871e626-604a-43a0-9d14-f61a04fabddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:08.521311 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871e626-604a-43a0-9d14-f61a04fabddd None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:08.521591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871e626-604a-43a0-9d14-f61a04fabddd None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:08.521867 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871e626-604a-43a0-9d14-f61a04fabddd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:08.524547 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444f8af-b53a-41d7-bcc4-83ebf1079525 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:08.526001 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444f8af-b53a-41d7-bcc4-83ebf1079525 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:08.530177 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871e626-604a-43a0-9d14-f61a04fabddd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:08.531626 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871e626-604a-43a0-9d14-f61a04fabddd None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:08.544614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-a444f8af-b53a-41d7-bcc4-83ebf1079525 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:08.544614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:08.544614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:08.544614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:08.544614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:08.544614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:08.544614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:08.544614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:08.544614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:08.544614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:08.544614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:08.544614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:08.544614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:08.544614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:08.544614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:08.545516 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:08.545516 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:08.545516 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:08.545516 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:08.545516 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:08.545516 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:08.545516 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:08.545516 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:08.545516 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:08.545516 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:08.545516 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:08.545516 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:08.545516 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:08.545516 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:08.545516 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:08.545516 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:08.545516 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:08.546368 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:08.546368 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:08.546368 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:08.546368 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:08.547403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-d871e626-604a-43a0-9d14-f61a04fabddd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 23 15:36:08.547403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:08.547403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:08.547403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:08.547403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:08.547403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:08.547403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:08.547403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:08.547403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:08.547403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:08.547403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:08.547403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:08.547403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:36:08.547403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:36:08.547403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:36:08.547403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:36:08.548387 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:08.548387 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:08.548387 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:36:08.548387 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:08.548387 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:36:08.548387 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:08.548387 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:08.548387 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:08.548387 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:08.548387 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:08.548387 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:08.548387 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:08.548387 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:08.548387 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:08.548387 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:08.548387 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:08.548387 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:08.548387 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:08.549584 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:08.549584 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:08.549584 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:36:08.549584 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:36:08.549584 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:36:08.549584 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:36:08.549584 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:36:08.549584 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:36:08.549584 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 23 15:36:08.549584 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:08.549584 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 270/525] 10.222.0.39 () {56 vars in 1102 bytes} [Mon May 23 15:36:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:08.550758 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 256/526] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:08.551403 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444f8af-b53a-41d7-bcc4-83ebf1079525 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:08.552122 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871e626-604a-43a0-9d14-f61a04fabddd None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:08.644792 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:08.654427 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:08.657655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444f8af-b53a-41d7-bcc4-83ebf1079525 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:08.661134 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871e626-604a-43a0-9d14-f61a04fabddd None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:08.694096 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af0f1c-74f8-4495-ab43-73af9c76812a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:08.694753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af0f1c-74f8-4495-ab43-73af9c76812a None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:08.695035 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af0f1c-74f8-4495-ab43-73af9c76812a None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:08.695313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af0f1c-74f8-4495-ab43-73af9c76812a None admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:08.696128 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af0f1c-74f8-4495-ab43-73af9c76812a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:08.696435 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af0f1c-74f8-4495-ab43-73af9c76812a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:08.696644 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff86e6-75ea-44a5-9c55-df9e037ff927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:08.697299 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff86e6-75ea-44a5-9c55-df9e037ff927 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:08.697581 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff86e6-75ea-44a5-9c55-df9e037ff927 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:08.697856 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff86e6-75ea-44a5-9c55-df9e037ff927 None admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:08.697946 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af0f1c-74f8-4495-ab43-73af9c76812a None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:08.698703 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff86e6-75ea-44a5-9c55-df9e037ff927 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:08.699017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff86e6-75ea-44a5-9c55-df9e037ff927 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:08.700690 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff86e6-75ea-44a5-9c55-df9e037ff927 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:08.722436 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 257/527] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:36:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:08.722436 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af0f1c-74f8-4495-ab43-73af9c76812a None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:08.722688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 271/528] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:36:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:08.722688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff86e6-75ea-44a5-9c55-df9e037ff927 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:08.828385 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff86e6-75ea-44a5-9c55-df9e037ff927 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:08.832028 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af0f1c-74f8-4495-ab43-73af9c76812a None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:08.864038 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7bafb8-90ed-4f09-83b6-7263fd1d12f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:08.864695 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bafb8-90ed-4f09-83b6-7263fd1d12f1 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:08.864980 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bafb8-90ed-4f09-83b6-7263fd1d12f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:08.865250 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bafb8-90ed-4f09-83b6-7263fd1d12f1 None admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:08.866084 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7bafb8-90ed-4f09-83b6-7263fd1d12f1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:08.866396 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7bafb8-90ed-4f09-83b6-7263fd1d12f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:08.866889 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14018b2-bea7-4764-97eb-24d20515a385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:08.867546 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14018b2-bea7-4764-97eb-24d20515a385 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:08.867854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7bafb8-90ed-4f09-83b6-7263fd1d12f1 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:08.867947 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14018b2-bea7-4764-97eb-24d20515a385 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:08.868138 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14018b2-bea7-4764-97eb-24d20515a385 None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:08.868856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14018b2-bea7-4764-97eb-24d20515a385 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:08.869159 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14018b2-bea7-4764-97eb-24d20515a385 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:08.870524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14018b2-bea7-4764-97eb-24d20515a385 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:08.882836 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 258/529] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:08.887918 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 272/530] 10.222.0.39 () {56 vars in 1139 bytes} [Mon May 23 15:36:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:08.888555 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14018b2-bea7-4764-97eb-24d20515a385 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:08.891842 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7bafb8-90ed-4f09-83b6-7263fd1d12f1 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:08.899878 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:08.906462 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:08.993667 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14018b2-bea7-4764-97eb-24d20515a385 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:08.997628 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7bafb8-90ed-4f09-83b6-7263fd1d12f1 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:09.033067 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8368cd2-e1cf-4640-b1a1-8889174f598c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:09.033720 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8368cd2-e1cf-4640-b1a1-8889174f598c None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:09.034003 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8368cd2-e1cf-4640-b1a1-8889174f598c None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:09.034278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8368cd2-e1cf-4640-b1a1-8889174f598c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:09.035108 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8368cd2-e1cf-4640-b1a1-8889174f598c None admin] RBAC: Adding query filter params (role.id=b57c4ebab8e842088df37b551053b113, scope.project.id=8addb03b903842609168ee2fafc8ec6b, user.id=d003ff6cc73946da9203c69a167bbfff) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:09.035423 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8368cd2-e1cf-4640-b1a1-8889174f598c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:09.036904 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8368cd2-e1cf-4640-b1a1-8889174f598c None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:09.042434 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 259/531] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:36:08 2022] GET /identity/v3/role_assignments?user.id=d003ff6cc73946da9203c69a167bbfff&scope.project.id=8addb03b903842609168ee2fafc8ec6b&role.id=b57c4ebab8e842088df37b551053b113 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:09.043392 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8368cd2-e1cf-4640-b1a1-8889174f598c None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:09.045324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7a72c-1c03-49f8-9f15-880987c472d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:09.046433 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7a72c-1c03-49f8-9f15-880987c472d2 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:09.047840 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7a72c-1c03-49f8-9f15-880987c472d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:09.048351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7a72c-1c03-49f8-9f15-880987c472d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:09.049429 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df7a72c-1c03-49f8-9f15-880987c472d2 None admin] RBAC: Adding query filter params (role.id=b57c4ebab8e842088df37b551053b113, scope.project.id=8addb03b903842609168ee2fafc8ec6b, user.id=76f7895b7b5748e7b4461f7fde1d558a) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:09.049976 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df7a72c-1c03-49f8-9f15-880987c472d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:09.051737 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df7a72c-1c03-49f8-9f15-880987c472d2 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:09.067656 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 273/532] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:36:08 2022] GET /identity/v3/role_assignments?user.id=76f7895b7b5748e7b4461f7fde1d558a&scope.project.id=8addb03b903842609168ee2fafc8ec6b&role.id=b57c4ebab8e842088df37b551053b113 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:09.067656 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7a72c-1c03-49f8-9f15-880987c472d2 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:09.190995 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:09.231668 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:09.268149 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8368cd2-e1cf-4640-b1a1-8889174f598c None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:09.281307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7a72c-1c03-49f8-9f15-880987c472d2 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:09.308182 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08370a5-63f9-4e44-8cd1-9c6bc2379725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:09.308987 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08370a5-63f9-4e44-8cd1-9c6bc2379725 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:09.309934 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08370a5-63f9-4e44-8cd1-9c6bc2379725 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:09.310332 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08370a5-63f9-4e44-8cd1-9c6bc2379725 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:09.319830 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08370a5-63f9-4e44-8cd1-9c6bc2379725 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:09.321314 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08370a5-63f9-4e44-8cd1-9c6bc2379725 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:09.333470 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a17ce-3bb6-45b7-9ddf-2106894416eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:09.334125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a17ce-3bb6-45b7-9ddf-2106894416eb None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:09.334406 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a17ce-3bb6-45b7-9ddf-2106894416eb None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:09.334679 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a17ce-3bb6-45b7-9ddf-2106894416eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:09.346848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-b08370a5-63f9-4e44-8cd1-9c6bc2379725 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:09.346848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:09.346848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:09.346848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:09.346848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:09.346848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:09.346848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:09.346848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:09.346848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:09.346848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:09.346848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:09.346848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:09.346848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:36:09.346848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:36:09.346848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:36:09.347867 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:36:09.347867 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:09.347867 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:09.347867 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:09.347867 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:09.347867 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:09.347867 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:09.347867 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:09.347867 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:09.347867 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:09.347867 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:09.347867 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:09.347867 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:09.347867 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:09.347867 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:09.347867 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:09.347867 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:09.348695 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:36:09.348695 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:36:09.348695 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:36:09.348695 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:36:09.348695 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:36:09.348695 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:36:09.348695 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:09.348695 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:09.348695 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 260/533] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:36:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:09.353576 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08370a5-63f9-4e44-8cd1-9c6bc2379725 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:09.449259 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a17ce-3bb6-45b7-9ddf-2106894416eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:09.452551 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a17ce-3bb6-45b7-9ddf-2106894416eb None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:09.537589 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08370a5-63f9-4e44-8cd1-9c6bc2379725 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:09.543653 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:09.589828 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 274/534] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:36:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:36:09.596519 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a17ce-3bb6-45b7-9ddf-2106894416eb None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:09.602290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:09.612544 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258d361-2e61-4fc3-bf82-15d953824fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:09.613422 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258d361-2e61-4fc3-bf82-15d953824fe2 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:09.613846 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258d361-2e61-4fc3-bf82-15d953824fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:09.614262 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258d361-2e61-4fc3-bf82-15d953824fe2 None admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:09.615283 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258d361-2e61-4fc3-bf82-15d953824fe2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:09.617088 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258d361-2e61-4fc3-bf82-15d953824fe2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:09.618682 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258d361-2e61-4fc3-bf82-15d953824fe2 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:09.642472 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 261/535] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:36:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:09.647304 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258d361-2e61-4fc3-bf82-15d953824fe2 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:09.779213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258d361-2e61-4fc3-bf82-15d953824fe2 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:09.782474 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a17ce-3bb6-45b7-9ddf-2106894416eb None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:09.816471 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c7209-243c-451a-92df-8744568dd4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:09.817473 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c7209-243c-451a-92df-8744568dd4b3 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:09.817954 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c7209-243c-451a-92df-8744568dd4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:09.818448 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c7209-243c-451a-92df-8744568dd4b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:09.819467 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c7209-243c-451a-92df-8744568dd4b3 None admin] RBAC: Adding query filter params (role.id=b57c4ebab8e842088df37b551053b113, scope.project.id=8addb03b903842609168ee2fafc8ec6b, user.id=3514c56baee94de39d6be4c8790ef76b) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:09.819997 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c7209-243c-451a-92df-8744568dd4b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:09.821626 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c7209-243c-451a-92df-8744568dd4b3 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:09.828112 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 262/536] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:36:09 2022] GET /identity/v3/role_assignments?user.id=3514c56baee94de39d6be4c8790ef76b&scope.project.id=8addb03b903842609168ee2fafc8ec6b&role.id=b57c4ebab8e842088df37b551053b113 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:09.862321 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b4f72-e079-47f8-a64c-dad2480ef491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:09.863918 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b4f72-e079-47f8-a64c-dad2480ef491 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:09.864412 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b4f72-e079-47f8-a64c-dad2480ef491 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:09.864887 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b4f72-e079-47f8-a64c-dad2480ef491 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:09.884326 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b4f72-e079-47f8-a64c-dad2480ef491 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:09.886167 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b4f72-e079-47f8-a64c-dad2480ef491 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:09.914944 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-321b4f72-e079-47f8-a64c-dad2480ef491 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:09.914944 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:09.914944 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:09.914944 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:09.914944 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:09.914944 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:09.914944 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:09.914944 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:09.914944 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:09.914944 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:09.914944 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:09.914944 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:09.914944 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:09.914944 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:09.914944 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:09.915879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:09.915879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:09.915879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:09.915879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:09.915879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:09.915879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:09.915879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:09.915879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:09.915879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:09.915879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:09.915879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:09.915879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:09.915879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:09.915879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:09.915879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:09.915879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:09.915879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:09.916733 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:09.916733 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:09.916733 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:09.916733 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:09.919556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 275/537] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:09.925596 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c7209-243c-451a-92df-8744568dd4b3 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:10.030176 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:10.068603 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c7209-243c-451a-92df-8744568dd4b3 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:10.107801 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3256d-67f4-457f-b17f-1ffbf55c6e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:10.108471 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3256d-67f4-457f-b17f-1ffbf55c6e0f None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:10.108751 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3256d-67f4-457f-b17f-1ffbf55c6e0f None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:10.109027 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3256d-67f4-457f-b17f-1ffbf55c6e0f None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:10.110005 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c3256d-67f4-457f-b17f-1ffbf55c6e0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:10.110313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c3256d-67f4-457f-b17f-1ffbf55c6e0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:10.111713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c3256d-67f4-457f-b17f-1ffbf55c6e0f None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:10.125123 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 263/538] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:10.130498 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b4f72-e079-47f8-a64c-dad2480ef491 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:10.174326 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:10.188635 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc167d-080f-487a-9374-a19661465170 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:10.188988 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc167d-080f-487a-9374-a19661465170 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:10.189274 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc167d-080f-487a-9374-a19661465170 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:10.190913 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 264/539] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:36:10.198594 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac652cba-4124-46e4-9926-4c50cd940ee4 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:10.198885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac652cba-4124-46e4-9926-4c50cd940ee4 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:10.199172 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac652cba-4124-46e4-9926-4c50cd940ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:10.218730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-ac652cba-4124-46e4-9926-4c50cd940ee4 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:10.219960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-ac652cba-4124-46e4-9926-4c50cd940ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:10.317885 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b4f72-e079-47f8-a64c-dad2480ef491 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:10.320580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 265/540] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:36:10.346313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac652cba-4124-46e4-9926-4c50cd940ee4 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:10.391490 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d0950-fb03-4894-8cf2-e2f9f190fa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:10.392349 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d0950-fb03-4894-8cf2-e2f9f190fa3a None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:10.392639 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d0950-fb03-4894-8cf2-e2f9f190fa3a None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:10.392918 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d0950-fb03-4894-8cf2-e2f9f190fa3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:10.405110 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d0950-fb03-4894-8cf2-e2f9f190fa3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:10.406571 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d0950-fb03-4894-8cf2-e2f9f190fa3a None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:10.431954 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:10.436621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-cb9d0950-fb03-4894-8cf2-e2f9f190fa3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:10.436621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:10.436621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:10.436621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:10.436621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:10.436621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:10.436621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:10.436621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:10.436621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:10.436621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:10.436621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:10.436621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:10.436621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:36:10.436621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:36:10.436621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:36:10.437449 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:36:10.437449 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:10.437449 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:10.437449 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:10.437449 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:10.437449 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:10.437449 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:10.437449 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:10.437449 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:10.437449 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:10.437449 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:10.437449 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:10.437449 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:10.437449 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:10.437449 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:10.437449 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:10.437449 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:10.438290 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:36:10.438290 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:36:10.438290 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:36:10.438290 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:36:10.438290 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:36:10.438290 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:36:10.438290 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:10.438290 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:10.442044 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 276/541] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:36:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:10.444485 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d0950-fb03-4894-8cf2-e2f9f190fa3a None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:10.535441 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac652cba-4124-46e4-9926-4c50cd940ee4 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:10.602004 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b1ff9-1c79-410a-b0b5-b1d39b084877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:10.602743 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b1ff9-1c79-410a-b0b5-b1d39b084877 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:10.603031 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b1ff9-1c79-410a-b0b5-b1d39b084877 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:10.603307 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b1ff9-1c79-410a-b0b5-b1d39b084877 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:10.614361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:10.627796 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b1ff9-1c79-410a-b0b5-b1d39b084877 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:36:10.641977 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-3f4b1ff9-1c79-410a-b0b5-b1d39b084877 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:10.641977 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:10.641977 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:10.641977 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:10.641977 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:10.641977 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:10.641977 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:10.641977 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:10.641977 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:10.641977 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:10.641977 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:10.641977 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:10.641977 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:36:10.641977 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:36:10.641977 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:36:10.641977 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:36:10.642858 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:36:10.642858 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:36:10.642858 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:36:10.642858 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:36:10.642858 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:10.642858 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:10.642858 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:10.642858 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:10.642858 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:10.642858 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:10.642858 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:10.642858 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:10.642858 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:10.642858 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:10.642858 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:10.642858 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:10.643666 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:10.643666 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:10.643666 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:10.643666 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:10.643666 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:36:10.643666 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:36:10.643666 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:36:10.643666 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:36:10.643666 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:36:10.643666 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:36:10.643666 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:10.643666 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:10.649172 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 266/542] 10.222.0.39 () {56 vars in 1102 bytes} [Mon May 23 15:36:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:36:10.652428 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b1ff9-1c79-410a-b0b5-b1d39b084877 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:10.655919 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d0950-fb03-4894-8cf2-e2f9f190fa3a None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:10.749644 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a17229-5eb2-4ab1-8c6d-ac98f357f128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:10.750314 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a17229-5eb2-4ab1-8c6d-ac98f357f128 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:10.750599 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a17229-5eb2-4ab1-8c6d-ac98f357f128 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:10.750877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a17229-5eb2-4ab1-8c6d-ac98f357f128 None admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:10.751705 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a17229-5eb2-4ab1-8c6d-ac98f357f128 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:10.752020 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a17229-5eb2-4ab1-8c6d-ac98f357f128 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:10.753658 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a17229-5eb2-4ab1-8c6d-ac98f357f128 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:10.772985 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b1ff9-1c79-410a-b0b5-b1d39b084877 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:10.780036 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 277/543] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:36:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:10.781023 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:10.785676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a17229-5eb2-4ab1-8c6d-ac98f357f128 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:10.815837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f487a01-d3b5-4362-994c-697881f20bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:10.816863 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f487a01-d3b5-4362-994c-697881f20bf2 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:10.817342 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f487a01-d3b5-4362-994c-697881f20bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:10.817804 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f487a01-d3b5-4362-994c-697881f20bf2 None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:10.820216 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f487a01-d3b5-4362-994c-697881f20bf2 None admin] RBAC: Adding query filter params (name=service) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:10.820751 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f487a01-d3b5-4362-994c-697881f20bf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:10.822506 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f487a01-d3b5-4362-994c-697881f20bf2 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:10.843277 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 267/544] 10.222.0.39 () {56 vars in 1103 bytes} [Mon May 23 15:36:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:10.851957 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f487a01-d3b5-4362-994c-697881f20bf2 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:10.954504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a17229-5eb2-4ab1-8c6d-ac98f357f128 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:11.000214 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f487a01-d3b5-4362-994c-697881f20bf2 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:11.037964 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773b404-3107-4317-aa00-04c808c0aa53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:11.038767 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773b404-3107-4317-aa00-04c808c0aa53 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:11.039054 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773b404-3107-4317-aa00-04c808c0aa53 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:11.039331 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773b404-3107-4317-aa00-04c808c0aa53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:11.040661 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca21423-a152-4e21-806d-1f44debde763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:11.041323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca21423-a152-4e21-806d-1f44debde763 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:11.041606 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca21423-a152-4e21-806d-1f44debde763 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:11.041878 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca21423-a152-4e21-806d-1f44debde763 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:11.042708 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca21423-a152-4e21-806d-1f44debde763 None admin] RBAC: Adding query filter params (role.id=b57c4ebab8e842088df37b551053b113, scope.project.id=8addb03b903842609168ee2fafc8ec6b, user.id=f831a06a9cf344a2aa068c20a987b6da) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:11.043015 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca21423-a152-4e21-806d-1f44debde763 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:11.045292 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca21423-a152-4e21-806d-1f44debde763 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:11.051423 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773b404-3107-4317-aa00-04c808c0aa53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:11.052965 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773b404-3107-4317-aa00-04c808c0aa53 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:11.061860 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 278/545] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:36:10 2022] GET /identity/v3/role_assignments?user.id=f831a06a9cf344a2aa068c20a987b6da&scope.project.id=8addb03b903842609168ee2fafc8ec6b&role.id=b57c4ebab8e842088df37b551053b113 => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:36:11.072945 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-f773b404-3107-4317-aa00-04c808c0aa53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:11.072945 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:11.072945 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:11.072945 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:11.072945 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:11.072945 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:11.072945 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:11.072945 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:11.072945 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:11.072945 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:11.072945 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:11.072945 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:11.072945 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:11.072945 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:11.072945 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:11.075139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:11.075139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:11.075139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:11.075139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:11.075139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:11.075139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:11.075139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:11.075139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:11.075139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:11.075139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:11.075139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:11.075139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:11.075139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:11.075139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:11.075139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:11.075139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:11.075139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:11.076046 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:11.076046 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:11.076046 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:11.076046 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:11.076046 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 268/546] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:11.080889 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca21423-a152-4e21-806d-1f44debde763 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:11.100037 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:11.250973 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca21423-a152-4e21-806d-1f44debde763 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:11.292504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0130623-7b27-4a1a-be52-bd5fd7ff14e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:11.293174 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0130623-7b27-4a1a-be52-bd5fd7ff14e5 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:11.293982 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0130623-7b27-4a1a-be52-bd5fd7ff14e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:11.294262 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0130623-7b27-4a1a-be52-bd5fd7ff14e5 None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:11.295154 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0130623-7b27-4a1a-be52-bd5fd7ff14e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:11.295713 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0130623-7b27-4a1a-be52-bd5fd7ff14e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:11.296860 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0130623-7b27-4a1a-be52-bd5fd7ff14e5 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:11.310319 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 279/547] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:11.315807 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773b404-3107-4317-aa00-04c808c0aa53 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:11.351042 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:11.464116 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773b404-3107-4317-aa00-04c808c0aa53 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:11.516879 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ffdf4-ebb6-48ca-ba75-1be4855a6743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:11.517686 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ffdf4-ebb6-48ca-ba75-1be4855a6743 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:11.517970 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ffdf4-ebb6-48ca-ba75-1be4855a6743 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:11.518245 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ffdf4-ebb6-48ca-ba75-1be4855a6743 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:11.530132 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ffdf4-ebb6-48ca-ba75-1be4855a6743 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:11.531645 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ffdf4-ebb6-48ca-ba75-1be4855a6743 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:11.548660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-862ffdf4-ebb6-48ca-ba75-1be4855a6743 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 15:36:11.548660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:11.548660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:11.548660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:11.548660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:11.548660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:11.548660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:11.548660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:11.548660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:11.548660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:11.548660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:11.548660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:11.548660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:36:11.548660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:36:11.548660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:36:11.548660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:36:11.550491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:11.550491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:11.550491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:36:11.550491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:11.550491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:36:11.550491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:11.550491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:11.550491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:11.550491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:11.550491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:11.550491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:11.550491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:11.550491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:11.550491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:11.550491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:11.550491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:11.550491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:11.550491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:11.551590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:11.551590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:11.551590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:36:11.551590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:36:11.551590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:36:11.551590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:36:11.551590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:36:11.551590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:36:11.551590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 15:36:11.551590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:11.551590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 269/548] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:36:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:11.556577 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0130623-7b27-4a1a-be52-bd5fd7ff14e5 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:11.576449 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71304126-b81b-4258-b3f6-c8bbb7dd666b None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:11.576840 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71304126-b81b-4258-b3f6-c8bbb7dd666b None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:11.576998 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71304126-b81b-4258-b3f6-c8bbb7dd666b None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:11.578601 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 270/549] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:36:11.583504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bb894-6eea-4468-a85a-6a6cb366fd35 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:11.583822 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bb894-6eea-4468-a85a-6a6cb366fd35 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:11.584098 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bb894-6eea-4468-a85a-6a6cb366fd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:11.602772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-cc8bb894-6eea-4468-a85a-6a6cb366fd35 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:11.603975 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-cc8bb894-6eea-4468-a85a-6a6cb366fd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:11.697059 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:11.702844 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 271/550] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:36:11.735264 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bb894-6eea-4468-a85a-6a6cb366fd35 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:11.767714 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0130623-7b27-4a1a-be52-bd5fd7ff14e5 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:11.769684 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:11.841831 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d09042-7790-49ae-91ee-d8106041ec12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:11.842501 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d09042-7790-49ae-91ee-d8106041ec12 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:11.842775 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d09042-7790-49ae-91ee-d8106041ec12 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:11.843044 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d09042-7790-49ae-91ee-d8106041ec12 None admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:11.844154 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d09042-7790-49ae-91ee-d8106041ec12 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:11.846819 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d09042-7790-49ae-91ee-d8106041ec12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:11.848278 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d09042-7790-49ae-91ee-d8106041ec12 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:11.883834 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 280/551] 10.222.0.39 () {56 vars in 1135 bytes} [Mon May 23 15:36:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:11.889871 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d09042-7790-49ae-91ee-d8106041ec12 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:11.929774 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bb894-6eea-4468-a85a-6a6cb366fd35 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:11.978393 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17965ad-bf1d-4fd6-9ca5-29f5ee1ef79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:11.979198 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17965ad-bf1d-4fd6-9ca5-29f5ee1ef79c None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:11.979484 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17965ad-bf1d-4fd6-9ca5-29f5ee1ef79c None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:11.979803 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17965ad-bf1d-4fd6-9ca5-29f5ee1ef79c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:11.991854 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17965ad-bf1d-4fd6-9ca5-29f5ee1ef79c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:36:12.000193 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-f17965ad-bf1d-4fd6-9ca5-29f5ee1ef79c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:12.000193 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:12.000193 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:12.000193 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:12.000193 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:12.000193 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:12.000193 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:12.000193 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:12.000193 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:12.000193 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:12.000193 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:12.000193 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:12.000193 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:36:12.000193 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:36:12.000193 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:36:12.000193 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:36:12.001636 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:36:12.001636 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:36:12.001636 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:36:12.001636 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:36:12.001636 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:12.001636 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:12.001636 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:12.001636 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:12.001636 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:12.001636 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:12.001636 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:12.001636 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:12.001636 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:12.001636 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:12.001636 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:12.001636 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:12.002451 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:12.002451 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:12.002451 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:12.002451 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:12.002451 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:36:12.002451 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:36:12.002451 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:36:12.002451 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:36:12.002451 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:36:12.002451 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:36:12.002451 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:12.002451 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:12.005163 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 272/552] 10.222.0.39 () {56 vars in 1102 bytes} [Mon May 23 15:36:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:12.006618 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4d77c-fefc-4120-a8db-c34b19af57bc None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:12.007113 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4d77c-fefc-4120-a8db-c34b19af57bc None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:12.007666 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4d77c-fefc-4120-a8db-c34b19af57bc None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:12.009396 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 273/553] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:12.010856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4d77c-fefc-4120-a8db-c34b19af57bc None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:12.022390 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d09042-7790-49ae-91ee-d8106041ec12 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:12.061302 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:12.068512 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93108a8e-c1b9-4e8e-ba85-bb57a9ae41e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:12.069196 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93108a8e-c1b9-4e8e-ba85-bb57a9ae41e8 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:12.069479 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93108a8e-c1b9-4e8e-ba85-bb57a9ae41e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:12.069757 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93108a8e-c1b9-4e8e-ba85-bb57a9ae41e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:12.089881 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:12.129564 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4d77c-fefc-4120-a8db-c34b19af57bc None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:12.161059 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93108a8e-c1b9-4e8e-ba85-bb57a9ae41e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:12.162991 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93108a8e-c1b9-4e8e-ba85-bb57a9ae41e8 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:12.171725 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21461c1c-c8a5-406e-8fe9-98925ee8f3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:12.172427 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21461c1c-c8a5-406e-8fe9-98925ee8f3c6 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:12.172706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21461c1c-c8a5-406e-8fe9-98925ee8f3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:12.172971 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21461c1c-c8a5-406e-8fe9-98925ee8f3c6 None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:12.173713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21461c1c-c8a5-406e-8fe9-98925ee8f3c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:12.174017 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21461c1c-c8a5-406e-8fe9-98925ee8f3c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:12.175389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21461c1c-c8a5-406e-8fe9-98925ee8f3c6 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:12.184847 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 274/554] 10.222.0.39 () {56 vars in 1103 bytes} [Mon May 23 15:36:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:12.186355 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcdbbf-dc23-44ab-b9ca-8e3b65567d0f None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:12.186843 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcdbbf-dc23-44ab-b9ca-8e3b65567d0f None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:12.187339 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcdbbf-dc23-44ab-b9ca-8e3b65567d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:12.247565 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-b9fcdbbf-dc23-44ab-b9ca-8e3b65567d0f None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:12.248991 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-b9fcdbbf-dc23-44ab-b9ca-8e3b65567d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:12.319803 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 275/555] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:36:12.320996 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fcdbbf-dc23-44ab-b9ca-8e3b65567d0f None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:12.338657 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 281/556] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:36:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:36:12.345645 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93108a8e-c1b9-4e8e-ba85-bb57a9ae41e8 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:12.385940 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:12.386274 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:12.429049 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fcdbbf-dc23-44ab-b9ca-8e3b65567d0f None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:12.470380 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fabf367-2119-48e3-9ba1-ba716d2859ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:12.471517 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabf367-2119-48e3-9ba1-ba716d2859ad None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:12.471956 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabf367-2119-48e3-9ba1-ba716d2859ad None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:12.472383 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabf367-2119-48e3-9ba1-ba716d2859ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:12.473610 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93108a8e-c1b9-4e8e-ba85-bb57a9ae41e8 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:12.483279 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fabf367-2119-48e3-9ba1-ba716d2859ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:12.485243 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fabf367-2119-48e3-9ba1-ba716d2859ad None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:12.504641 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-0fabf367-2119-48e3-9ba1-ba716d2859ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:12.504641 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:12.504641 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:12.504641 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:12.504641 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:12.504641 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:12.504641 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:12.504641 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:12.504641 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:12.504641 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:12.504641 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:12.504641 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:12.504641 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:12.504641 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:12.504641 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:12.505786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:12.505786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:12.505786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:12.505786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:12.505786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:12.505786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:12.505786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:12.505786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:12.505786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:12.505786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:12.505786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:12.505786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:12.505786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:12.505786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:12.505786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:12.505786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:12.505786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:12.506803 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:12.506803 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:12.506803 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:12.506803 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:12.508643 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 276/557] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:12.513950 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fabf367-2119-48e3-9ba1-ba716d2859ad None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:12.518706 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46556c9b-c2dd-4dd4-881d-1c98e633ce2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:12.519727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46556c9b-c2dd-4dd4-881d-1c98e633ce2a None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:12.520155 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46556c9b-c2dd-4dd4-881d-1c98e633ce2a None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:12.520598 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46556c9b-c2dd-4dd4-881d-1c98e633ce2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:12.534822 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46556c9b-c2dd-4dd4-881d-1c98e633ce2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:12.537055 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46556c9b-c2dd-4dd4-881d-1c98e633ce2a None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:12.560560 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-46556c9b-c2dd-4dd4-881d-1c98e633ce2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:12.560560 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:12.560560 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:12.560560 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:12.560560 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:12.560560 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:12.560560 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:12.560560 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:12.560560 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:12.560560 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:12.560560 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:12.560560 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:12.560560 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:12.560560 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:12.560560 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:12.561967 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:12.561967 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:12.561967 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:12.561967 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:12.561967 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:12.561967 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:12.561967 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:12.561967 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:12.561967 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:12.561967 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:12.561967 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:12.561967 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:12.561967 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:12.561967 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:12.561967 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:12.561967 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:12.561967 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:12.562861 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:12.562861 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:12.562861 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:12.562861 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:12.569933 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 282/558] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:12.569933 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46556c9b-c2dd-4dd4-881d-1c98e633ce2a None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:12.632179 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fabf367-2119-48e3-9ba1-ba716d2859ad None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:12.648339 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:12.664569 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:12.668998 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d46e0f-ad38-4bca-ac37-4ab1bb8dd404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:12.669793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d46e0f-ad38-4bca-ac37-4ab1bb8dd404 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:12.670069 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d46e0f-ad38-4bca-ac37-4ab1bb8dd404 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:12.670346 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d46e0f-ad38-4bca-ac37-4ab1bb8dd404 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:12.680310 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d46e0f-ad38-4bca-ac37-4ab1bb8dd404 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:36:12.683397 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46556c9b-c2dd-4dd4-881d-1c98e633ce2a None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:12.688772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-29d46e0f-ad38-4bca-ac37-4ab1bb8dd404 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:12.688772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:12.688772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:12.688772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:12.688772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:12.688772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:12.688772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:12.688772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:12.688772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:12.688772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:12.688772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:12.688772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:12.688772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:36:12.688772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:36:12.688772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:36:12.688772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:36:12.689713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:36:12.689713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:36:12.689713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:36:12.689713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:36:12.689713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:12.689713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:12.689713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:12.689713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:12.689713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:12.689713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:12.689713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:12.689713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:12.689713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:12.689713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:12.689713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:12.689713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:12.690656 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:12.690656 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:12.690656 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:12.690656 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:12.690656 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:36:12.690656 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:36:12.690656 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:36:12.690656 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:36:12.690656 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:36:12.690656 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:36:12.690656 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:12.690656 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:12.690656 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 277/559] 10.222.0.39 () {56 vars in 1102 bytes} [Mon May 23 15:36:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:12.691952 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d46e0f-ad38-4bca-ac37-4ab1bb8dd404 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:12.724032 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6acf7a6-d07d-410c-b0fb-22517aa2d0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:12.724741 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acf7a6-d07d-410c-b0fb-22517aa2d0f4 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:12.725179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acf7a6-d07d-410c-b0fb-22517aa2d0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:12.726576 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acf7a6-d07d-410c-b0fb-22517aa2d0f4 None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:12.727707 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6acf7a6-d07d-410c-b0fb-22517aa2d0f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:12.728265 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6acf7a6-d07d-410c-b0fb-22517aa2d0f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:12.730564 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6acf7a6-d07d-410c-b0fb-22517aa2d0f4 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:12.743642 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 283/560] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:12.744839 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bea5c-65c8-420c-a86b-d60d5fc6b7e7 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:12.745183 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bea5c-65c8-420c-a86b-d60d5fc6b7e7 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:12.745480 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bea5c-65c8-420c-a86b-d60d5fc6b7e7 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:12.751591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 284/561] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:12.751591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0bea5c-65c8-420c-a86b-d60d5fc6b7e7 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:12.803072 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d46e0f-ad38-4bca-ac37-4ab1bb8dd404 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:12.838980 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a2a19-8446-459e-97d3-67b8fc989dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:12.839670 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a2a19-8446-459e-97d3-67b8fc989dd0 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:12.839960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a2a19-8446-459e-97d3-67b8fc989dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:12.840664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a2a19-8446-459e-97d3-67b8fc989dd0 None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:12.841024 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a2a19-8446-459e-97d3-67b8fc989dd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:12.841337 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a2a19-8446-459e-97d3-67b8fc989dd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:12.843214 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a2a19-8446-459e-97d3-67b8fc989dd0 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:12.855514 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 278/562] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:12.857484 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3404c56-0b25-4e8c-8451-0f2c919432bd None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:12.857776 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3404c56-0b25-4e8c-8451-0f2c919432bd None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:12.858053 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3404c56-0b25-4e8c-8451-0f2c919432bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:12.861343 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0bea5c-65c8-420c-a86b-d60d5fc6b7e7 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:12.877399 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-b3404c56-0b25-4e8c-8451-0f2c919432bd None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:12.878818 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-b3404c56-0b25-4e8c-8451-0f2c919432bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:12.905535 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb49f95-8f57-4499-92ae-74124723f95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:12.906652 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb49f95-8f57-4499-92ae-74124723f95a None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:12.906938 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb49f95-8f57-4499-92ae-74124723f95a None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:12.907383 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb49f95-8f57-4499-92ae-74124723f95a None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:12.908070 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:12.908242 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb49f95-8f57-4499-92ae-74124723f95a None admin] RBAC: Adding query filter params (name=service) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:12.909204 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb49f95-8f57-4499-92ae-74124723f95a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:12.910603 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb49f95-8f57-4499-92ae-74124723f95a None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:12.925235 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 285/563] 10.222.0.39 () {56 vars in 1103 bytes} [Mon May 23 15:36:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:12.925235 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb49f95-8f57-4499-92ae-74124723f95a None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:12.929233 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:12.959763 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 279/564] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:36:12.960799 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3404c56-0b25-4e8c-8451-0f2c919432bd None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:13.035133 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb49f95-8f57-4499-92ae-74124723f95a None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:13.070571 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c82c81-02ee-46d0-82be-b9578edb51a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:13.071286 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c82c81-02ee-46d0-82be-b9578edb51a5 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:13.071570 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c82c81-02ee-46d0-82be-b9578edb51a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:13.071879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c82c81-02ee-46d0-82be-b9578edb51a5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:13.074911 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3404c56-0b25-4e8c-8451-0f2c919432bd None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:13.080253 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c82c81-02ee-46d0-82be-b9578edb51a5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:13.081885 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c82c81-02ee-46d0-82be-b9578edb51a5 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:13.096877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-01c82c81-02ee-46d0-82be-b9578edb51a5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 15:36:13.096877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:13.096877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:13.096877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:13.096877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:13.096877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:13.096877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:13.096877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:13.096877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:13.096877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:13.096877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:13.096877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:13.096877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:36:13.096877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:36:13.096877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:36:13.096877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:36:13.097970 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:13.097970 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:13.097970 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:36:13.097970 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:13.097970 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:36:13.097970 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:13.097970 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:13.097970 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:13.097970 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:13.097970 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:13.097970 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:13.097970 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:13.097970 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:13.097970 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:13.097970 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:13.097970 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:13.097970 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:13.097970 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:13.098905 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:13.098905 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:13.098905 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:36:13.098905 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:36:13.098905 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:36:13.098905 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:36:13.098905 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:36:13.098905 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:36:13.098905 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 15:36:13.098905 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:13.099446 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 286/565] 10.222.0.39 () {56 vars in 1093 bytes} [Mon May 23 15:36:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:13.100227 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c82c81-02ee-46d0-82be-b9578edb51a5 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:13.115909 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8db4a5-b4c2-46ab-8eb1-b8fac3423030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:13.116926 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8db4a5-b4c2-46ab-8eb1-b8fac3423030 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:13.117211 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8db4a5-b4c2-46ab-8eb1-b8fac3423030 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:13.117483 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8db4a5-b4c2-46ab-8eb1-b8fac3423030 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:13.125480 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8db4a5-b4c2-46ab-8eb1-b8fac3423030 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:13.126958 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8db4a5-b4c2-46ab-8eb1-b8fac3423030 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:13.141660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-8f8db4a5-b4c2-46ab-8eb1-b8fac3423030 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:13.141660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:13.141660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:13.141660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:13.141660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:13.141660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:13.141660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:13.141660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:13.141660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:13.141660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:13.141660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:13.141660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:13.141660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:36:13.141660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:36:13.141660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:36:13.142599 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:36:13.142599 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:13.142599 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:13.142599 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:13.142599 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:13.142599 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:13.142599 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:13.142599 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:13.142599 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:13.142599 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:13.142599 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:13.142599 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:13.142599 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:13.142599 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:13.142599 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:13.142599 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:13.142599 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:13.143485 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:36:13.143485 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:36:13.143485 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:36:13.143485 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:36:13.143485 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:36:13.143485 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:36:13.143485 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:13.143485 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:13.143485 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 280/566] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:36:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:13.144004 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8db4a5-b4c2-46ab-8eb1-b8fac3423030 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:13.174201 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:13.176616 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:13.223270 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c82c81-02ee-46d0-82be-b9578edb51a5 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:13.258801 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8db4a5-b4c2-46ab-8eb1-b8fac3423030 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:13.259451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064cca2-c6f6-4a05-8eab-fb07539ab4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:13.260453 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064cca2-c6f6-4a05-8eab-fb07539ab4b6 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:13.260744 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064cca2-c6f6-4a05-8eab-fb07539ab4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:13.261792 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064cca2-c6f6-4a05-8eab-fb07539ab4b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:13.274666 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a064cca2-c6f6-4a05-8eab-fb07539ab4b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:13.276176 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a064cca2-c6f6-4a05-8eab-fb07539ab4b6 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:13.293392 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e9772-e1c9-4891-873f-ed90c1940313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:13.294186 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e9772-e1c9-4891-873f-ed90c1940313 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:13.294362 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-a064cca2-c6f6-4a05-8eab-fb07539ab4b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:13.294362 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:13.294362 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:13.294362 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:13.294362 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:13.294362 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:13.294362 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:13.294362 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:13.294362 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:13.294362 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:13.294362 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:13.294362 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:13.294362 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:13.294362 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:13.294362 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:13.295222 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:13.295222 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:13.295222 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:13.295222 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:13.295222 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:13.295222 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:13.295222 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:13.295222 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:13.295222 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:13.295222 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:13.295222 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:13.295222 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:13.295222 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:13.295222 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:13.295222 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:13.295222 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:13.295222 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:13.296516 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:13.296516 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:13.296516 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:13.296516 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:13.296736 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e9772-e1c9-4891-873f-ed90c1940313 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:13.296736 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e9772-e1c9-4891-873f-ed90c1940313 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:13.296861 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 287/567] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:13.296861 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064cca2-c6f6-4a05-8eab-fb07539ab4b6 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:13.310558 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e9772-e1c9-4891-873f-ed90c1940313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:36:13.318290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-412e9772-e1c9-4891-873f-ed90c1940313 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:13.318290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:13.318290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:13.318290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:13.318290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:13.318290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:13.318290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:13.318290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:13.318290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:13.318290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:13.318290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:13.318290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:13.318290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:36:13.318290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:36:13.318290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:36:13.318290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:36:13.319213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:36:13.319213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:36:13.319213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:36:13.319213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:36:13.319213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:13.319213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:13.319213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:13.319213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:13.319213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:13.319213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:13.319213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:13.319213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:13.319213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:13.319213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:13.319213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:13.319213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:13.325069 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:13.325069 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:13.325069 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:13.325069 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:13.325069 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:36:13.325069 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:36:13.325069 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:36:13.325069 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:36:13.325069 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:36:13.325069 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:36:13.325069 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:13.325069 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:13.325069 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 281/568] 10.222.0.39 () {56 vars in 1102 bytes} [Mon May 23 15:36:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:13.325069 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e9772-e1c9-4891-873f-ed90c1940313 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:13.413769 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064cca2-c6f6-4a05-8eab-fb07539ab4b6 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:13.415540 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:13.431709 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:13.431970 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e9772-e1c9-4891-873f-ed90c1940313 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:13.450363 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cde08d-73c8-4a35-ac93-6e5cb0f1561f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:13.451303 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cde08d-73c8-4a35-ac93-6e5cb0f1561f None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:13.451586 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cde08d-73c8-4a35-ac93-6e5cb0f1561f None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:13.451894 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cde08d-73c8-4a35-ac93-6e5cb0f1561f None admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:13.452743 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cde08d-73c8-4a35-ac93-6e5cb0f1561f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:13.453062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cde08d-73c8-4a35-ac93-6e5cb0f1561f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:13.454595 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cde08d-73c8-4a35-ac93-6e5cb0f1561f None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:13.469877 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63381b52-c733-44dd-b64c-5a7fa1411b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:13.470534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63381b52-c733-44dd-b64c-5a7fa1411b34 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:13.470821 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63381b52-c733-44dd-b64c-5a7fa1411b34 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:13.471098 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63381b52-c733-44dd-b64c-5a7fa1411b34 None admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:13.471931 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63381b52-c733-44dd-b64c-5a7fa1411b34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:13.472244 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63381b52-c733-44dd-b64c-5a7fa1411b34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:13.477924 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 288/569] 10.222.0.39 () {56 vars in 1133 bytes} [Mon May 23 15:36:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:13.478063 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63381b52-c733-44dd-b64c-5a7fa1411b34 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:13.478152 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cde08d-73c8-4a35-ac93-6e5cb0f1561f None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:13.495287 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 282/570] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:36:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:13.495287 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63381b52-c733-44dd-b64c-5a7fa1411b34 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:13.587010 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cde08d-73c8-4a35-ac93-6e5cb0f1561f None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:13.600134 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63381b52-c733-44dd-b64c-5a7fa1411b34 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:13.620432 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8445e7-64a9-44d7-9dc6-670e662e7c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:13.621085 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8445e7-64a9-44d7-9dc6-670e662e7c94 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:13.621995 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8445e7-64a9-44d7-9dc6-670e662e7c94 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:13.622280 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8445e7-64a9-44d7-9dc6-670e662e7c94 None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:13.623089 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8445e7-64a9-44d7-9dc6-670e662e7c94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:13.623428 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8445e7-64a9-44d7-9dc6-670e662e7c94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:13.624822 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8445e7-64a9-44d7-9dc6-670e662e7c94 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:13.634339 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592369d1-dfd5-4b1c-b757-99cffcb60817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:13.634999 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592369d1-dfd5-4b1c-b757-99cffcb60817 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:13.635280 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592369d1-dfd5-4b1c-b757-99cffcb60817 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:13.635557 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592369d1-dfd5-4b1c-b757-99cffcb60817 None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:13.635916 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 289/571] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:13.636335 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592369d1-dfd5-4b1c-b757-99cffcb60817 None admin] RBAC: Adding query filter params (name=service) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:13.636646 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592369d1-dfd5-4b1c-b757-99cffcb60817 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:13.636739 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8445e7-64a9-44d7-9dc6-670e662e7c94 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:13.638195 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592369d1-dfd5-4b1c-b757-99cffcb60817 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:13.647462 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 283/572] 10.222.0.39 () {56 vars in 1103 bytes} [Mon May 23 15:36:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:13.648157 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592369d1-dfd5-4b1c-b757-99cffcb60817 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:13.658932 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:13.673729 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:13.737205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8445e7-64a9-44d7-9dc6-670e662e7c94 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:13.749454 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592369d1-dfd5-4b1c-b757-99cffcb60817 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:13.769454 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1bc11-98f2-4c3d-9f27-76fa36488e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:13.770234 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1bc11-98f2-4c3d-9f27-76fa36488e47 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:13.770512 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1bc11-98f2-4c3d-9f27-76fa36488e47 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:13.770785 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1bc11-98f2-4c3d-9f27-76fa36488e47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:13.781494 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1bc11-98f2-4c3d-9f27-76fa36488e47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:13.782731 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313834d3-ce27-4ef4-b4e2-86b41b7bdf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:13.782925 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1bc11-98f2-4c3d-9f27-76fa36488e47 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:13.783379 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313834d3-ce27-4ef4-b4e2-86b41b7bdf72 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:13.783696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313834d3-ce27-4ef4-b4e2-86b41b7bdf72 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:13.783979 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313834d3-ce27-4ef4-b4e2-86b41b7bdf72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:13.784805 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313834d3-ce27-4ef4-b4e2-86b41b7bdf72 None admin] RBAC: Adding query filter params (role.id=b57c4ebab8e842088df37b551053b113, scope.project.id=8addb03b903842609168ee2fafc8ec6b, user.id=b275a110936a44ce8d54793af1a34808) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:13.785116 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313834d3-ce27-4ef4-b4e2-86b41b7bdf72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:13.786547 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313834d3-ce27-4ef4-b4e2-86b41b7bdf72 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:13.792031 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 284/573] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:36:13 2022] GET /identity/v3/role_assignments?user.id=b275a110936a44ce8d54793af1a34808&scope.project.id=8addb03b903842609168ee2fafc8ec6b&role.id=b57c4ebab8e842088df37b551053b113 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:13.793790 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c100554-ebc0-4fab-9df8-2f6c3524256e None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:13.794088 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c100554-ebc0-4fab-9df8-2f6c3524256e None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:13.794538 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c100554-ebc0-4fab-9df8-2f6c3524256e None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:13.796912 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 285/574] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:13.796912 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c100554-ebc0-4fab-9df8-2f6c3524256e None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:13.800103 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-21f1bc11-98f2-4c3d-9f27-76fa36488e47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:13.800103 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:13.800103 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:13.800103 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:13.800103 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:13.800103 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:13.800103 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:13.800103 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:13.800103 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:13.800103 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:13.800103 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:13.800103 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:13.800103 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:13.800103 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:13.800103 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:13.801035 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:13.801035 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:13.801035 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:13.801035 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:13.801035 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:13.801035 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:13.801035 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:13.801035 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:13.801035 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:13.801035 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:13.801035 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:13.801035 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:13.801035 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:13.801035 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:13.801035 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:13.801035 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:13.801035 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:13.801938 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:13.801938 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:13.801938 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:13.801938 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:13.801938 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 290/575] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:13.802210 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1bc11-98f2-4c3d-9f27-76fa36488e47 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:13.881657 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:13.906298 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:13.916143 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c100554-ebc0-4fab-9df8-2f6c3524256e None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:13.923407 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1bc11-98f2-4c3d-9f27-76fa36488e47 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:13.957289 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a30564-c7c0-447c-8fb9-7918230f6e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:13.958100 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a30564-c7c0-447c-8fb9-7918230f6e31 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:13.958377 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a30564-c7c0-447c-8fb9-7918230f6e31 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:13.958656 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a30564-c7c0-447c-8fb9-7918230f6e31 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:13.961670 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c184f81-db6c-4361-a359-00555f9d384c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:13.962662 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c184f81-db6c-4361-a359-00555f9d384c None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:13.963095 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c184f81-db6c-4361-a359-00555f9d384c None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:13.963541 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c184f81-db6c-4361-a359-00555f9d384c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:13.967780 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a30564-c7c0-447c-8fb9-7918230f6e31 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:13.969240 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a30564-c7c0-447c-8fb9-7918230f6e31 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:13.976536 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c184f81-db6c-4361-a359-00555f9d384c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:13.978004 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c184f81-db6c-4361-a359-00555f9d384c None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:13.985750 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-21a30564-c7c0-447c-8fb9-7918230f6e31 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 23 15:36:13.985750 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:13.985750 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:13.985750 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:13.985750 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:13.985750 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:13.985750 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:13.985750 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:13.985750 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:13.985750 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:13.985750 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:13.985750 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:13.985750 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:36:13.985750 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:36:13.985750 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:36:13.985750 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:36:13.986793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:13.986793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:13.986793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:36:13.986793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:13.986793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:36:13.986793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:13.986793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:13.986793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:13.986793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:13.986793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:13.986793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:13.986793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:13.986793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:13.986793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:13.986793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:13.986793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:13.986793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:13.986793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:13.988514 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:13.988514 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:13.988514 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:36:13.988514 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:36:13.988514 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:36:13.988514 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:36:13.988514 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:36:13.988514 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:36:13.988514 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 23 15:36:13.988514 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:13.991624 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 286/576] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:36:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:13.992915 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd21f2-080e-4910-b149-b2dd2d0c7939 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:13.993203 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd21f2-080e-4910-b149-b2dd2d0c7939 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:13.993478 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd21f2-080e-4910-b149-b2dd2d0c7939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:14.000965 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-1c184f81-db6c-4361-a359-00555f9d384c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:14.000965 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:14.000965 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:14.000965 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:14.000965 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:14.000965 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:14.000965 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:14.000965 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:14.000965 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:14.000965 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:14.000965 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:14.000965 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:14.000965 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:14.000965 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:14.000965 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:14.001860 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:14.001860 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:14.001860 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:14.001860 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:14.001860 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:14.001860 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:14.001860 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:14.001860 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:14.001860 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:14.001860 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:14.001860 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:14.001860 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:14.001860 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:14.001860 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:14.001860 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:14.001860 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:14.001860 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:14.002755 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:14.002755 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:14.002755 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:14.002755 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:14.004747 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 291/577] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:14.005684 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c184f81-db6c-4361-a359-00555f9d384c None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:14.015337 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-4acd21f2-080e-4910-b149-b2dd2d0c7939 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:14.016551 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-4acd21f2-080e-4910-b149-b2dd2d0c7939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:14.082196 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 287/578] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:36:14.083049 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd21f2-080e-4910-b149-b2dd2d0c7939 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:14.128126 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c184f81-db6c-4361-a359-00555f9d384c None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:14.155463 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:14.164137 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0895f2b-36d3-4ecd-a978-2a30fac12918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:14.164804 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0895f2b-36d3-4ecd-a978-2a30fac12918 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:14.165091 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0895f2b-36d3-4ecd-a978-2a30fac12918 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:14.165413 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0895f2b-36d3-4ecd-a978-2a30fac12918 None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:14.167372 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0895f2b-36d3-4ecd-a978-2a30fac12918 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:14.167372 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0895f2b-36d3-4ecd-a978-2a30fac12918 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:14.168081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0895f2b-36d3-4ecd-a978-2a30fac12918 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:14.175522 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:14.181495 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 292/579] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:14.182154 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0895f2b-36d3-4ecd-a978-2a30fac12918 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:14.206011 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd21f2-080e-4910-b149-b2dd2d0c7939 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:14.245921 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbeeef5-0bb5-4efc-bb2c-529309272bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:14.247231 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbeeef5-0bb5-4efc-bb2c-529309272bbd None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:14.247456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbeeef5-0bb5-4efc-bb2c-529309272bbd None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:14.247753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbeeef5-0bb5-4efc-bb2c-529309272bbd None admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:14.248605 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbeeef5-0bb5-4efc-bb2c-529309272bbd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:14.248891 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbeeef5-0bb5-4efc-bb2c-529309272bbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:14.250336 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbeeef5-0bb5-4efc-bb2c-529309272bbd None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:14.272210 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 288/580] 10.222.0.39 () {56 vars in 1137 bytes} [Mon May 23 15:36:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:14.272210 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbeeef5-0bb5-4efc-bb2c-529309272bbd None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:14.300391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0895f2b-36d3-4ecd-a978-2a30fac12918 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:14.336747 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4715c25-ede8-4c25-ac17-f430c49ae379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:14.337404 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4715c25-ede8-4c25-ac17-f430c49ae379 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:14.337688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4715c25-ede8-4c25-ac17-f430c49ae379 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:14.337964 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4715c25-ede8-4c25-ac17-f430c49ae379 None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:14.338684 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4715c25-ede8-4c25-ac17-f430c49ae379 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:14.338993 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4715c25-ede8-4c25-ac17-f430c49ae379 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:14.341056 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4715c25-ede8-4c25-ac17-f430c49ae379 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:14.357646 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 293/581] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:14.357646 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4715c25-ede8-4c25-ac17-f430c49ae379 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:14.385955 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbeeef5-0bb5-4efc-bb2c-529309272bbd None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:14.405316 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:14.418642 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:14.423245 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785327d-ba00-49ee-8628-065ee6082aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:14.424065 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785327d-ba00-49ee-8628-065ee6082aaf None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:14.424342 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785327d-ba00-49ee-8628-065ee6082aaf None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:14.424612 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785327d-ba00-49ee-8628-065ee6082aaf None admin] PATH_INFO: `/v3/roles/service` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:14.434656 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785327d-ba00-49ee-8628-065ee6082aaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:36:14.442908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-d785327d-ba00-49ee-8628-065ee6082aaf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:14.442908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:14.442908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:14.442908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:14.442908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:14.442908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:14.442908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:14.442908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:14.442908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:14.442908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:14.442908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:14.442908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:14.442908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:36:14.442908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:36:14.442908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:36:14.442908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:36:14.444133 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:36:14.444133 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:36:14.444133 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:36:14.444133 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:36:14.444133 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:14.444133 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:14.444133 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:14.444133 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:14.444133 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:14.444133 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:14.444133 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:14.444133 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:14.444133 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:14.444133 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:14.444133 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:14.444133 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:14.444980 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:14.444980 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:14.444980 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:14.444980 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:14.444980 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:36:14.444980 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:36:14.444980 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:36:14.444980 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:36:14.444980 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:36:14.444980 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:36:14.444980 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:14.444980 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:14.449997 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 289/582] 10.222.0.39 () {56 vars in 1102 bytes} [Mon May 23 15:36:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:14.451106 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785327d-ba00-49ee-8628-065ee6082aaf None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:14.465858 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4715c25-ede8-4c25-ac17-f430c49ae379 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:14.503618 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e5f5ca-d199-4ceb-b1f2-12fe695bc7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:14.504605 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5f5ca-d199-4ceb-b1f2-12fe695bc7a4 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:14.504896 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5f5ca-d199-4ceb-b1f2-12fe695bc7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:14.505174 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5f5ca-d199-4ceb-b1f2-12fe695bc7a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:14.513058 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e5f5ca-d199-4ceb-b1f2-12fe695bc7a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:14.514796 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e5f5ca-d199-4ceb-b1f2-12fe695bc7a4 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:14.529872 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-b8e5f5ca-d199-4ceb-b1f2-12fe695bc7a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:14.529872 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:14.529872 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:14.529872 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:14.529872 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:14.529872 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:14.529872 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:14.529872 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:14.529872 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:14.529872 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:14.529872 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:14.529872 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:14.529872 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:36:14.529872 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:36:14.529872 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:36:14.530769 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:36:14.530769 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:14.530769 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:14.530769 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:14.530769 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:14.530769 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:14.530769 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:14.530769 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:14.530769 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:14.530769 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:14.530769 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:14.530769 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:14.530769 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:14.530769 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:14.530769 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:14.530769 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:14.530769 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:14.531678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:36:14.531678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:36:14.531678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:36:14.531678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:36:14.531678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:36:14.531678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:36:14.531678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:14.531678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:14.531678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 294/583] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:36:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:14.532767 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e5f5ca-d199-4ceb-b1f2-12fe695bc7a4 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:14.559682 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785327d-ba00-49ee-8628-065ee6082aaf None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:14.594877 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27f8cf-7f72-4c2e-9374-fd7ed31bb19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:14.595741 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27f8cf-7f72-4c2e-9374-fd7ed31bb19f None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:14.596025 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27f8cf-7f72-4c2e-9374-fd7ed31bb19f None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:14.596299 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27f8cf-7f72-4c2e-9374-fd7ed31bb19f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:14.607110 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df27f8cf-7f72-4c2e-9374-fd7ed31bb19f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:14.608593 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df27f8cf-7f72-4c2e-9374-fd7ed31bb19f None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:14.626429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-df27f8cf-7f72-4c2e-9374-fd7ed31bb19f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:14.626429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:14.626429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:14.626429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:14.626429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:14.626429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:14.626429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:14.626429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:14.626429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:14.626429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:14.626429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:14.626429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:14.626429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:14.626429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:14.626429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:14.627340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:14.627340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:14.627340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:14.627340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:14.627340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:14.627340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:14.627340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:14.627340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:14.627340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:14.627340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:14.627340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:14.627340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:14.627340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:14.627340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:14.627340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:14.627340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:14.627340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:14.628277 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:14.628277 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:14.628277 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:14.628277 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:14.628277 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 290/584] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:14.628551 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27f8cf-7f72-4c2e-9374-fd7ed31bb19f None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:14.642554 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e5f5ca-d199-4ceb-b1f2-12fe695bc7a4 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:14.661085 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:14.661935 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:14.678112 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086ef02-e127-4513-8571-303887dd2927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:14.678832 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086ef02-e127-4513-8571-303887dd2927 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:14.679114 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086ef02-e127-4513-8571-303887dd2927 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:14.679392 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086ef02-e127-4513-8571-303887dd2927 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:14.687623 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4086ef02-e127-4513-8571-303887dd2927 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:14.689069 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4086ef02-e127-4513-8571-303887dd2927 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:14.704148 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-4086ef02-e127-4513-8571-303887dd2927 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 15:36:14.704148 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:14.704148 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:14.704148 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:14.704148 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:14.704148 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:14.704148 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:14.704148 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:14.704148 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:14.704148 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:14.704148 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:14.704148 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:14.704148 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:36:14.704148 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:36:14.704148 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:36:14.704148 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:36:14.705367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:14.705367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:14.705367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:36:14.705367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:14.705367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:36:14.705367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:14.705367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:14.705367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:14.705367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:14.705367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:14.705367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:14.705367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:14.705367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:14.705367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:14.705367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:14.705367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:14.705367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:14.705367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:14.706317 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:14.706317 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:14.706317 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:36:14.706317 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:36:14.706317 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:36:14.706317 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:36:14.706317 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:36:14.706317 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:36:14.706317 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 15:36:14.706317 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:14.706317 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 295/585] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:36:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:14.706317 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086ef02-e127-4513-8571-303887dd2927 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:14.741606 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27f8cf-7f72-4c2e-9374-fd7ed31bb19f None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:14.780689 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96c491-304e-4ac3-a0a3-b9087c02e2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:14.781348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96c491-304e-4ac3-a0a3-b9087c02e2b3 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:14.781629 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96c491-304e-4ac3-a0a3-b9087c02e2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:14.781905 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96c491-304e-4ac3-a0a3-b9087c02e2b3 None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:14.782642 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96c491-304e-4ac3-a0a3-b9087c02e2b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:14.782948 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96c491-304e-4ac3-a0a3-b9087c02e2b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:14.784341 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96c491-304e-4ac3-a0a3-b9087c02e2b3 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:14.792345 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 291/586] 10.222.0.39 () {56 vars in 1103 bytes} [Mon May 23 15:36:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:14.793160 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96c491-304e-4ac3-a0a3-b9087c02e2b3 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:14.820189 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086ef02-e127-4513-8571-303887dd2927 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:14.860046 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add74c5b-8b88-4fc1-8ff8-6b29e4bf98ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:14.860808 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add74c5b-8b88-4fc1-8ff8-6b29e4bf98ab None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:14.861087 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add74c5b-8b88-4fc1-8ff8-6b29e4bf98ab None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:14.861385 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add74c5b-8b88-4fc1-8ff8-6b29e4bf98ab None admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:14.862246 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add74c5b-8b88-4fc1-8ff8-6b29e4bf98ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:14.862561 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add74c5b-8b88-4fc1-8ff8-6b29e4bf98ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:14.864015 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add74c5b-8b88-4fc1-8ff8-6b29e4bf98ab None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:14.879440 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 296/587] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:36:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:14.880302 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add74c5b-8b88-4fc1-8ff8-6b29e4bf98ab None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:14.899515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:14.908810 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96c491-304e-4ac3-a0a3-b9087c02e2b3 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:14.926751 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:14.945662 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52377ee1-2beb-42d5-bb86-a7c012f84ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:14.946259 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52377ee1-2beb-42d5-bb86-a7c012f84ebc None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:14.946545 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52377ee1-2beb-42d5-bb86-a7c012f84ebc None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:14.946826 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52377ee1-2beb-42d5-bb86-a7c012f84ebc None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:14.947554 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52377ee1-2beb-42d5-bb86-a7c012f84ebc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:14.947891 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52377ee1-2beb-42d5-bb86-a7c012f84ebc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:14.949272 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52377ee1-2beb-42d5-bb86-a7c012f84ebc None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:14.963638 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 292/588] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:14.963638 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52377ee1-2beb-42d5-bb86-a7c012f84ebc None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:15.002160 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add74c5b-8b88-4fc1-8ff8-6b29e4bf98ab None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:15.043155 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda4fb0-bac7-495e-a2bc-1d53560a10f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:15.043945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda4fb0-bac7-495e-a2bc-1d53560a10f2 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:15.044416 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda4fb0-bac7-495e-a2bc-1d53560a10f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:15.044701 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda4fb0-bac7-495e-a2bc-1d53560a10f2 None admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:15.047132 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda4fb0-bac7-495e-a2bc-1d53560a10f2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:15.047449 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda4fb0-bac7-495e-a2bc-1d53560a10f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:15.049385 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda4fb0-bac7-495e-a2bc-1d53560a10f2 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:15.070785 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 297/589] 10.222.0.39 () {56 vars in 1137 bytes} [Mon May 23 15:36:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:15.071523 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52377ee1-2beb-42d5-bb86-a7c012f84ebc None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:15.072229 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda4fb0-bac7-495e-a2bc-1d53560a10f2 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:15.115672 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96db60-725d-4d0c-9a74-d6e3050fc9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:15.116691 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96db60-725d-4d0c-9a74-d6e3050fc9af None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:15.116976 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96db60-725d-4d0c-9a74-d6e3050fc9af None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:15.117321 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96db60-725d-4d0c-9a74-d6e3050fc9af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:15.129299 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b96db60-725d-4d0c-9a74-d6e3050fc9af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:15.133578 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b96db60-725d-4d0c-9a74-d6e3050fc9af None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:15.152322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-1b96db60-725d-4d0c-9a74-d6e3050fc9af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:15.152322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:15.152322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:15.152322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:15.152322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:15.152322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:15.152322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:15.152322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:15.152322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:15.152322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:15.152322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:15.152322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:15.152322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:15.152322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:15.152322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:15.153518 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:15.153518 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:15.153518 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:15.153518 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:15.153518 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:15.153518 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:15.153518 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:15.153518 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:15.153518 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:15.153518 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:15.153518 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:15.153518 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:15.153518 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:15.153518 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:15.153518 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:15.153518 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:15.153518 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:15.154631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:15.154631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:15.154631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:15.154631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:15.160777 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 293/590] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:15.160777 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96db60-725d-4d0c-9a74-d6e3050fc9af None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:15.160777 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:15.179195 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:15.186647 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda4fb0-bac7-495e-a2bc-1d53560a10f2 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:15.227292 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1254abf-76c9-450a-8019-9544fbd292a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:15.228215 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1254abf-76c9-450a-8019-9544fbd292a3 None admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:15.228500 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1254abf-76c9-450a-8019-9544fbd292a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:15.228776 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1254abf-76c9-450a-8019-9544fbd292a3 None admin] PATH_INFO: `/v3/projects/8addb03b903842609168ee2fafc8ec6b/users/76f7895b7b5748e7b4461f7fde1d558a/roles/b57c4ebab8e842088df37b551053b113` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:15.243964 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1254abf-76c9-450a-8019-9544fbd292a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=8addb03b903842609168ee2fafc8ec6b, user_id=76f7895b7b5748e7b4461f7fde1d558a, role_id=b57c4ebab8e842088df37b551053b113)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:15.245406 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1254abf-76c9-450a-8019-9544fbd292a3 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:15.270691 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96db60-725d-4d0c-9a74-d6e3050fc9af None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:15.304457 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288d5c3-0bd6-4b78-ae0e-c8e5efdda455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:15.305245 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288d5c3-0bd6-4b78-ae0e-c8e5efdda455 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:15.305533 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288d5c3-0bd6-4b78-ae0e-c8e5efdda455 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:15.305809 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288d5c3-0bd6-4b78-ae0e-c8e5efdda455 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:15.313051 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288d5c3-0bd6-4b78-ae0e-c8e5efdda455 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:15.314491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288d5c3-0bd6-4b78-ae0e-c8e5efdda455 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:15.328587 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-8288d5c3-0bd6-4b78-ae0e-c8e5efdda455 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:15.328587 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:15.328587 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:15.328587 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:15.328587 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:15.328587 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:15.328587 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:15.328587 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:15.328587 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:15.328587 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:15.328587 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:15.328587 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:15.328587 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:36:15.328587 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:36:15.328587 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:36:15.329664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:36:15.329664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:15.329664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:15.329664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:15.329664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:15.329664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:15.329664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:15.329664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:15.329664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:15.329664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:15.329664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:15.329664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:15.329664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:15.329664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:15.329664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:15.329664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:15.329664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:15.330590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:36:15.330590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:36:15.330590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:36:15.330590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:36:15.330590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:36:15.330590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:36:15.330590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:15.330590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:15.330590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 294/591] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:36:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:15.330590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288d5c3-0bd6-4b78-ae0e-c8e5efdda455 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:15.336811 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 298/592] 10.222.0.39 () {58 vars in 1439 bytes} [Mon May 23 15:36:15 2022] PUT /identity/v3/projects/8addb03b903842609168ee2fafc8ec6b/users/76f7895b7b5748e7b4461f7fde1d558a/roles/b57c4ebab8e842088df37b551053b113 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:36:15.337645 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1254abf-76c9-450a-8019-9544fbd292a3 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:15.416414 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:15.463811 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288d5c3-0bd6-4b78-ae0e-c8e5efdda455 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:15.477733 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1254abf-76c9-450a-8019-9544fbd292a3 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:15.506929 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4809e-12d6-4005-9f71-1638d5f99e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:15.508209 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4809e-12d6-4005-9f71-1638d5f99e52 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:15.508702 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4809e-12d6-4005-9f71-1638d5f99e52 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:15.509181 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4809e-12d6-4005-9f71-1638d5f99e52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:15.522909 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4809e-12d6-4005-9f71-1638d5f99e52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:15.525183 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4809e-12d6-4005-9f71-1638d5f99e52 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:15.528362 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab607ba2-49ca-4d68-b7d0-295824706ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:15.529049 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab607ba2-49ca-4d68-b7d0-295824706ed0 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:15.529342 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab607ba2-49ca-4d68-b7d0-295824706ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:15.529626 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab607ba2-49ca-4d68-b7d0-295824706ed0 None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:15.530378 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab607ba2-49ca-4d68-b7d0-295824706ed0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:15.530695 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab607ba2-49ca-4d68-b7d0-295824706ed0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:15.532131 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab607ba2-49ca-4d68-b7d0-295824706ed0 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:15.545813 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 299/593] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:15.545988 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-b0e4809e-12d6-4005-9f71-1638d5f99e52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:15.545988 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:15.545988 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:15.545988 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:15.545988 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:15.545988 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:15.545988 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:15.545988 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:15.545988 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:15.545988 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:15.545988 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:15.545988 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:15.545988 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:15.545988 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:15.545988 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:15.546875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:15.546875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:15.546875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:15.546875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:15.546875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:15.546875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:15.546875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:15.546875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:15.546875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:15.546875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:15.546875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:15.546875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:15.546875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:15.546875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:15.546875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:15.546875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:15.546875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:15.548199 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:15.548199 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:15.548199 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:15.548199 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:15.548446 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab607ba2-49ca-4d68-b7d0-295824706ed0 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:15.549848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 295/594] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:15.553146 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4809e-12d6-4005-9f71-1638d5f99e52 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:15.558457 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:15.677518 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4809e-12d6-4005-9f71-1638d5f99e52 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:15.679733 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab607ba2-49ca-4d68-b7d0-295824706ed0 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:15.700911 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:15.718493 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c5cf0-d586-4f56-820a-9adb403de3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:15.719208 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c5cf0-d586-4f56-820a-9adb403de3be None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:15.719616 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c5cf0-d586-4f56-820a-9adb403de3be None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:15.720172 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c5cf0-d586-4f56-820a-9adb403de3be None admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:15.721014 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c5cf0-d586-4f56-820a-9adb403de3be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:15.721431 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c5cf0-d586-4f56-820a-9adb403de3be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:15.723172 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c5cf0-d586-4f56-820a-9adb403de3be None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:15.725805 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45733c-c6e7-4bfd-a495-440de2bfbe18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:15.727143 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45733c-c6e7-4bfd-a495-440de2bfbe18 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:15.727580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45733c-c6e7-4bfd-a495-440de2bfbe18 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:15.728029 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45733c-c6e7-4bfd-a495-440de2bfbe18 None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:15.728903 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a45733c-c6e7-4bfd-a495-440de2bfbe18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:15.729358 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a45733c-c6e7-4bfd-a495-440de2bfbe18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:15.731308 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a45733c-c6e7-4bfd-a495-440de2bfbe18 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:15.738430 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 300/595] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:36:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:15.739447 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c5cf0-d586-4f56-820a-9adb403de3be None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:15.752050 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 296/596] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:15.753563 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45733c-c6e7-4bfd-a495-440de2bfbe18 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:15.814590 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:15.857453 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c5cf0-d586-4f56-820a-9adb403de3be None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:15.867281 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45733c-c6e7-4bfd-a495-440de2bfbe18 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:15.905455 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6835b-abe5-404c-8584-988e4d9da781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:15.906252 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6835b-abe5-404c-8584-988e4d9da781 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:15.906538 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6835b-abe5-404c-8584-988e4d9da781 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:15.906736 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb031a-bf8d-449e-aeb7-1630a8f166d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:15.906847 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6835b-abe5-404c-8584-988e4d9da781 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:15.907824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb031a-bf8d-449e-aeb7-1630a8f166d1 None admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:15.908112 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb031a-bf8d-449e-aeb7-1630a8f166d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:15.908390 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb031a-bf8d-449e-aeb7-1630a8f166d1 None admin] PATH_INFO: `/v3/projects/8addb03b903842609168ee2fafc8ec6b/users/d003ff6cc73946da9203c69a167bbfff/roles/b57c4ebab8e842088df37b551053b113` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:15.915477 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6835b-abe5-404c-8584-988e4d9da781 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:15.917946 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6835b-abe5-404c-8584-988e4d9da781 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:15.928296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb031a-bf8d-449e-aeb7-1630a8f166d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=8addb03b903842609168ee2fafc8ec6b, user_id=d003ff6cc73946da9203c69a167bbfff, role_id=b57c4ebab8e842088df37b551053b113)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:15.929752 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb031a-bf8d-449e-aeb7-1630a8f166d1 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:15.935160 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-06d6835b-abe5-404c-8584-988e4d9da781 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 23 15:36:15.935160 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:15.935160 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:15.935160 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:15.935160 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:15.935160 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:15.935160 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:15.935160 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:15.935160 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:15.935160 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:15.935160 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:15.935160 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:15.935160 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:36:15.935160 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:36:15.935160 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:36:15.935160 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:36:15.936164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:15.936164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:15.936164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:36:15.936164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:15.936164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:36:15.936164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:15.936164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:15.936164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:15.936164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:15.936164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:15.936164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:15.936164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:15.936164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:15.936164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:15.936164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:15.936164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:15.936164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:15.936164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:15.937122 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:15.937122 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:15.937122 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:36:15.937122 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:36:15.937122 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:36:15.937122 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:36:15.937122 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:36:15.937122 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:36:15.937122 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 23 15:36:15.937122 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:15.940883 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 301/597] 10.222.0.39 () {56 vars in 1102 bytes} [Mon May 23 15:36:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:15.941633 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6835b-abe5-404c-8584-988e4d9da781 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:15.998010 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 297/598] 10.222.0.39 () {58 vars in 1439 bytes} [Mon May 23 15:36:15 2022] PUT /identity/v3/projects/8addb03b903842609168ee2fafc8ec6b/users/d003ff6cc73946da9203c69a167bbfff/roles/b57c4ebab8e842088df37b551053b113 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:36:15.999201 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb031a-bf8d-449e-aeb7-1630a8f166d1 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:16.040174 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:16.071586 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6835b-abe5-404c-8584-988e4d9da781 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:16.113044 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:16.123914 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f0ff5-da03-4097-a0c5-3a334e510917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:16.125377 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f0ff5-da03-4097-a0c5-3a334e510917 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:16.125964 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f0ff5-da03-4097-a0c5-3a334e510917 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:16.126551 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f0ff5-da03-4097-a0c5-3a334e510917 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:16.135012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f0ff5-da03-4097-a0c5-3a334e510917 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:16.137106 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f0ff5-da03-4097-a0c5-3a334e510917 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:16.141914 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb031a-bf8d-449e-aeb7-1630a8f166d1 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:16.155499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-ea0f0ff5-da03-4097-a0c5-3a334e510917 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:16.155499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:16.155499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:16.155499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:16.155499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:16.155499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:16.155499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:16.155499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:16.155499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:16.155499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:16.155499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:16.155499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:16.155499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:36:16.155499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:36:16.155499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:36:16.166231 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:36:16.166231 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:16.166231 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:16.166231 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:16.166231 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:16.166231 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:16.166231 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:16.166231 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:16.166231 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:16.166231 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:16.166231 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:16.166231 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:16.166231 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:16.166231 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:16.166231 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:16.166231 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:16.166231 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:16.167126 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:36:16.167126 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:36:16.167126 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:36:16.167126 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:36:16.167126 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:36:16.167126 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:36:16.167126 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:16.167126 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:16.167126 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 302/599] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:36:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:16.167126 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5c4c1-aeeb-42ef-9077-5d15ca4f8fcb None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:16.167126 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5c4c1-aeeb-42ef-9077-5d15ca4f8fcb None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:16.167776 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5c4c1-aeeb-42ef-9077-5d15ca4f8fcb None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:16.167776 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 303/600] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:16.167776 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5c4c1-aeeb-42ef-9077-5d15ca4f8fcb None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:16.194073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16c0a6-68f4-4943-8ac7-821b091a0279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:16.194855 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16c0a6-68f4-4943-8ac7-821b091a0279 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:16.195141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16c0a6-68f4-4943-8ac7-821b091a0279 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:16.195413 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16c0a6-68f4-4943-8ac7-821b091a0279 None admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:16.196289 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16c0a6-68f4-4943-8ac7-821b091a0279 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:16.196630 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16c0a6-68f4-4943-8ac7-821b091a0279 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:16.199032 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16c0a6-68f4-4943-8ac7-821b091a0279 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:16.220789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 298/601] 10.222.0.39 () {56 vars in 1139 bytes} [Mon May 23 15:36:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:16.222078 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69384d-d4c8-4868-be15-7ac9b3ae1955 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:16.222492 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69384d-d4c8-4868-be15-7ac9b3ae1955 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:16.222769 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69384d-d4c8-4868-be15-7ac9b3ae1955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:16.242284 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-aa69384d-d4c8-4868-be15-7ac9b3ae1955 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:16.243464 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-aa69384d-d4c8-4868-be15-7ac9b3ae1955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:16.304456 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5c4c1-aeeb-42ef-9077-5d15ca4f8fcb None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:16.329192 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 299/602] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:36:16.330063 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69384d-d4c8-4868-be15-7ac9b3ae1955 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:16.361709 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:16.364343 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33754bc-a24a-43a6-a2d2-d751202558f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:16.365300 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33754bc-a24a-43a6-a2d2-d751202558f7 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:16.365583 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33754bc-a24a-43a6-a2d2-d751202558f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:16.365860 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33754bc-a24a-43a6-a2d2-d751202558f7 None admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:16.366714 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33754bc-a24a-43a6-a2d2-d751202558f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:16.367080 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33754bc-a24a-43a6-a2d2-d751202558f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:16.369473 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33754bc-a24a-43a6-a2d2-d751202558f7 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:16.391070 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 304/603] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:36:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:16.392060 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33754bc-a24a-43a6-a2d2-d751202558f7 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:16.444678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:16.478236 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69384d-d4c8-4868-be15-7ac9b3ae1955 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:16.506849 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33754bc-a24a-43a6-a2d2-d751202558f7 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:16.530317 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53a85b-37a4-497c-8a90-e161a5751467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:16.531420 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53a85b-37a4-497c-8a90-e161a5751467 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:16.531869 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53a85b-37a4-497c-8a90-e161a5751467 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:16.532286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53a85b-37a4-497c-8a90-e161a5751467 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:16.547857 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53a85b-37a4-497c-8a90-e161a5751467 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:16.548164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c7888-ff3b-4793-9b0b-465e4848ffa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:16.549022 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c7888-ff3b-4793-9b0b-465e4848ffa0 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:16.549312 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c7888-ff3b-4793-9b0b-465e4848ffa0 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:16.549590 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c7888-ff3b-4793-9b0b-465e4848ffa0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:16.550353 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53a85b-37a4-497c-8a90-e161a5751467 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:16.564024 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c7888-ff3b-4793-9b0b-465e4848ffa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:36:16.570828 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-3f53a85b-37a4-497c-8a90-e161a5751467 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:16.570828 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:16.570828 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:16.570828 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:16.570828 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:16.570828 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:16.570828 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:16.570828 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:16.570828 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:16.570828 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:16.570828 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:16.570828 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:16.570828 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:16.570828 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:16.570828 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:16.571894 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:16.571894 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:16.571894 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:16.571894 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:16.571894 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:16.571894 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:16.571894 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:16.571894 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:16.571894 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:16.571894 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:16.571894 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:16.571894 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:16.571894 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:16.571894 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:16.571894 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:16.571894 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:16.571894 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:16.572927 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:16.572927 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:16.572927 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:16.572927 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:16.575006 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-181c7888-ff3b-4793-9b0b-465e4848ffa0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:16.575006 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:16.575006 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:16.575006 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:16.575006 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:16.575006 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:16.575006 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:16.575006 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:16.575006 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:16.575006 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:16.575006 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:16.575006 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:16.575006 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:36:16.575006 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:36:16.575006 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:36:16.575006 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:36:16.575932 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:36:16.575932 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:36:16.575932 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:36:16.575932 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:36:16.575932 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:16.575932 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:16.575932 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:16.575932 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:16.575932 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:16.575932 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:16.575932 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:16.575932 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:16.575932 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:16.575932 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:16.575932 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:16.575932 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:16.576955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:16.576955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:16.576955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:16.576955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:16.576955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:36:16.576955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:36:16.576955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:36:16.576955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:36:16.576955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:36:16.576955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:36:16.576955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:16.576955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:16.577700 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 300/604] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:16.577700 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53a85b-37a4-497c-8a90-e161a5751467 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:16.579223 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 305/605] 10.222.0.39 () {56 vars in 1102 bytes} [Mon May 23 15:36:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:16.584659 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c7888-ff3b-4793-9b0b-465e4848ffa0 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:16.663724 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:16.700407 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c7888-ff3b-4793-9b0b-465e4848ffa0 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:16.701175 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53a85b-37a4-497c-8a90-e161a5751467 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:16.709348 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:16.741429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb88b62-4a67-48f2-b7d9-c9852cff6d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:16.742327 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb88b62-4a67-48f2-b7d9-c9852cff6d06 None admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:16.742614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb88b62-4a67-48f2-b7d9-c9852cff6d06 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:16.742893 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb88b62-4a67-48f2-b7d9-c9852cff6d06 None admin] PATH_INFO: `/v3/projects/8addb03b903842609168ee2fafc8ec6b/users/3514c56baee94de39d6be4c8790ef76b/roles/b57c4ebab8e842088df37b551053b113` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:16.745026 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a00241-9e57-4085-99da-8ff67b495ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:16.746904 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a00241-9e57-4085-99da-8ff67b495ed3 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:16.747420 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a00241-9e57-4085-99da-8ff67b495ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:16.747949 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a00241-9e57-4085-99da-8ff67b495ed3 None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:16.748887 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a00241-9e57-4085-99da-8ff67b495ed3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:16.749477 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a00241-9e57-4085-99da-8ff67b495ed3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:16.751628 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a00241-9e57-4085-99da-8ff67b495ed3 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:16.758180 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb88b62-4a67-48f2-b7d9-c9852cff6d06 None admin] RBAC: Authorizing `identity:create_grant(project_id=8addb03b903842609168ee2fafc8ec6b, user_id=3514c56baee94de39d6be4c8790ef76b, role_id=b57c4ebab8e842088df37b551053b113)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:16.759675 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb88b62-4a67-48f2-b7d9-c9852cff6d06 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:16.767411 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 306/606] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:16.768622 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a00241-9e57-4085-99da-8ff67b495ed3 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:16.867966 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 301/607] 10.222.0.39 () {58 vars in 1439 bytes} [Mon May 23 15:36:16 2022] PUT /identity/v3/projects/8addb03b903842609168ee2fafc8ec6b/users/3514c56baee94de39d6be4c8790ef76b/roles/b57c4ebab8e842088df37b551053b113 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:36:16.869053 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb88b62-4a67-48f2-b7d9-c9852cff6d06 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:16.876205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a00241-9e57-4085-99da-8ff67b495ed3 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:16.914362 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86aab43-3718-40e7-aefa-f2a22277f9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:16.915448 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86aab43-3718-40e7-aefa-f2a22277f9c9 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:16.915974 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86aab43-3718-40e7-aefa-f2a22277f9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:16.916455 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86aab43-3718-40e7-aefa-f2a22277f9c9 None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:16.917533 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86aab43-3718-40e7-aefa-f2a22277f9c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:16.918118 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86aab43-3718-40e7-aefa-f2a22277f9c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:16.919837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86aab43-3718-40e7-aefa-f2a22277f9c9 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:16.929950 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 307/608] 10.222.0.39 () {56 vars in 1103 bytes} [Mon May 23 15:36:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:16.936686 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86aab43-3718-40e7-aefa-f2a22277f9c9 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:16.968972 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:17.058288 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86aab43-3718-40e7-aefa-f2a22277f9c9 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:17.101886 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2489490-bbb7-42ca-b09f-96fcd126b18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:17.103081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2489490-bbb7-42ca-b09f-96fcd126b18e None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:17.105132 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2489490-bbb7-42ca-b09f-96fcd126b18e None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:17.105786 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2489490-bbb7-42ca-b09f-96fcd126b18e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:17.113723 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb88b62-4a67-48f2-b7d9-c9852cff6d06 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:17.136272 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2489490-bbb7-42ca-b09f-96fcd126b18e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:17.140143 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2489490-bbb7-42ca-b09f-96fcd126b18e None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:17.170530 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-a2489490-bbb7-42ca-b09f-96fcd126b18e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:17.170530 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:17.170530 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:17.170530 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:17.170530 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:17.170530 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:17.170530 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:17.170530 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:17.170530 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:17.170530 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:17.170530 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:17.170530 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:17.170530 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:17.170530 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:17.170530 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:17.173049 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:17.173049 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:17.173049 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:17.173049 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:17.173049 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:17.173049 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:17.173049 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:17.173049 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:17.173049 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:17.173049 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:17.173049 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:17.173049 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:17.173049 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:17.173049 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:17.173049 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:17.173049 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:17.173049 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:17.173981 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:17.173981 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:17.173981 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:17.173981 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:17.174247 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:17.174643 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 308/609] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:36:17.185633 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2489490-bbb7-42ca-b09f-96fcd126b18e None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:17.187643 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dcfd26-45ea-4008-96fb-666473327cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:17.188832 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcfd26-45ea-4008-96fb-666473327cca None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:17.189374 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcfd26-45ea-4008-96fb-666473327cca None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:17.189851 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcfd26-45ea-4008-96fb-666473327cca None admin] PATH_INFO: `/v3/projects/service` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:17.201717 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dcfd26-45ea-4008-96fb-666473327cca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:17.205765 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dcfd26-45ea-4008-96fb-666473327cca None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:17.222556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-19dcfd26-45ea-4008-96fb-666473327cca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:17.222556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:17.222556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:17.222556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:17.222556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:17.222556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:17.222556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:17.222556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:17.222556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:17.222556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:17.222556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:17.222556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:17.222556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:36:17.222556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:36:17.222556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:36:17.223491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:36:17.223491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:17.223491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:17.223491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:17.223491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:17.223491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:17.223491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:17.223491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:17.223491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:17.223491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:17.223491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:17.223491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:17.223491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:17.223491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:17.223491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:17.223491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:17.223491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:17.224947 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:36:17.224947 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:36:17.224947 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:36:17.224947 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:36:17.224947 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:36:17.224947 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:36:17.224947 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:17.224947 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:17.227732 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 302/610] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:36:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:17.231228 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dcfd26-45ea-4008-96fb-666473327cca None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:17.326279 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:17.346349 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2489490-bbb7-42ca-b09f-96fcd126b18e None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:17.383136 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3756f43-977e-4dba-af46-51e818c63064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:17.383832 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3756f43-977e-4dba-af46-51e818c63064 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:17.384123 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3756f43-977e-4dba-af46-51e818c63064 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:17.384404 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3756f43-977e-4dba-af46-51e818c63064 None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:17.385138 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3756f43-977e-4dba-af46-51e818c63064 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:17.385446 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3756f43-977e-4dba-af46-51e818c63064 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:17.387989 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3756f43-977e-4dba-af46-51e818c63064 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:17.403643 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 309/611] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:36:17.420722 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3756f43-977e-4dba-af46-51e818c63064 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:17.424462 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dcfd26-45ea-4008-96fb-666473327cca None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:17.465500 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b51c2-de17-4e8b-9b0d-87c9882f110e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:17.466680 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b51c2-de17-4e8b-9b0d-87c9882f110e None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:17.467938 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b51c2-de17-4e8b-9b0d-87c9882f110e None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:17.468691 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b51c2-de17-4e8b-9b0d-87c9882f110e None admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:17.470962 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b51c2-de17-4e8b-9b0d-87c9882f110e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:17.472809 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b51c2-de17-4e8b-9b0d-87c9882f110e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:17.474467 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b51c2-de17-4e8b-9b0d-87c9882f110e None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:17.507915 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 303/612] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:36:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:36:17.517645 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b51c2-de17-4e8b-9b0d-87c9882f110e None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:17.590882 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3756f43-977e-4dba-af46-51e818c63064 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:17.620024 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:17.628875 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803a41f-a27e-421f-93cd-007a8f53cd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:17.631375 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803a41f-a27e-421f-93cd-007a8f53cd8a None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:17.632674 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803a41f-a27e-421f-93cd-007a8f53cd8a None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:17.633866 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803a41f-a27e-421f-93cd-007a8f53cd8a None admin] PATH_INFO: `/v3/users/swift` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:17.646329 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803a41f-a27e-421f-93cd-007a8f53cd8a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:17.647856 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803a41f-a27e-421f-93cd-007a8f53cd8a None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:17.655336 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:17.669195 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-e803a41f-a27e-421f-93cd-007a8f53cd8a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 15:36:17.669195 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:17.669195 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:17.669195 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:17.669195 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:17.669195 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:17.669195 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:17.669195 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:17.669195 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:17.669195 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:17.669195 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:17.669195 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:17.669195 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:36:17.669195 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:36:17.669195 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:36:17.669195 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:36:17.670502 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:17.670502 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:17.670502 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:36:17.670502 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:17.670502 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:36:17.670502 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:17.670502 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:17.670502 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:17.670502 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:17.670502 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:17.670502 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:17.670502 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:17.670502 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:17.670502 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:17.670502 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:17.670502 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:17.670502 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:17.670502 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:17.671451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:17.671451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:17.671451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:36:17.671451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:36:17.671451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:36:17.671451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:36:17.671451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:36:17.671451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:36:17.671451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 15:36:17.671451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:17.685405 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 310/613] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:36:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:17.692996 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803a41f-a27e-421f-93cd-007a8f53cd8a None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:17.744082 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b51c2-de17-4e8b-9b0d-87c9882f110e None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:17.795381 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728adbb-508e-4dd5-a3ce-cc0de483d812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:17.799761 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728adbb-508e-4dd5-a3ce-cc0de483d812 None admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:17.800288 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728adbb-508e-4dd5-a3ce-cc0de483d812 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:17.800797 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728adbb-508e-4dd5-a3ce-cc0de483d812 None admin] PATH_INFO: `/v3/projects/8addb03b903842609168ee2fafc8ec6b/users/f831a06a9cf344a2aa068c20a987b6da/roles/b57c4ebab8e842088df37b551053b113` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:17.817384 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4728adbb-508e-4dd5-a3ce-cc0de483d812 None admin] RBAC: Authorizing `identity:create_grant(project_id=8addb03b903842609168ee2fafc8ec6b, user_id=f831a06a9cf344a2aa068c20a987b6da, role_id=b57c4ebab8e842088df37b551053b113)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:17.819209 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4728adbb-508e-4dd5-a3ce-cc0de483d812 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:17.830531 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803a41f-a27e-421f-93cd-007a8f53cd8a None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:17.866246 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177cc639-4631-48c4-8cd5-0d06e0d086d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:17.866910 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cc639-4631-48c4-8cd5-0d06e0d086d2 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:17.867190 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cc639-4631-48c4-8cd5-0d06e0d086d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:17.867462 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cc639-4631-48c4-8cd5-0d06e0d086d2 None admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:17.868343 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177cc639-4631-48c4-8cd5-0d06e0d086d2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:17.868654 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177cc639-4631-48c4-8cd5-0d06e0d086d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:17.870078 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177cc639-4631-48c4-8cd5-0d06e0d086d2 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:17.893831 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 311/614] 10.222.0.39 () {56 vars in 1135 bytes} [Mon May 23 15:36:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:17.898832 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f19d24-d33d-4db0-84a2-f93036042f67 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:17.898832 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f19d24-d33d-4db0-84a2-f93036042f67 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:17.898832 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f19d24-d33d-4db0-84a2-f93036042f67 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:17.899090 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 304/615] 10.222.0.39 () {58 vars in 1439 bytes} [Mon May 23 15:36:17 2022] PUT /identity/v3/projects/8addb03b903842609168ee2fafc8ec6b/users/f831a06a9cf344a2aa068c20a987b6da/roles/b57c4ebab8e842088df37b551053b113 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:36:17.899169 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 312/616] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:17.899236 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728adbb-508e-4dd5-a3ce-cc0de483d812 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:17.909283 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605fe50-5120-4296-982a-6d3d9765f8b2 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:17.909858 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605fe50-5120-4296-982a-6d3d9765f8b2 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:17.910358 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605fe50-5120-4296-982a-6d3d9765f8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:17.950509 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-4605fe50-5120-4296-982a-6d3d9765f8b2 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:17.952108 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-4605fe50-5120-4296-982a-6d3d9765f8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:18.020225 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:18.044669 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728adbb-508e-4dd5-a3ce-cc0de483d812 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:18.090594 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50d2e5-baa2-4cb6-9c0b-b8e35d644cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:18.092110 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50d2e5-baa2-4cb6-9c0b-b8e35d644cf5 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:18.092625 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50d2e5-baa2-4cb6-9c0b-b8e35d644cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:18.093115 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50d2e5-baa2-4cb6-9c0b-b8e35d644cf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:18.114026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50d2e5-baa2-4cb6-9c0b-b8e35d644cf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:18.114868 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:18.117287 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50d2e5-baa2-4cb6-9c0b-b8e35d644cf5 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:18.135226 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 313/617] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:36:18.140754 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-8d50d2e5-baa2-4cb6-9c0b-b8e35d644cf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:18.140754 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:18.140754 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:18.140754 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:18.140754 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:18.140754 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:18.140754 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:18.140754 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:18.140754 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:18.140754 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:18.140754 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:18.140754 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:18.140754 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:18.140754 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:18.140754 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:18.141873 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:18.141873 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:18.141873 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:18.141873 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:18.141873 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:18.141873 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:18.141873 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:18.141873 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:18.141873 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:18.141873 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:18.141873 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:18.141873 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:18.141873 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:18.141873 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:18.141873 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:18.141873 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:18.141873 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:18.142814 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:18.142814 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:18.142814 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:18.142814 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:18.142814 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 305/618] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:18.148119 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605fe50-5120-4296-982a-6d3d9765f8b2 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:18.169190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50d2e5-baa2-4cb6-9c0b-b8e35d644cf5 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:18.274427 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605fe50-5120-4296-982a-6d3d9765f8b2 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:18.301563 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50d2e5-baa2-4cb6-9c0b-b8e35d644cf5 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:18.329174 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14593fe4-04aa-4e2e-9122-e07fda945353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:18.329855 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14593fe4-04aa-4e2e-9122-e07fda945353 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:18.330138 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14593fe4-04aa-4e2e-9122-e07fda945353 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:18.330414 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14593fe4-04aa-4e2e-9122-e07fda945353 None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:18.331144 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14593fe4-04aa-4e2e-9122-e07fda945353 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:18.331449 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14593fe4-04aa-4e2e-9122-e07fda945353 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:18.332855 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14593fe4-04aa-4e2e-9122-e07fda945353 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:18.354821 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 314/619] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:36:18.360350 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14593fe4-04aa-4e2e-9122-e07fda945353 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:18.374623 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5184d-ea77-4c5a-a957-58e00d91aeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:18.375483 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5184d-ea77-4c5a-a957-58e00d91aeca None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:18.375851 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5184d-ea77-4c5a-a957-58e00d91aeca None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:18.376135 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5184d-ea77-4c5a-a957-58e00d91aeca None admin] PATH_INFO: `/v3/roles/service` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:18.395882 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe5184d-ea77-4c5a-a957-58e00d91aeca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:36:18.411268 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-afe5184d-ea77-4c5a-a957-58e00d91aeca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:18.411268 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:18.411268 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:18.411268 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:18.411268 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:18.411268 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:18.411268 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:18.411268 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:18.411268 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:18.411268 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:18.411268 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:18.411268 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:18.411268 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:36:18.411268 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:36:18.411268 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:36:18.411268 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:36:18.412363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:36:18.412363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:36:18.412363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:36:18.412363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:36:18.412363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:18.412363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:18.412363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:18.412363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:18.412363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:18.412363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:18.412363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:18.412363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:18.412363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:18.412363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:18.412363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:18.412363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:18.413278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:18.413278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:18.413278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:18.413278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:18.413278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:36:18.413278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:36:18.413278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:36:18.413278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:36:18.413278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:36:18.413278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:36:18.413278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:18.413278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:18.413278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 306/620] 10.222.0.39 () {56 vars in 1102 bytes} [Mon May 23 15:36:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:36:18.420443 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5184d-ea77-4c5a-a957-58e00d91aeca None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:18.461480 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:18.468868 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:18.534935 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14593fe4-04aa-4e2e-9122-e07fda945353 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:18.571660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5184d-ea77-4c5a-a957-58e00d91aeca None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:18.573966 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09001005-e54c-49c2-9322-1d2c67d9f52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:18.576529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09001005-e54c-49c2-9322-1d2c67d9f52c None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:18.576999 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09001005-e54c-49c2-9322-1d2c67d9f52c None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:18.577446 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09001005-e54c-49c2-9322-1d2c67d9f52c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:18.586385 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09001005-e54c-49c2-9322-1d2c67d9f52c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:18.588659 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09001005-e54c-49c2-9322-1d2c67d9f52c None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:18.607809 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-09001005-e54c-49c2-9322-1d2c67d9f52c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:18.607809 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:18.607809 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:18.607809 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:18.607809 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:18.607809 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:18.607809 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:18.607809 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:18.607809 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:18.607809 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:18.607809 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:18.607809 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:18.607809 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:36:18.607809 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:36:18.607809 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:36:18.609138 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:36:18.609138 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:18.609138 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:18.609138 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:18.609138 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:18.609138 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:18.609138 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:18.609138 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:18.609138 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:18.609138 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:18.609138 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:18.609138 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:18.609138 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:18.609138 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:18.609138 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:18.609138 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:18.609138 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:18.610029 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:36:18.610029 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:36:18.610029 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:36:18.610029 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:36:18.610029 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:36:18.610029 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:36:18.610029 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:18.610029 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:18.611526 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2f63e-ef39-4a11-a167-5fb95acd1c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:18.612309 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2f63e-ef39-4a11-a167-5fb95acd1c6a None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:18.612641 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 315/621] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:36:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:18.612752 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2f63e-ef39-4a11-a167-5fb95acd1c6a None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:18.613098 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2f63e-ef39-4a11-a167-5fb95acd1c6a None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:18.613973 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2f63e-ef39-4a11-a167-5fb95acd1c6a None admin] RBAC: Adding query filter params (name=service) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:18.614363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2f63e-ef39-4a11-a167-5fb95acd1c6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:18.614766 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c014992-923a-4f23-85ca-44d88938e5ad None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:18.615230 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c014992-923a-4f23-85ca-44d88938e5ad None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:18.615720 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c014992-923a-4f23-85ca-44d88938e5ad None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:18.616065 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2f63e-ef39-4a11-a167-5fb95acd1c6a None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:18.617662 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 316/622] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:18.618792 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c014992-923a-4f23-85ca-44d88938e5ad None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:18.627498 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 307/623] 10.222.0.39 () {56 vars in 1103 bytes} [Mon May 23 15:36:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:36:18.631734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba778b-99fc-470e-a659-42238132ebc4 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:18.631734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba778b-99fc-470e-a659-42238132ebc4 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:18.631734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba778b-99fc-470e-a659-42238132ebc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:18.654394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-37ba778b-99fc-470e-a659-42238132ebc4 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:18.656571 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-37ba778b-99fc-470e-a659-42238132ebc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:18.737783 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:18.750481 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 308/624] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:36:18.752416 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c014992-923a-4f23-85ca-44d88938e5ad None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:18.752536 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba778b-99fc-470e-a659-42238132ebc4 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:18.763464 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:18.809109 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5e29b-d0a5-4243-a58f-d89c01ffe5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:18.809792 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5e29b-d0a5-4243-a58f-d89c01ffe5fa None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:18.810073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5e29b-d0a5-4243-a58f-d89c01ffe5fa None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:18.810347 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5e29b-d0a5-4243-a58f-d89c01ffe5fa None admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:18.811141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5e29b-d0a5-4243-a58f-d89c01ffe5fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:18.811681 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5e29b-d0a5-4243-a58f-d89c01ffe5fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:18.813738 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5e29b-d0a5-4243-a58f-d89c01ffe5fa None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:18.827499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 317/625] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:36:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:18.828494 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5e29b-d0a5-4243-a58f-d89c01ffe5fa None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:18.886113 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba778b-99fc-470e-a659-42238132ebc4 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:18.924371 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6c2e0-4c44-4733-b135-8cea4ef819d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:18.925300 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6c2e0-4c44-4733-b135-8cea4ef819d9 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:18.925659 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6c2e0-4c44-4733-b135-8cea4ef819d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:18.926007 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6c2e0-4c44-4733-b135-8cea4ef819d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:18.937601 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6c2e0-4c44-4733-b135-8cea4ef819d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:18.939207 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6c2e0-4c44-4733-b135-8cea4ef819d9 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:18.943240 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5e29b-d0a5-4243-a58f-d89c01ffe5fa None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:18.959117 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-8dc6c2e0-4c44-4733-b135-8cea4ef819d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:18.959117 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:18.959117 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:18.959117 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:18.959117 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:18.959117 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:18.959117 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:18.959117 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:18.959117 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:18.959117 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:18.959117 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:18.959117 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:18.959117 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:18.959117 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:18.959117 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:18.960083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:18.960083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:18.960083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:18.960083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:18.960083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:18.960083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:18.960083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:18.960083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:18.960083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:18.960083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:18.960083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:18.960083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:18.960083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:18.960083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:18.960083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:18.960083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:18.960083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:18.960938 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:18.960938 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:18.960938 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:18.960938 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:18.965543 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 309/626] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:18.966479 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6c2e0-4c44-4733-b135-8cea4ef819d9 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:18.980021 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5945a-fa65-4ec5-bcc6-9dd52696ddb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:18.981527 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5945a-fa65-4ec5-bcc6-9dd52696ddb0 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:18.981808 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5945a-fa65-4ec5-bcc6-9dd52696ddb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:18.982080 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5945a-fa65-4ec5-bcc6-9dd52696ddb0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:18.993574 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5945a-fa65-4ec5-bcc6-9dd52696ddb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:36:19.003510 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-5be5945a-fa65-4ec5-bcc6-9dd52696ddb0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:19.003510 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:19.003510 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:19.003510 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:19.003510 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:19.003510 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:19.003510 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:19.003510 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:19.003510 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:19.003510 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:19.003510 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:19.003510 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:19.003510 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:36:19.003510 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:36:19.003510 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:36:19.003510 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:36:19.005633 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:36:19.005633 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:36:19.005633 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:36:19.005633 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:36:19.005633 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:19.005633 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:19.005633 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:19.005633 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:19.005633 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:19.005633 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:19.005633 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:19.005633 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:19.005633 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:19.005633 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:19.005633 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:19.005633 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:19.007547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:19.007547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:19.007547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:19.007547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:19.007547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:36:19.007547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:36:19.007547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:36:19.007547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:36:19.007547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:36:19.007547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:36:19.007547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:19.007547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:19.010413 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 318/627] 10.222.0.39 () {56 vars in 1102 bytes} [Mon May 23 15:36:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:19.011386 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5945a-fa65-4ec5-bcc6-9dd52696ddb0 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:19.012956 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:19.043265 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:19.078531 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6c2e0-4c44-4733-b135-8cea4ef819d9 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:19.120324 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f4a86-354f-4e8c-ae83-83ae54e08001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:19.122012 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f4a86-354f-4e8c-ae83-83ae54e08001 None admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:19.122304 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f4a86-354f-4e8c-ae83-83ae54e08001 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:19.122580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f4a86-354f-4e8c-ae83-83ae54e08001 None admin] PATH_INFO: `/v3/projects/8addb03b903842609168ee2fafc8ec6b/users/b275a110936a44ce8d54793af1a34808/roles/b57c4ebab8e842088df37b551053b113` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:19.131093 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5945a-fa65-4ec5-bcc6-9dd52696ddb0 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:19.138843 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f4a86-354f-4e8c-ae83-83ae54e08001 None admin] RBAC: Authorizing `identity:create_grant(project_id=8addb03b903842609168ee2fafc8ec6b, user_id=b275a110936a44ce8d54793af1a34808, role_id=b57c4ebab8e842088df37b551053b113)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:19.140498 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f4a86-354f-4e8c-ae83-83ae54e08001 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:19.168554 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac6add-b51b-4c74-aed9-5c314a43251d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:19.169134 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac6add-b51b-4c74-aed9-5c314a43251d None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:19.169469 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac6add-b51b-4c74-aed9-5c314a43251d None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:19.169783 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac6add-b51b-4c74-aed9-5c314a43251d None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:19.170467 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddac6add-b51b-4c74-aed9-5c314a43251d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:19.170773 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddac6add-b51b-4c74-aed9-5c314a43251d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:19.172161 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddac6add-b51b-4c74-aed9-5c314a43251d None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:19.190300 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 319/628] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:19.190300 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac6add-b51b-4c74-aed9-5c314a43251d None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:19.255309 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 310/629] 10.222.0.39 () {58 vars in 1439 bytes} [Mon May 23 15:36:18 2022] PUT /identity/v3/projects/8addb03b903842609168ee2fafc8ec6b/users/b275a110936a44ce8d54793af1a34808/roles/b57c4ebab8e842088df37b551053b113 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:36:19.256540 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f4a86-354f-4e8c-ae83-83ae54e08001 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:19.299686 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:19.315042 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac6add-b51b-4c74-aed9-5c314a43251d None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:19.357186 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1176937-4d54-43d2-a4d4-8af14126a206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:19.358011 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1176937-4d54-43d2-a4d4-8af14126a206 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:19.358393 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1176937-4d54-43d2-a4d4-8af14126a206 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:19.358766 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1176937-4d54-43d2-a4d4-8af14126a206 None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:19.360021 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1176937-4d54-43d2-a4d4-8af14126a206 None admin] RBAC: Adding query filter params (name=service) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:19.360423 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1176937-4d54-43d2-a4d4-8af14126a206 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:19.361998 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1176937-4d54-43d2-a4d4-8af14126a206 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:19.375731 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 320/630] 10.222.0.39 () {56 vars in 1103 bytes} [Mon May 23 15:36:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:19.383623 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1176937-4d54-43d2-a4d4-8af14126a206 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:19.442546 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f4a86-354f-4e8c-ae83-83ae54e08001 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:19.447864 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:19.484339 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf40a1c-bba0-49f0-aef2-39f8b66f52f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:19.485667 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf40a1c-bba0-49f0-aef2-39f8b66f52f5 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:19.486132 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf40a1c-bba0-49f0-aef2-39f8b66f52f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:19.486606 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf40a1c-bba0-49f0-aef2-39f8b66f52f5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:19.495124 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf40a1c-bba0-49f0-aef2-39f8b66f52f5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:19.497397 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf40a1c-bba0-49f0-aef2-39f8b66f52f5 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:19.517099 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-2cf40a1c-bba0-49f0-aef2-39f8b66f52f5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 15:36:19.517099 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:19.517099 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:19.517099 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:19.517099 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:19.517099 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:19.517099 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:19.517099 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:19.517099 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:19.517099 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:19.517099 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:19.517099 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:19.517099 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:36:19.517099 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:36:19.517099 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:36:19.517099 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:36:19.518097 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:19.518097 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:19.518097 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:36:19.518097 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:19.518097 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:36:19.518097 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:19.518097 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:19.518097 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:19.518097 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:19.518097 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:19.518097 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:19.518097 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:19.518097 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:19.518097 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:19.518097 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:19.518097 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:19.518097 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:19.518097 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:19.519411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:19.519411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:19.519411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:36:19.519411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:36:19.519411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:36:19.519411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:36:19.519411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:36:19.519411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:36:19.519411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 15:36:19.519411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:19.521884 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 311/631] 10.222.0.39 () {56 vars in 1093 bytes} [Mon May 23 15:36:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:19.527991 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf40a1c-bba0-49f0-aef2-39f8b66f52f5 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:19.573761 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1176937-4d54-43d2-a4d4-8af14126a206 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:19.619065 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92caab7-b145-4311-a66c-9acf9ca07e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:19.619891 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92caab7-b145-4311-a66c-9acf9ca07e05 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:19.620174 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92caab7-b145-4311-a66c-9acf9ca07e05 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:19.620448 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92caab7-b145-4311-a66c-9acf9ca07e05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:19.633701 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92caab7-b145-4311-a66c-9acf9ca07e05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:19.635259 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92caab7-b145-4311-a66c-9acf9ca07e05 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:19.646724 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf40a1c-bba0-49f0-aef2-39f8b66f52f5 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:19.653450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-d92caab7-b145-4311-a66c-9acf9ca07e05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:19.653450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:19.653450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:19.653450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:19.653450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:19.653450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:19.653450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:19.653450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:19.653450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:19.653450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:19.653450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:19.653450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:19.653450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:19.653450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:19.653450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:19.654345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:19.654345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:19.654345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:19.654345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:19.654345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:19.654345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:19.654345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:19.654345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:19.654345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:19.654345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:19.654345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:19.654345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:19.654345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:19.654345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:19.654345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:19.654345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:19.654345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:19.655257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:19.655257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:19.655257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:19.655257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:19.655257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 321/632] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:19.656256 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf24f1b-6e72-4cdf-af4d-1b324bb2cc8e None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:19.656542 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf24f1b-6e72-4cdf-af4d-1b324bb2cc8e None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:19.656821 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf24f1b-6e72-4cdf-af4d-1b324bb2cc8e None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:19.661927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 322/633] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:19.661927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf24f1b-6e72-4cdf-af4d-1b324bb2cc8e None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:19.666256 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:19.689866 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc59d0-5df6-4298-8707-72ac2d1b2877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:19.690769 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc59d0-5df6-4298-8707-72ac2d1b2877 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:19.690896 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc59d0-5df6-4298-8707-72ac2d1b2877 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:19.691085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc59d0-5df6-4298-8707-72ac2d1b2877 None admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:19.691981 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc59d0-5df6-4298-8707-72ac2d1b2877 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:19.692336 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc59d0-5df6-4298-8707-72ac2d1b2877 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:19.693855 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc59d0-5df6-4298-8707-72ac2d1b2877 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:19.713285 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 312/634] 10.222.0.39 () {56 vars in 1133 bytes} [Mon May 23 15:36:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:36:19.714586 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc8e1b-e2f1-47b5-9de3-24f95779827b None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:19.714904 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc8e1b-e2f1-47b5-9de3-24f95779827b None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:19.715184 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc8e1b-e2f1-47b5-9de3-24f95779827b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:19.738105 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-67cc8e1b-e2f1-47b5-9de3-24f95779827b None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:19.739050 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-67cc8e1b-e2f1-47b5-9de3-24f95779827b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:19.747028 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:19.806672 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf24f1b-6e72-4cdf-af4d-1b324bb2cc8e None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:19.810730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 313/635] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:36:19.815636 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc8e1b-e2f1-47b5-9de3-24f95779827b None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:19.859886 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bdde6-c5f8-4f35-bf7a-efaeb5e6d8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:19.860829 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bdde6-c5f8-4f35-bf7a-efaeb5e6d8e3 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:19.861261 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bdde6-c5f8-4f35-bf7a-efaeb5e6d8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:19.861734 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bdde6-c5f8-4f35-bf7a-efaeb5e6d8e3 None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:19.862699 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3bdde6-c5f8-4f35-bf7a-efaeb5e6d8e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:19.863207 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3bdde6-c5f8-4f35-bf7a-efaeb5e6d8e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:19.864890 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3bdde6-c5f8-4f35-bf7a-efaeb5e6d8e3 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:19.879468 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 323/636] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:19.880661 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bdde6-c5f8-4f35-bf7a-efaeb5e6d8e3 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:19.956009 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc8e1b-e2f1-47b5-9de3-24f95779827b None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:19.958188 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:19.992560 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60f42e-068f-403a-ba2d-8cb955178514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:19.993210 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60f42e-068f-403a-ba2d-8cb955178514 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:19.993490 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60f42e-068f-403a-ba2d-8cb955178514 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:19.993760 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60f42e-068f-403a-ba2d-8cb955178514 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:20.002181 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bdde6-c5f8-4f35-bf7a-efaeb5e6d8e3 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:20.006402 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:20.040018 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d81660-caf7-4e1b-8b38-e174a4bced5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:20.040907 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d81660-caf7-4e1b-8b38-e174a4bced5d None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:20.041284 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d81660-caf7-4e1b-8b38-e174a4bced5d None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:20.041633 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d81660-caf7-4e1b-8b38-e174a4bced5d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:20.054581 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d81660-caf7-4e1b-8b38-e174a4bced5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:36:20.064271 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-37d81660-caf7-4e1b-8b38-e174a4bced5d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:20.064271 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:20.064271 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:20.064271 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:20.064271 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:20.064271 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:20.064271 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:20.064271 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:20.064271 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:20.064271 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:20.064271 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:20.064271 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:20.064271 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:36:20.064271 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:36:20.064271 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:36:20.064271 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:36:20.065409 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:36:20.065409 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:36:20.065409 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:36:20.065409 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:36:20.065409 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:20.065409 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:20.065409 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:20.065409 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:20.065409 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:20.065409 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:20.065409 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:20.065409 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:20.065409 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:20.065409 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:20.065409 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:20.065409 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:20.066451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:20.066451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:20.066451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:20.066451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:20.066451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:36:20.066451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:36:20.066451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:36:20.066451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:36:20.066451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:36:20.066451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:36:20.066451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:20.066451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:20.072109 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 324/637] 10.222.0.39 () {56 vars in 1102 bytes} [Mon May 23 15:36:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:20.072942 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d81660-caf7-4e1b-8b38-e174a4bced5d None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:20.073751 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60f42e-068f-403a-ba2d-8cb955178514 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:20.075706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60f42e-068f-403a-ba2d-8cb955178514 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:20.188974 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d81660-caf7-4e1b-8b38-e174a4bced5d None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:20.194359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 314/638] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:36:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:36:20.195671 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60f42e-068f-403a-ba2d-8cb955178514 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:20.214016 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:20.227376 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7c2f1-c933-459e-ad86-3b0f46436ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:20.228353 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7c2f1-c933-459e-ad86-3b0f46436ae2 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:20.230900 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7c2f1-c933-459e-ad86-3b0f46436ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:20.230900 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7c2f1-c933-459e-ad86-3b0f46436ae2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:20.238415 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7c2f1-c933-459e-ad86-3b0f46436ae2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:20.239914 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7c2f1-c933-459e-ad86-3b0f46436ae2 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:20.244636 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:20.256791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-05d7c2f1-c933-459e-ad86-3b0f46436ae2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 23 15:36:20.256791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:20.256791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:20.256791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:20.256791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:20.256791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:20.256791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:20.256791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:20.256791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:20.256791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:20.256791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:20.256791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:20.256791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:36:20.256791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:36:20.256791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:36:20.256791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:36:20.257927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:20.257927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:20.257927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:36:20.257927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:20.257927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:36:20.257927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:20.257927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:20.257927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:20.257927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:20.257927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:20.257927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:20.257927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:20.257927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:20.257927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:20.257927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:20.257927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:20.257927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:20.257927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:20.259079 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:20.259079 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:20.259079 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:36:20.259079 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:36:20.259079 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:36:20.259079 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:36:20.259079 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:36:20.259079 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:36:20.259079 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 23 15:36:20.259079 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:20.267108 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 325/639] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:36:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:20.267108 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7c2f1-c933-459e-ad86-3b0f46436ae2 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:20.319465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60f42e-068f-403a-ba2d-8cb955178514 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:20.357455 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3438a-6516-49c9-b064-d3642d7e4824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:20.358356 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3438a-6516-49c9-b064-d3642d7e4824 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:20.359149 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3438a-6516-49c9-b064-d3642d7e4824 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:20.359771 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3438a-6516-49c9-b064-d3642d7e4824 None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:20.360572 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3438a-6516-49c9-b064-d3642d7e4824 None admin] RBAC: Adding query filter params (name=service) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:20.360879 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3438a-6516-49c9-b064-d3642d7e4824 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:20.362242 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3438a-6516-49c9-b064-d3642d7e4824 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:20.375095 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 315/640] 10.222.0.39 () {56 vars in 1103 bytes} [Mon May 23 15:36:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:20.375095 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3438a-6516-49c9-b064-d3642d7e4824 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:20.378679 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7c2f1-c933-459e-ad86-3b0f46436ae2 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:20.414383 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759e811-8293-4afc-bbb3-641f6833592f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:20.415170 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759e811-8293-4afc-bbb3-641f6833592f None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:20.415454 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759e811-8293-4afc-bbb3-641f6833592f None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:20.415764 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759e811-8293-4afc-bbb3-641f6833592f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:20.426673 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759e811-8293-4afc-bbb3-641f6833592f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:20.428167 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759e811-8293-4afc-bbb3-641f6833592f None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:20.445573 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-c759e811-8293-4afc-bbb3-641f6833592f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:20.445573 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:20.445573 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:20.445573 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:20.445573 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:20.445573 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:20.445573 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:20.445573 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:20.445573 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:20.445573 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:20.445573 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:20.445573 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:20.445573 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:20.445573 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:20.445573 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:20.446556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:20.446556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:20.446556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:20.446556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:20.446556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:20.446556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:20.446556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:20.446556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:20.446556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:20.446556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:20.446556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:20.446556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:20.446556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:20.446556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:20.446556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:20.446556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:20.446556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:20.447471 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:20.447471 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:20.447471 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:20.447471 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:20.447471 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 326/641] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:20.448472 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c8bd4-60c3-4cb3-b6bf-81f3ee3d9139 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:20.448823 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c8bd4-60c3-4cb3-b6bf-81f3ee3d9139 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:20.449752 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c8bd4-60c3-4cb3-b6bf-81f3ee3d9139 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:20.455108 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 327/642] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:20.455108 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c8bd4-60c3-4cb3-b6bf-81f3ee3d9139 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:20.490671 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:20.492158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3438a-6516-49c9-b064-d3642d7e4824 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:20.493693 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:20.525313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c34ee6-9ebc-4813-9cde-d07844820ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:20.525975 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c34ee6-9ebc-4813-9cde-d07844820ddb None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:20.526248 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c34ee6-9ebc-4813-9cde-d07844820ddb None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:20.526531 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c34ee6-9ebc-4813-9cde-d07844820ddb None admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:20.528106 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c34ee6-9ebc-4813-9cde-d07844820ddb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:20.528604 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c34ee6-9ebc-4813-9cde-d07844820ddb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:20.530026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c34ee6-9ebc-4813-9cde-d07844820ddb None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:20.552414 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 316/643] 10.222.0.39 () {56 vars in 1137 bytes} [Mon May 23 15:36:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:20.552414 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c34ee6-9ebc-4813-9cde-d07844820ddb None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:20.562027 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c8bd4-60c3-4cb3-b6bf-81f3ee3d9139 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:20.600255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a4e60-2bbb-4349-90c1-6ab3eda2c439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:20.600961 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a4e60-2bbb-4349-90c1-6ab3eda2c439 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:20.601242 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a4e60-2bbb-4349-90c1-6ab3eda2c439 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:20.601512 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a4e60-2bbb-4349-90c1-6ab3eda2c439 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:20.613454 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a4e60-2bbb-4349-90c1-6ab3eda2c439 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:20.615326 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a4e60-2bbb-4349-90c1-6ab3eda2c439 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:20.634072 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-d01a4e60-2bbb-4349-90c1-6ab3eda2c439 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:20.634072 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:20.634072 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:20.634072 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:20.634072 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:20.634072 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:20.634072 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:20.634072 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:20.634072 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:20.634072 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:20.634072 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:20.634072 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:20.634072 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:20.634072 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:20.634072 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:20.635012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:20.635012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:20.635012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:20.635012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:20.635012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:20.635012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:20.635012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:20.635012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:20.635012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:20.635012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:20.635012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:20.635012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:20.635012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:20.635012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:20.635012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:20.635012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:20.635012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:20.636078 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:20.636078 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:20.636078 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:20.636078 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:20.640032 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 328/644] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:20.641194 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc8388-d0da-41be-835d-907f81bcacc1 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:20.641486 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc8388-d0da-41be-835d-907f81bcacc1 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:20.641769 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc8388-d0da-41be-835d-907f81bcacc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:20.660615 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-88fc8388-d0da-41be-835d-907f81bcacc1 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:20.661802 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-88fc8388-d0da-41be-835d-907f81bcacc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:20.663917 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c34ee6-9ebc-4813-9cde-d07844820ddb None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:20.700324 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4cffc-db04-4f40-aca0-e7960cf6f32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:20.700983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4cffc-db04-4f40-aca0-e7960cf6f32b None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:20.701264 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4cffc-db04-4f40-aca0-e7960cf6f32b None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:20.701540 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4cffc-db04-4f40-aca0-e7960cf6f32b None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:20.702256 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab4cffc-db04-4f40-aca0-e7960cf6f32b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:20.702559 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab4cffc-db04-4f40-aca0-e7960cf6f32b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:20.703974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab4cffc-db04-4f40-aca0-e7960cf6f32b None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:20.716148 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 317/645] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:20.716978 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4cffc-db04-4f40-aca0-e7960cf6f32b None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:20.735980 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 329/646] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:36:20.740956 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:20.741864 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc8388-d0da-41be-835d-907f81bcacc1 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:20.765073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:20.821055 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4cffc-db04-4f40-aca0-e7960cf6f32b None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:20.856797 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d47ac-6fa2-4b25-a9f6-ba4e25e39c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:20.857370 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d47ac-6fa2-4b25-a9f6-ba4e25e39c41 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:20.857655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d47ac-6fa2-4b25-a9f6-ba4e25e39c41 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:20.857915 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc8388-d0da-41be-835d-907f81bcacc1 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:20.858018 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d47ac-6fa2-4b25-a9f6-ba4e25e39c41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:20.895363 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e4310-242a-4f2c-91c3-c17121a9e093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:20.896072 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e4310-242a-4f2c-91c3-c17121a9e093 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:20.896352 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e4310-242a-4f2c-91c3-c17121a9e093 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:20.896626 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e4310-242a-4f2c-91c3-c17121a9e093 None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:20.897451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e4310-242a-4f2c-91c3-c17121a9e093 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:20.897758 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e4310-242a-4f2c-91c3-c17121a9e093 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:20.899533 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e4310-242a-4f2c-91c3-c17121a9e093 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:20.912034 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 330/647] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:20.916842 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e4310-242a-4f2c-91c3-c17121a9e093 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:20.929930 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d47ac-6fa2-4b25-a9f6-ba4e25e39c41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:20.931384 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d47ac-6fa2-4b25-a9f6-ba4e25e39c41 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:20.952657 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:21.002553 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:21.025469 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e4310-242a-4f2c-91c3-c17121a9e093 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:21.037233 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 318/648] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:36:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:36:21.038098 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d47ac-6fa2-4b25-a9f6-ba4e25e39c41 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:21.065455 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07d5c3-777c-4395-afe2-70183b2b76d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:21.066248 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07d5c3-777c-4395-afe2-70183b2b76d5 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:21.066529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07d5c3-777c-4395-afe2-70183b2b76d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:21.066805 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07d5c3-777c-4395-afe2-70183b2b76d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:21.073600 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07d5c3-777c-4395-afe2-70183b2b76d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:21.075822 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07d5c3-777c-4395-afe2-70183b2b76d5 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:21.091056 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-fb07d5c3-777c-4395-afe2-70183b2b76d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:21.091056 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:21.091056 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:21.091056 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:21.091056 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:21.091056 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:21.091056 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:21.091056 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:21.091056 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:21.091056 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:21.091056 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:21.091056 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:21.091056 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:36:21.091056 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:36:21.091056 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:36:21.092548 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:36:21.092548 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:21.092548 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:21.092548 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:21.092548 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:21.092548 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:21.092548 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:21.092548 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:21.092548 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:21.092548 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:21.092548 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:21.092548 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:21.092548 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:21.092548 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:21.092548 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:21.092548 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:21.092548 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:21.093445 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:36:21.093445 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:36:21.093445 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:36:21.093445 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:36:21.093445 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:36:21.093445 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:36:21.093445 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:21.093445 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:21.093445 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 331/649] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:36:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:21.093445 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07d5c3-777c-4395-afe2-70183b2b76d5 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:21.158076 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d47ac-6fa2-4b25-a9f6-ba4e25e39c41 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:21.180654 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:21.198555 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9822c80-78b1-4675-aea6-c6041d0d27a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:21.199779 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9822c80-78b1-4675-aea6-c6041d0d27a8 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:21.199779 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9822c80-78b1-4675-aea6-c6041d0d27a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:21.199992 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9822c80-78b1-4675-aea6-c6041d0d27a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:21.212449 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9822c80-78b1-4675-aea6-c6041d0d27a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:36:21.215489 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07d5c3-777c-4395-afe2-70183b2b76d5 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:21.220885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-c9822c80-78b1-4675-aea6-c6041d0d27a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:21.220885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:21.220885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:21.220885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:21.220885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:21.220885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:21.220885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:21.220885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:21.220885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:21.220885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:21.220885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:21.220885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:21.220885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:36:21.220885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:36:21.220885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:36:21.220885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:36:21.222008 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:36:21.222008 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:36:21.222008 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:36:21.222008 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:36:21.222008 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:21.222008 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:21.222008 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:21.222008 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:21.222008 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:21.222008 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:21.222008 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:21.222008 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:21.222008 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:21.222008 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:21.222008 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:21.222008 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:21.223046 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:21.223046 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:21.223046 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:21.223046 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:21.223046 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:36:21.223046 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:36:21.223046 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:36:21.223046 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:36:21.223046 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:36:21.223046 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:36:21.223046 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:21.223046 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:21.231853 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 319/650] 10.222.0.39 () {56 vars in 1102 bytes} [Mon May 23 15:36:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:21.231853 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9822c80-78b1-4675-aea6-c6041d0d27a8 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:21.251973 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520a37e-c6c6-4292-a79d-70e94ec77a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:21.252772 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520a37e-c6c6-4292-a79d-70e94ec77a36 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:21.253048 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520a37e-c6c6-4292-a79d-70e94ec77a36 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:21.253319 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520a37e-c6c6-4292-a79d-70e94ec77a36 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:21.256622 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:21.261504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520a37e-c6c6-4292-a79d-70e94ec77a36 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:21.262858 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520a37e-c6c6-4292-a79d-70e94ec77a36 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:21.278676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-5520a37e-c6c6-4292-a79d-70e94ec77a36 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 15:36:21.278676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:21.278676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:21.278676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:21.278676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:21.278676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:21.278676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:21.278676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:21.278676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:21.278676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:21.278676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:21.278676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:21.278676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:36:21.278676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:36:21.278676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:36:21.278676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:36:21.279877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:21.279877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:21.279877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:36:21.279877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:21.279877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:36:21.279877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:21.279877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:21.279877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:21.279877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:21.279877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:21.279877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:21.279877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:21.279877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:21.279877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:21.279877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:21.279877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:21.279877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:21.279877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:21.281036 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:21.281036 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:21.281036 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:36:21.281036 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:36:21.281036 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:36:21.281036 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:36:21.281036 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:36:21.281036 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:36:21.281036 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 15:36:21.281036 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:21.282090 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 332/651] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:36:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:21.282693 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520a37e-c6c6-4292-a79d-70e94ec77a36 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:21.348446 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9822c80-78b1-4675-aea6-c6041d0d27a8 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:21.384004 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4781e-35bb-45a1-8a3b-1412103167b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:21.384780 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4781e-35bb-45a1-8a3b-1412103167b1 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:21.385065 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4781e-35bb-45a1-8a3b-1412103167b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:21.385332 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4781e-35bb-45a1-8a3b-1412103167b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:21.388990 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520a37e-c6c6-4292-a79d-70e94ec77a36 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:21.396380 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4781e-35bb-45a1-8a3b-1412103167b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:21.397898 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4781e-35bb-45a1-8a3b-1412103167b1 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:21.415706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-36f4781e-35bb-45a1-8a3b-1412103167b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:21.415706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:21.415706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:21.415706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:21.415706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:21.415706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:21.415706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:21.415706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:21.415706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:21.415706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:21.415706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:21.415706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:21.415706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:21.415706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:21.415706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:21.416606 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:21.416606 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:21.416606 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:21.416606 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:21.416606 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:21.416606 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:21.416606 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:21.416606 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:21.416606 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:21.416606 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:21.416606 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:21.416606 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:21.416606 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:21.416606 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:21.416606 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:21.416606 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:21.416606 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:21.417585 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:21.417585 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:21.417585 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:21.417585 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:21.417585 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 320/652] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:21.417585 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4781e-35bb-45a1-8a3b-1412103167b1 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:21.432266 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a3b79-8d76-4892-a9bc-011b13d551c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:21.433247 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a3b79-8d76-4892-a9bc-011b13d551c4 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:21.434438 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a3b79-8d76-4892-a9bc-011b13d551c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:21.434722 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a3b79-8d76-4892-a9bc-011b13d551c4 None admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:21.435516 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a3b79-8d76-4892-a9bc-011b13d551c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:21.435866 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a3b79-8d76-4892-a9bc-011b13d551c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:21.437305 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a3b79-8d76-4892-a9bc-011b13d551c4 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:21.454004 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 333/653] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:36:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:21.454004 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a3b79-8d76-4892-a9bc-011b13d551c4 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:21.458004 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:21.539008 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4781e-35bb-45a1-8a3b-1412103167b1 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:21.577392 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be00ab-d230-46e7-94c0-22a8fb55b9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:21.578074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be00ab-d230-46e7-94c0-22a8fb55b9aa None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:21.578398 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be00ab-d230-46e7-94c0-22a8fb55b9aa None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:21.578687 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be00ab-d230-46e7-94c0-22a8fb55b9aa None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:21.579446 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be00ab-d230-46e7-94c0-22a8fb55b9aa None admin] RBAC: Adding query filter params (name=service) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:21.579786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be00ab-d230-46e7-94c0-22a8fb55b9aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:21.581181 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be00ab-d230-46e7-94c0-22a8fb55b9aa None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:21.593233 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 321/654] 10.222.0.39 () {56 vars in 1103 bytes} [Mon May 23 15:36:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:21.594561 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be00ab-d230-46e7-94c0-22a8fb55b9aa None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:21.638331 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:21.691299 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a3b79-8d76-4892-a9bc-011b13d551c4 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:21.693144 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:21.700399 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be00ab-d230-46e7-94c0-22a8fb55b9aa None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:21.725855 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c458fd1-7e1e-49ef-8b57-ee883ba4c62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:21.726519 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c458fd1-7e1e-49ef-8b57-ee883ba4c62f None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:21.726798 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c458fd1-7e1e-49ef-8b57-ee883ba4c62f None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:21.727070 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c458fd1-7e1e-49ef-8b57-ee883ba4c62f None admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:21.727941 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c458fd1-7e1e-49ef-8b57-ee883ba4c62f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:21.728254 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c458fd1-7e1e-49ef-8b57-ee883ba4c62f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:21.729660 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c458fd1-7e1e-49ef-8b57-ee883ba4c62f None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:21.736751 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c8ef8-3e49-4a5a-bdfa-c74a5a611e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:21.737408 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c8ef8-3e49-4a5a-bdfa-c74a5a611e6b None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:21.737690 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c8ef8-3e49-4a5a-bdfa-c74a5a611e6b None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:21.737966 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c8ef8-3e49-4a5a-bdfa-c74a5a611e6b None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:21.738679 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c8ef8-3e49-4a5a-bdfa-c74a5a611e6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:21.738986 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c8ef8-3e49-4a5a-bdfa-c74a5a611e6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:21.740365 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c8ef8-3e49-4a5a-bdfa-c74a5a611e6b None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:21.747668 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 334/655] 10.222.0.39 () {56 vars in 1137 bytes} [Mon May 23 15:36:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:21.748467 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c458fd1-7e1e-49ef-8b57-ee883ba4c62f None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:21.757307 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 322/656] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:21.757307 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c8ef8-3e49-4a5a-bdfa-c74a5a611e6b None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:21.846788 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c458fd1-7e1e-49ef-8b57-ee883ba4c62f None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:21.850147 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c8ef8-3e49-4a5a-bdfa-c74a5a611e6b None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:21.861141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:21.881349 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556e71f-ad47-4fa9-b175-1ed16100b0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:21.881995 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556e71f-ad47-4fa9-b175-1ed16100b0d6 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:21.882279 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556e71f-ad47-4fa9-b175-1ed16100b0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:21.882552 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556e71f-ad47-4fa9-b175-1ed16100b0d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:21.883377 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556e71f-ad47-4fa9-b175-1ed16100b0d6 None admin] RBAC: Adding query filter params (role.id=b57c4ebab8e842088df37b551053b113, scope.project.id=8addb03b903842609168ee2fafc8ec6b, user.id=76f7895b7b5748e7b4461f7fde1d558a) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:21.883725 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556e71f-ad47-4fa9-b175-1ed16100b0d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:21.884535 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9167ef6-1f2f-495f-bb82-4500541a6d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:21.885190 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556e71f-ad47-4fa9-b175-1ed16100b0d6 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:21.885318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9167ef6-1f2f-495f-bb82-4500541a6d80 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:21.885600 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9167ef6-1f2f-495f-bb82-4500541a6d80 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:21.885875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9167ef6-1f2f-495f-bb82-4500541a6d80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:21.891278 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 335/657] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:36:21 2022] GET /identity/v3/role_assignments?user.id=76f7895b7b5748e7b4461f7fde1d558a&scope.project.id=8addb03b903842609168ee2fafc8ec6b&role.id=b57c4ebab8e842088df37b551053b113 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:21.892593 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac5db2-5a2c-470b-a4a5-5ed623d37c16 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:21.892889 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac5db2-5a2c-470b-a4a5-5ed623d37c16 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:21.893169 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac5db2-5a2c-470b-a4a5-5ed623d37c16 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:21.894393 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 336/658] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:21.895190 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac5db2-5a2c-470b-a4a5-5ed623d37c16 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:21.909229 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9167ef6-1f2f-495f-bb82-4500541a6d80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:21.910768 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9167ef6-1f2f-495f-bb82-4500541a6d80 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:21.930920 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-c9167ef6-1f2f-495f-bb82-4500541a6d80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:21.930920 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:21.930920 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:21.930920 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:21.930920 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:21.930920 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:21.930920 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:21.930920 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:21.930920 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:21.930920 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:21.930920 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:21.930920 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:21.930920 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:21.930920 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:21.930920 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:21.932215 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:21.932215 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:21.932215 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:21.932215 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:21.932215 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:21.932215 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:21.932215 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:21.932215 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:21.932215 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:21.932215 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:21.932215 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:21.932215 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:21.932215 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:21.932215 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:21.932215 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:21.932215 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:21.932215 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:21.933129 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:21.933129 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:21.933129 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:21.933129 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:21.933129 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 323/659] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:21.933129 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9167ef6-1f2f-495f-bb82-4500541a6d80 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:21.948962 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:22.028591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac5db2-5a2c-470b-a4a5-5ed623d37c16 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:22.073254 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9167ef6-1f2f-495f-bb82-4500541a6d80 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:22.074711 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a17992-f97c-4365-9f5b-9c521379c782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:22.075382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a17992-f97c-4365-9f5b-9c521379c782 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:22.075706 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a17992-f97c-4365-9f5b-9c521379c782 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:22.076007 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a17992-f97c-4365-9f5b-9c521379c782 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:22.132438 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcebdb7-c1d1-4a4f-8f9f-7b7167c8f98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:22.133245 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcebdb7-c1d1-4a4f-8f9f-7b7167c8f98c None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:22.133538 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcebdb7-c1d1-4a4f-8f9f-7b7167c8f98c None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:22.137527 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcebdb7-c1d1-4a4f-8f9f-7b7167c8f98c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:22.143177 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcebdb7-c1d1-4a4f-8f9f-7b7167c8f98c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:22.145171 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcebdb7-c1d1-4a4f-8f9f-7b7167c8f98c None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:22.151900 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:22.168856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-2fcebdb7-c1d1-4a4f-8f9f-7b7167c8f98c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:22.168856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:22.168856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:22.168856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:22.168856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:22.168856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:22.168856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:22.168856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:22.168856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:22.168856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:22.168856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:22.168856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:22.168856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:36:22.168856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:36:22.168856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:36:22.170951 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:36:22.170951 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:22.170951 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:22.170951 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:22.170951 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:22.170951 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:22.170951 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:22.170951 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:22.170951 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:22.170951 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:22.170951 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:22.170951 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:22.170951 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:22.170951 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:22.170951 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:22.170951 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:22.170951 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:22.172028 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:36:22.172028 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:36:22.172028 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:36:22.172028 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:36:22.172028 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:36:22.172028 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:36:22.172028 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:22.172028 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:22.178969 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 324/660] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:36:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:22.178969 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581d179-af00-49fd-8574-a470c81f0002 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:22.178969 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581d179-af00-49fd-8574-a470c81f0002 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:22.178969 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581d179-af00-49fd-8574-a470c81f0002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:22.190867 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a17992-f97c-4365-9f5b-9c521379c782 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:22.198076 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a17992-f97c-4365-9f5b-9c521379c782 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:22.200978 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-d581d179-af00-49fd-8574-a470c81f0002 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:22.202230 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-d581d179-af00-49fd-8574-a470c81f0002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:22.274196 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:22.291631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 325/661] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:36:22.291631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581d179-af00-49fd-8574-a470c81f0002 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:22.339638 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 337/662] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:36:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:36:22.340920 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a17992-f97c-4365-9f5b-9c521379c782 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:22.426248 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:22.437296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581d179-af00-49fd-8574-a470c81f0002 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:22.448586 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a17992-f97c-4365-9f5b-9c521379c782 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:22.479017 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f939f-8405-42d9-8251-3a37aca8269e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:22.479619 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f939f-8405-42d9-8251-3a37aca8269e None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:22.479928 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f939f-8405-42d9-8251-3a37aca8269e None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:22.480765 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f939f-8405-42d9-8251-3a37aca8269e None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:22.482402 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f939f-8405-42d9-8251-3a37aca8269e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:22.482402 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f939f-8405-42d9-8251-3a37aca8269e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:22.483435 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f939f-8405-42d9-8251-3a37aca8269e None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:22.485726 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6efe56-164f-4984-baa0-53051d3576b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:22.486389 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6efe56-164f-4984-baa0-53051d3576b3 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:22.486667 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6efe56-164f-4984-baa0-53051d3576b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:22.486941 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6efe56-164f-4984-baa0-53051d3576b3 None admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:22.487767 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6efe56-164f-4984-baa0-53051d3576b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:22.488072 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6efe56-164f-4984-baa0-53051d3576b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:22.489468 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6efe56-164f-4984-baa0-53051d3576b3 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:22.497119 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 326/663] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:22.498195 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f939f-8405-42d9-8251-3a37aca8269e None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:22.505840 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 338/664] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:36:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:22.506875 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6efe56-164f-4984-baa0-53051d3576b3 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:22.561617 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:22.606794 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f939f-8405-42d9-8251-3a37aca8269e None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:22.619832 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6efe56-164f-4984-baa0-53051d3576b3 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:22.642427 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d1bf1-9aae-4ceb-bb0f-54d9787f4fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:22.643228 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d1bf1-9aae-4ceb-bb0f-54d9787f4fb8 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:22.643513 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d1bf1-9aae-4ceb-bb0f-54d9787f4fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:22.643822 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d1bf1-9aae-4ceb-bb0f-54d9787f4fb8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:22.654549 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d1bf1-9aae-4ceb-bb0f-54d9787f4fb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:36:22.659205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35200087-8ed1-4876-a95d-0dc352d9a2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:22.660244 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35200087-8ed1-4876-a95d-0dc352d9a2a2 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:22.660710 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35200087-8ed1-4876-a95d-0dc352d9a2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:22.661164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35200087-8ed1-4876-a95d-0dc352d9a2a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:22.662318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-aa6d1bf1-9aae-4ceb-bb0f-54d9787f4fb8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:22.662318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:22.662318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:22.662318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:22.662318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:22.662318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:22.662318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:22.662318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:22.662318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:22.662318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:22.662318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:22.662318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:22.662318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:36:22.662318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:36:22.662318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:36:22.662318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:36:22.663246 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:36:22.663246 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:36:22.663246 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:36:22.663246 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:36:22.663246 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:22.663246 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:22.663246 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:22.663246 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:22.663246 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:22.663246 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:22.663246 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:22.663246 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:22.663246 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:22.663246 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:22.663246 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:22.663246 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:22.664125 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:22.664125 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:22.664125 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:22.664125 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:22.664125 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:36:22.664125 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:36:22.664125 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:36:22.664125 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:36:22.664125 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:36:22.664125 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:36:22.664125 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:22.664125 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:22.664125 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 327/665] 10.222.0.39 () {56 vars in 1102 bytes} [Mon May 23 15:36:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:22.665253 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d1bf1-9aae-4ceb-bb0f-54d9787f4fb8 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:22.675086 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:22.680001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35200087-8ed1-4876-a95d-0dc352d9a2a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:22.681446 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35200087-8ed1-4876-a95d-0dc352d9a2a2 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:22.699396 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-35200087-8ed1-4876-a95d-0dc352d9a2a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:22.699396 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:22.699396 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:22.699396 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:22.699396 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:22.699396 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:22.699396 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:22.699396 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:22.699396 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:22.699396 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:22.699396 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:22.699396 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:22.699396 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:22.699396 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:22.699396 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:22.700498 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:22.700498 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:22.700498 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:22.700498 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:22.700498 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:22.700498 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:22.700498 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:22.700498 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:22.700498 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:22.700498 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:22.700498 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:22.700498 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:22.700498 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:22.700498 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:22.700498 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:22.700498 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:22.700498 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:22.701582 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:22.701582 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:22.701582 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:22.701582 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:22.701582 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 339/666] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:22.702155 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35200087-8ed1-4876-a95d-0dc352d9a2a2 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:22.784281 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d1bf1-9aae-4ceb-bb0f-54d9787f4fb8 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:22.800876 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:22.809870 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35200087-8ed1-4876-a95d-0dc352d9a2a2 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:22.820033 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99b184-f54e-4bff-a57b-44f4a7ad28cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:22.821150 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99b184-f54e-4bff-a57b-44f4a7ad28cf None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:22.822496 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99b184-f54e-4bff-a57b-44f4a7ad28cf None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:22.822496 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99b184-f54e-4bff-a57b-44f4a7ad28cf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:22.830684 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99b184-f54e-4bff-a57b-44f4a7ad28cf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:22.832170 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99b184-f54e-4bff-a57b-44f4a7ad28cf None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:22.844506 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94728a7-c9fd-4c65-bfa2-3e7309573b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:22.845159 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94728a7-c9fd-4c65-bfa2-3e7309573b26 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:22.845442 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94728a7-c9fd-4c65-bfa2-3e7309573b26 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:22.845723 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94728a7-c9fd-4c65-bfa2-3e7309573b26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:22.846562 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94728a7-c9fd-4c65-bfa2-3e7309573b26 None admin] RBAC: Adding query filter params (role.id=b57c4ebab8e842088df37b551053b113, scope.project.id=8addb03b903842609168ee2fafc8ec6b, user.id=d003ff6cc73946da9203c69a167bbfff) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:22.846879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94728a7-c9fd-4c65-bfa2-3e7309573b26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:22.847084 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-6e99b184-f54e-4bff-a57b-44f4a7ad28cf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 23 15:36:22.847084 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:22.847084 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:22.847084 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:22.847084 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:22.847084 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:22.847084 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:22.847084 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:22.847084 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:22.847084 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:22.847084 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:22.847084 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:22.847084 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:36:22.847084 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:36:22.847084 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:36:22.847084 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:36:22.848171 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:22.848171 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:22.848171 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:36:22.848171 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:22.848171 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:36:22.848171 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:22.848171 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:22.848171 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:22.848171 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:22.848171 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:22.848171 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:22.848171 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:22.848171 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:22.848171 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:22.848171 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:22.848171 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:22.848171 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:22.848171 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:22.849318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:22.849318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:22.849318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:36:22.849318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:36:22.849318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:36:22.849318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:36:22.849318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:36:22.849318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:36:22.849318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 23 15:36:22.849318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:22.849978 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94728a7-c9fd-4c65-bfa2-3e7309573b26 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:22.852153 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 328/667] 10.222.0.39 () {56 vars in 1102 bytes} [Mon May 23 15:36:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:22.852703 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99b184-f54e-4bff-a57b-44f4a7ad28cf None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:22.859749 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 340/668] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:36:22 2022] GET /identity/v3/role_assignments?user.id=d003ff6cc73946da9203c69a167bbfff&scope.project.id=8addb03b903842609168ee2fafc8ec6b&role.id=b57c4ebab8e842088df37b551053b113 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:22.860391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94728a7-c9fd-4c65-bfa2-3e7309573b26 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:22.924559 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:22.976587 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94728a7-c9fd-4c65-bfa2-3e7309573b26 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:23.015805 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9a310-8181-454f-a753-a549384a1404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:23.016515 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9a310-8181-454f-a753-a549384a1404 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:23.016804 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9a310-8181-454f-a753-a549384a1404 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:23.017089 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9a310-8181-454f-a753-a549384a1404 None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:23.017363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99b184-f54e-4bff-a57b-44f4a7ad28cf None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:23.017827 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9a310-8181-454f-a753-a549384a1404 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:23.018140 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9a310-8181-454f-a753-a549384a1404 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:23.019580 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9a310-8181-454f-a753-a549384a1404 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:23.039175 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 341/669] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:23.040087 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9a310-8181-454f-a753-a549384a1404 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:23.064809 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39395ac-4d91-4ff7-810c-bdcaa60de5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:23.065539 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39395ac-4d91-4ff7-810c-bdcaa60de5d7 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:23.065820 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39395ac-4d91-4ff7-810c-bdcaa60de5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:23.066092 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39395ac-4d91-4ff7-810c-bdcaa60de5d7 None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:23.066892 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39395ac-4d91-4ff7-810c-bdcaa60de5d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:23.067201 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39395ac-4d91-4ff7-810c-bdcaa60de5d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:23.069087 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39395ac-4d91-4ff7-810c-bdcaa60de5d7 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:23.080144 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 329/670] 10.222.0.39 () {56 vars in 1103 bytes} [Mon May 23 15:36:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:23.081106 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39395ac-4d91-4ff7-810c-bdcaa60de5d7 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:23.129459 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:23.178007 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9a310-8181-454f-a753-a549384a1404 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:23.193878 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:23.210409 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39395ac-4d91-4ff7-810c-bdcaa60de5d7 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:23.220554 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884c6d8-cc71-4183-8207-12764eff3a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:23.221228 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884c6d8-cc71-4183-8207-12764eff3a88 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:23.223297 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884c6d8-cc71-4183-8207-12764eff3a88 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:23.223297 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884c6d8-cc71-4183-8207-12764eff3a88 None admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:23.223297 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884c6d8-cc71-4183-8207-12764eff3a88 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:23.223297 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884c6d8-cc71-4183-8207-12764eff3a88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:23.224475 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884c6d8-cc71-4183-8207-12764eff3a88 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:23.245131 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 342/671] 10.222.0.39 () {56 vars in 1139 bytes} [Mon May 23 15:36:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:23.246544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884c6d8-cc71-4183-8207-12764eff3a88 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:23.257854 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27658775-7e23-48d4-9b79-781c38f911db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:23.257854 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27658775-7e23-48d4-9b79-781c38f911db None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:23.257854 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27658775-7e23-48d4-9b79-781c38f911db None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:23.257854 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27658775-7e23-48d4-9b79-781c38f911db None admin] PATH_INFO: `/v3/projects/service` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:23.266869 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27658775-7e23-48d4-9b79-781c38f911db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:23.268381 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27658775-7e23-48d4-9b79-781c38f911db None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:23.283016 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-27658775-7e23-48d4-9b79-781c38f911db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:23.283016 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:23.283016 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:23.283016 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:23.283016 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:23.283016 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:23.283016 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:23.283016 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:23.283016 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:23.283016 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:23.283016 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:23.283016 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:23.283016 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:36:23.283016 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:36:23.283016 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:36:23.283994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:36:23.283994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:23.283994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:23.283994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:23.283994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:23.283994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:23.283994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:23.283994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:23.283994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:23.283994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:23.283994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:23.283994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:23.283994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:23.283994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:23.283994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:23.283994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:23.283994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:23.284896 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:36:23.284896 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:36:23.284896 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:36:23.284896 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:36:23.284896 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:36:23.284896 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:36:23.284896 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:23.284896 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:23.284896 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 330/672] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:36:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:23.285465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27658775-7e23-48d4-9b79-781c38f911db None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:23.382866 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884c6d8-cc71-4183-8207-12764eff3a88 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:23.394972 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:23.399501 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27658775-7e23-48d4-9b79-781c38f911db None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:23.431373 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812eb9b-8b6d-4a89-b67e-121a05b9ff86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:23.433056 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812eb9b-8b6d-4a89-b67e-121a05b9ff86 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:23.433545 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812eb9b-8b6d-4a89-b67e-121a05b9ff86 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:23.434123 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812eb9b-8b6d-4a89-b67e-121a05b9ff86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:23.436507 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1462244-3ef5-470f-b34d-e711d1b8c133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:23.437501 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1462244-3ef5-470f-b34d-e711d1b8c133 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:23.437501 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1462244-3ef5-470f-b34d-e711d1b8c133 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:23.437986 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1462244-3ef5-470f-b34d-e711d1b8c133 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:23.447410 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812eb9b-8b6d-4a89-b67e-121a05b9ff86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:23.450213 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812eb9b-8b6d-4a89-b67e-121a05b9ff86 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:23.474588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-2812eb9b-8b6d-4a89-b67e-121a05b9ff86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:23.474588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:23.474588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:23.474588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:23.474588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:23.474588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:23.474588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:23.474588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:23.474588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:23.474588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:23.474588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:23.474588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:23.474588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:23.474588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:23.474588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:23.475740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:23.475740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:23.475740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:23.475740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:23.475740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:23.475740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:23.475740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:23.475740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:23.475740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:23.475740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:23.475740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:23.475740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:23.475740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:23.475740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:23.475740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:23.475740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:23.475740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:23.476884 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:23.476884 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:23.476884 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:23.476884 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:23.484157 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 343/673] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:23.484157 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812eb9b-8b6d-4a89-b67e-121a05b9ff86 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:23.511819 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:23.521779 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1462244-3ef5-470f-b34d-e711d1b8c133 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:23.523433 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1462244-3ef5-470f-b34d-e711d1b8c133 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:23.595671 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812eb9b-8b6d-4a89-b67e-121a05b9ff86 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:23.623729 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:23.632030 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 331/674] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:36:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:36:23.632948 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1462244-3ef5-470f-b34d-e711d1b8c133 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:23.636287 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b0c58-000b-480d-800c-cd3258e39433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:23.641167 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b0c58-000b-480d-800c-cd3258e39433 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:23.641167 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b0c58-000b-480d-800c-cd3258e39433 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:23.641167 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b0c58-000b-480d-800c-cd3258e39433 None admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:23.641167 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b0c58-000b-480d-800c-cd3258e39433 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:23.641167 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b0c58-000b-480d-800c-cd3258e39433 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:23.641167 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b0c58-000b-480d-800c-cd3258e39433 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:23.654133 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 344/675] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:36:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:23.655110 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b0c58-000b-480d-800c-cd3258e39433 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:23.743946 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1462244-3ef5-470f-b34d-e711d1b8c133 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:23.751016 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:23.768786 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b0c58-000b-480d-800c-cd3258e39433 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:23.780334 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613ccfa-c777-4422-b2ec-3322fb10119f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:23.781003 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613ccfa-c777-4422-b2ec-3322fb10119f None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:23.781288 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613ccfa-c777-4422-b2ec-3322fb10119f None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:23.781565 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613ccfa-c777-4422-b2ec-3322fb10119f None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:23.782296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613ccfa-c777-4422-b2ec-3322fb10119f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:23.782608 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613ccfa-c777-4422-b2ec-3322fb10119f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:23.784084 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613ccfa-c777-4422-b2ec-3322fb10119f None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:23.798352 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 332/676] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:23.799209 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613ccfa-c777-4422-b2ec-3322fb10119f None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:23.810934 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a0372-6d2f-4285-853f-90b9d93252e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:23.811769 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a0372-6d2f-4285-853f-90b9d93252e0 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:23.812081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a0372-6d2f-4285-853f-90b9d93252e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:23.812439 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a0372-6d2f-4285-853f-90b9d93252e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:23.823691 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a0372-6d2f-4285-853f-90b9d93252e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:23.825812 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a0372-6d2f-4285-853f-90b9d93252e0 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:23.845589 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-443a0372-6d2f-4285-853f-90b9d93252e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:23.845589 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:23.845589 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:23.845589 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:23.845589 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:23.845589 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:23.845589 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:23.845589 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:23.845589 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:23.845589 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:23.845589 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:23.845589 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:23.845589 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:23.845589 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:23.845589 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:23.846559 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:23.846559 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:23.846559 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:23.846559 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:23.846559 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:23.846559 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:23.846559 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:23.846559 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:23.846559 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:23.846559 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:23.846559 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:23.846559 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:23.846559 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:23.846559 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:23.846559 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:23.846559 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:23.846559 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:23.847443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:23.847443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:23.847443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:23.847443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:23.847443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 345/677] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:23.848185 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a0372-6d2f-4285-853f-90b9d93252e0 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:23.870238 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:23.916172 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613ccfa-c777-4422-b2ec-3322fb10119f None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:23.953520 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38153015-6c8c-4969-b17a-a8c90a98c9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:23.954283 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38153015-6c8c-4969-b17a-a8c90a98c9a1 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:23.954567 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38153015-6c8c-4969-b17a-a8c90a98c9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:23.954841 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38153015-6c8c-4969-b17a-a8c90a98c9a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:23.955724 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38153015-6c8c-4969-b17a-a8c90a98c9a1 None admin] RBAC: Adding query filter params (role.id=b57c4ebab8e842088df37b551053b113, scope.project.id=8addb03b903842609168ee2fafc8ec6b, user.id=3514c56baee94de39d6be4c8790ef76b) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:23.956040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38153015-6c8c-4969-b17a-a8c90a98c9a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:23.956628 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a0372-6d2f-4285-853f-90b9d93252e0 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:23.957484 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38153015-6c8c-4969-b17a-a8c90a98c9a1 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:23.972073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 333/678] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:36:23 2022] GET /identity/v3/role_assignments?user.id=3514c56baee94de39d6be4c8790ef76b&scope.project.id=8addb03b903842609168ee2fafc8ec6b&role.id=b57c4ebab8e842088df37b551053b113 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:23.973081 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38153015-6c8c-4969-b17a-a8c90a98c9a1 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:23.994429 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a354f-d903-4660-bc87-944ab3bb6372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:23.995229 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a354f-d903-4660-bc87-944ab3bb6372 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:23.995517 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a354f-d903-4660-bc87-944ab3bb6372 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:23.995869 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a354f-d903-4660-bc87-944ab3bb6372 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:23.999056 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:24.013443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a354f-d903-4660-bc87-944ab3bb6372 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:24.014536 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a354f-d903-4660-bc87-944ab3bb6372 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:24.031668 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-620a354f-d903-4660-bc87-944ab3bb6372 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 15:36:24.031668 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:24.031668 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:24.031668 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:24.031668 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:24.031668 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:24.031668 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:24.031668 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:24.031668 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:24.031668 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:24.031668 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:24.031668 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:24.031668 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:36:24.031668 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:36:24.031668 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:36:24.031668 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:36:24.033889 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:24.033889 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:24.033889 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:36:24.033889 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:24.033889 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:36:24.033889 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:24.033889 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:24.033889 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:24.033889 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:24.033889 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:24.033889 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:24.033889 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:24.033889 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:24.033889 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:24.033889 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:24.033889 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:24.033889 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:24.033889 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:24.036467 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:24.036467 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:24.036467 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:36:24.036467 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:36:24.036467 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:36:24.036467 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:36:24.036467 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:36:24.036467 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:36:24.036467 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 15:36:24.036467 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:24.036467 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 346/679] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:36:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:24.043632 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a354f-d903-4660-bc87-944ab3bb6372 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:24.184159 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a354f-d903-4660-bc87-944ab3bb6372 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:24.188808 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38153015-6c8c-4969-b17a-a8c90a98c9a1 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:24.242576 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:24.264558 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006da85-9226-41f5-bb44-51e808a5c9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:24.265251 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006da85-9226-41f5-bb44-51e808a5c9b7 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:24.265537 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006da85-9226-41f5-bb44-51e808a5c9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:24.265816 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006da85-9226-41f5-bb44-51e808a5c9b7 None admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:24.266680 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1006da85-9226-41f5-bb44-51e808a5c9b7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:24.266997 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1006da85-9226-41f5-bb44-51e808a5c9b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:24.268465 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1006da85-9226-41f5-bb44-51e808a5c9b7 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:24.271294 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc1198-afaf-4291-a771-405e72fb9b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:24.272006 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc1198-afaf-4291-a771-405e72fb9b66 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:24.272292 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc1198-afaf-4291-a771-405e72fb9b66 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:24.272589 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc1198-afaf-4291-a771-405e72fb9b66 None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:24.273685 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc1198-afaf-4291-a771-405e72fb9b66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:24.274165 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc1198-afaf-4291-a771-405e72fb9b66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:24.275804 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc1198-afaf-4291-a771-405e72fb9b66 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:24.290363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 334/680] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:24.295828 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159c4e1-db97-4f76-8754-3c960ec10078 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:24.296164 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159c4e1-db97-4f76-8754-3c960ec10078 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:24.296453 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159c4e1-db97-4f76-8754-3c960ec10078 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:24.296614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 347/681] 10.222.0.39 () {56 vars in 1135 bytes} [Mon May 23 15:36:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:36:24.298059 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 335/682] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:24.301820 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159c4e1-db97-4f76-8754-3c960ec10078 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:24.302175 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006da85-9226-41f5-bb44-51e808a5c9b7 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:24.380559 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:24.425078 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006da85-9226-41f5-bb44-51e808a5c9b7 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:24.439084 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159c4e1-db97-4f76-8754-3c960ec10078 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:24.463553 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f00a7-a919-46ae-a267-978fe1617876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:24.465094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f00a7-a919-46ae-a267-978fe1617876 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:24.465679 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f00a7-a919-46ae-a267-978fe1617876 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:24.466159 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f00a7-a919-46ae-a267-978fe1617876 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:24.473378 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f00a7-a919-46ae-a267-978fe1617876 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:24.475041 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f00a7-a919-46ae-a267-978fe1617876 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:24.481775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee272b9-4c4d-4f73-88bf-3c68a9abcb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:24.482429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee272b9-4c4d-4f73-88bf-3c68a9abcb48 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:24.482713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee272b9-4c4d-4f73-88bf-3c68a9abcb48 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:24.482994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee272b9-4c4d-4f73-88bf-3c68a9abcb48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:24.490946 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-506f00a7-a919-46ae-a267-978fe1617876 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:24.490946 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:24.490946 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:24.490946 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:24.490946 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:24.490946 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:24.490946 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:24.490946 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:24.490946 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:24.490946 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:24.490946 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:24.490946 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:24.490946 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:36:24.490946 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:36:24.490946 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:36:24.491891 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:36:24.491891 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:24.491891 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:24.491891 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:24.491891 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:24.491891 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:24.491891 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:24.491891 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:24.491891 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:24.491891 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:24.491891 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:24.491891 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:24.491891 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:24.491891 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:24.491891 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:24.491891 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:24.491891 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:24.492795 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:36:24.492795 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:36:24.492795 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:36:24.492795 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:36:24.492795 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:36:24.492795 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:36:24.492795 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:24.492795 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:24.495469 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 348/683] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:36:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:24.497392 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd972ac-bd00-46f5-a63f-6b7c335eeb7e None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:24.497880 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd972ac-bd00-46f5-a63f-6b7c335eeb7e None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:24.498403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd972ac-bd00-46f5-a63f-6b7c335eeb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:24.517944 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-7bd972ac-bd00-46f5-a63f-6b7c335eeb7e None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:24.519541 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-7bd972ac-bd00-46f5-a63f-6b7c335eeb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:24.546167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:24.568076 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee272b9-4c4d-4f73-88bf-3c68a9abcb48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:24.570596 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee272b9-4c4d-4f73-88bf-3c68a9abcb48 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:24.611182 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 349/684] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:36:24.612123 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd972ac-bd00-46f5-a63f-6b7c335eeb7e None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:24.666027 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:24.714357 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 336/685] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:36:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:36:24.716006 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee272b9-4c4d-4f73-88bf-3c68a9abcb48 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:24.741824 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd972ac-bd00-46f5-a63f-6b7c335eeb7e None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:24.779793 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3281c-b070-4102-804a-390d63870421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:24.780577 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3281c-b070-4102-804a-390d63870421 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:24.780859 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3281c-b070-4102-804a-390d63870421 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:24.781140 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3281c-b070-4102-804a-390d63870421 None admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:24.782041 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3281c-b070-4102-804a-390d63870421 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:24.782353 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3281c-b070-4102-804a-390d63870421 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:24.783926 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3281c-b070-4102-804a-390d63870421 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:24.797625 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 350/686] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:36:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:24.798472 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3281c-b070-4102-804a-390d63870421 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:24.825804 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:24.846223 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee272b9-4c4d-4f73-88bf-3c68a9abcb48 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:24.887643 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85905b8f-564f-4be5-b20e-61ea2a38621b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:24.888447 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85905b8f-564f-4be5-b20e-61ea2a38621b None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:24.888736 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85905b8f-564f-4be5-b20e-61ea2a38621b None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:24.889136 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85905b8f-564f-4be5-b20e-61ea2a38621b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:24.900350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85905b8f-564f-4be5-b20e-61ea2a38621b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:36:24.908874 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-85905b8f-564f-4be5-b20e-61ea2a38621b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:36:24.908874 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:24.908874 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:24.908874 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:24.908874 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:24.908874 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:24.908874 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:24.908874 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:24.908874 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:24.908874 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:24.908874 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:24.908874 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:24.908874 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:36:24.908874 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:36:24.908874 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:36:24.908874 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:36:24.909802 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:36:24.909802 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:36:24.909802 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:36:24.909802 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:36:24.909802 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:24.909802 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:24.909802 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:24.909802 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:24.909802 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:24.909802 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:24.909802 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:24.909802 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:24.909802 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:24.909802 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:24.909802 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:24.909802 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:24.910641 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:24.910641 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:24.910641 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:24.910641 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:24.910641 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:36:24.910641 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:36:24.910641 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:36:24.910641 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:36:24.910641 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:36:24.910641 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:36:24.910641 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:36:24.910641 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:24.910641 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 337/687] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:36:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:24.911334 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85905b8f-564f-4be5-b20e-61ea2a38621b None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:24.916302 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3281c-b070-4102-804a-390d63870421 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:24.916302 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:24.952650 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9b76b-e9a1-405f-996c-656e6b290ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:24.953454 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9b76b-e9a1-405f-996c-656e6b290ab6 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:24.953739 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9b76b-e9a1-405f-996c-656e6b290ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:24.954013 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9b76b-e9a1-405f-996c-656e6b290ab6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:24.965625 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9b76b-e9a1-405f-996c-656e6b290ab6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:24.967162 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9b76b-e9a1-405f-996c-656e6b290ab6 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:24.987190 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-cda9b76b-e9a1-405f-996c-656e6b290ab6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:24.987190 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:24.987190 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:24.987190 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:24.987190 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:24.987190 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:24.987190 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:24.987190 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:24.987190 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:24.987190 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:24.987190 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:24.987190 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:24.987190 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:24.987190 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:24.987190 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:24.989245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:24.989245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:24.989245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:24.989245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:24.989245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:24.989245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:24.989245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:24.989245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:24.989245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:24.989245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:24.989245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:24.989245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:24.989245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:24.989245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:24.989245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:24.989245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:24.989245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:24.991285 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:24.991285 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:24.991285 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:24.991285 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:24.991285 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 351/688] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:24.991285 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9b76b-e9a1-405f-996c-656e6b290ab6 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:25.028954 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85905b8f-564f-4be5-b20e-61ea2a38621b None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:25.068378 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648de72-512e-49b9-a1d8-ea5f29da059e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:25.069097 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648de72-512e-49b9-a1d8-ea5f29da059e None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:25.069380 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648de72-512e-49b9-a1d8-ea5f29da059e None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:25.069656 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648de72-512e-49b9-a1d8-ea5f29da059e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:25.070990 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648de72-512e-49b9-a1d8-ea5f29da059e None admin] RBAC: Adding query filter params (role.id=b57c4ebab8e842088df37b551053b113, scope.project.id=8addb03b903842609168ee2fafc8ec6b, user.id=f831a06a9cf344a2aa068c20a987b6da) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:25.071305 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648de72-512e-49b9-a1d8-ea5f29da059e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:25.073253 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648de72-512e-49b9-a1d8-ea5f29da059e None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:25.081806 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 338/689] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:36:24 2022] GET /identity/v3/role_assignments?user.id=f831a06a9cf344a2aa068c20a987b6da&scope.project.id=8addb03b903842609168ee2fafc8ec6b&role.id=b57c4ebab8e842088df37b551053b113 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:25.082606 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648de72-512e-49b9-a1d8-ea5f29da059e None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:25.094027 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:25.137845 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9b76b-e9a1-405f-996c-656e6b290ab6 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:25.221384 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648de72-512e-49b9-a1d8-ea5f29da059e None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:25.264573 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b83f8-9a41-4ce7-bcfb-c02dd4be6c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:25.264787 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea161a-1919-4ad5-bbcf-177bd8673c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:25.265244 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea161a-1919-4ad5-bbcf-177bd8673c81 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:25.265353 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b83f8-9a41-4ce7-bcfb-c02dd4be6c15 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:25.265533 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b83f8-9a41-4ce7-bcfb-c02dd4be6c15 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:25.265625 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea161a-1919-4ad5-bbcf-177bd8673c81 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:25.265793 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea161a-1919-4ad5-bbcf-177bd8673c81 None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:25.265889 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b83f8-9a41-4ce7-bcfb-c02dd4be6c15 None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:25.266522 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b83f8-9a41-4ce7-bcfb-c02dd4be6c15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:25.266637 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea161a-1919-4ad5-bbcf-177bd8673c81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:25.266829 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b83f8-9a41-4ce7-bcfb-c02dd4be6c15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:25.266927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea161a-1919-4ad5-bbcf-177bd8673c81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:25.268223 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea161a-1919-4ad5-bbcf-177bd8673c81 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:25.268333 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b83f8-9a41-4ce7-bcfb-c02dd4be6c15 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:25.287921 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 339/690] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:25.289318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b83f8-9a41-4ce7-bcfb-c02dd4be6c15 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:25.290545 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 352/691] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:36:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:25.296237 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea161a-1919-4ad5-bbcf-177bd8673c81 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:25.357306 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:25.399411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:25.439941 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b83f8-9a41-4ce7-bcfb-c02dd4be6c15 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:25.456071 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea161a-1919-4ad5-bbcf-177bd8673c81 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:25.489915 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41807ab-9902-452a-95c4-1856a8b7c5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:25.490643 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41807ab-9902-452a-95c4-1856a8b7c5ff None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:25.490925 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41807ab-9902-452a-95c4-1856a8b7c5ff None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:25.491201 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41807ab-9902-452a-95c4-1856a8b7c5ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:25.500360 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41807ab-9902-452a-95c4-1856a8b7c5ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:25.501432 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f2e41-45ac-4af5-ae21-8cf68816e9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:25.502220 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f2e41-45ac-4af5-ae21-8cf68816e9cf None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:25.502497 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f2e41-45ac-4af5-ae21-8cf68816e9cf None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:25.502765 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f2e41-45ac-4af5-ae21-8cf68816e9cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:25.503706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41807ab-9902-452a-95c4-1856a8b7c5ff None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:25.513865 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29f2e41-45ac-4af5-ae21-8cf68816e9cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:25.515298 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29f2e41-45ac-4af5-ae21-8cf68816e9cf None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:25.519502 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-c41807ab-9902-452a-95c4-1856a8b7c5ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:25.519502 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:25.519502 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:25.519502 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:25.519502 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:25.519502 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:25.519502 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:25.519502 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:25.519502 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:25.519502 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:25.519502 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:25.519502 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:25.519502 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:36:25.519502 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:36:25.519502 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:36:25.520564 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:36:25.520564 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:25.520564 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:25.520564 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:25.520564 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:25.520564 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:25.520564 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:25.520564 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:25.520564 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:25.520564 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:25.520564 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:25.520564 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:25.520564 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:25.520564 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:25.520564 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:25.520564 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:25.520564 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:25.521460 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:36:25.521460 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:36:25.521460 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:36:25.521460 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:36:25.521460 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:36:25.521460 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:36:25.521460 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:25.521460 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:25.523840 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 340/692] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:36:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:36:25.525266 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fc3ae-c7d6-4199-89f6-9b4d48e15404 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:25.525797 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fc3ae-c7d6-4199-89f6-9b4d48e15404 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:25.526293 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fc3ae-c7d6-4199-89f6-9b4d48e15404 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:25.528072 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 341/693] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:25.532974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93fc3ae-c7d6-4199-89f6-9b4d48e15404 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:25.539318 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-b29f2e41-45ac-4af5-ae21-8cf68816e9cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:25.539318 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:25.539318 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:25.539318 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:25.539318 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:25.539318 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:25.539318 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:25.539318 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:25.539318 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:25.539318 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:25.539318 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:25.539318 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:25.539318 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:25.539318 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:25.539318 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:25.540227 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:25.540227 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:25.540227 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:25.540227 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:25.540227 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:25.540227 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:25.540227 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:25.540227 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:25.540227 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:25.540227 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:25.540227 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:25.540227 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:25.540227 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:25.540227 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:25.540227 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:25.540227 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:25.540227 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:25.541113 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:25.541113 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:25.541113 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:25.541113 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:25.541113 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 353/694] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:25.542239 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb3aa3-92f4-4322-b571-6f8ebb444d8c None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:25.543060 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb3aa3-92f4-4322-b571-6f8ebb444d8c None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:25.543427 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb3aa3-92f4-4322-b571-6f8ebb444d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:25.564752 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-cccb3aa3-92f4-4322-b571-6f8ebb444d8c None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:25.565927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-cccb3aa3-92f4-4322-b571-6f8ebb444d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:25.640121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:25.642830 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 354/695] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:36:25.647204 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb3aa3-92f4-4322-b571-6f8ebb444d8c None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:25.665553 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93fc3ae-c7d6-4199-89f6-9b4d48e15404 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:25.694719 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:25.704662 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e317e0-d825-489b-b30a-a540d27295ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:25.705593 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e317e0-d825-489b-b30a-a540d27295ed None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:25.706036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e317e0-d825-489b-b30a-a540d27295ed None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:25.706447 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e317e0-d825-489b-b30a-a540d27295ed None admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:25.707553 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e317e0-d825-489b-b30a-a540d27295ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:25.708086 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e317e0-d825-489b-b30a-a540d27295ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:25.709833 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e317e0-d825-489b-b30a-a540d27295ed None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:25.723804 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 342/696] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:36:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:25.725320 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e317e0-d825-489b-b30a-a540d27295ed None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:25.779494 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb3aa3-92f4-4322-b571-6f8ebb444d8c None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:25.821448 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881c369-9943-4081-91ca-73a7560a16dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:25.822113 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881c369-9943-4081-91ca-73a7560a16dd None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:25.822400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881c369-9943-4081-91ca-73a7560a16dd None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:25.822984 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881c369-9943-4081-91ca-73a7560a16dd None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:25.824105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881c369-9943-4081-91ca-73a7560a16dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:25.824419 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881c369-9943-4081-91ca-73a7560a16dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:25.825953 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881c369-9943-4081-91ca-73a7560a16dd None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:25.843761 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 355/697] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:25.844829 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881c369-9943-4081-91ca-73a7560a16dd None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:25.851521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e317e0-d825-489b-b30a-a540d27295ed None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:25.901241 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a37a9c-314d-4b01-a98e-372cd36e7c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:25.902616 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a37a9c-314d-4b01-a98e-372cd36e7c48 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:25.903017 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a37a9c-314d-4b01-a98e-372cd36e7c48 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:25.903293 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a37a9c-314d-4b01-a98e-372cd36e7c48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:25.912493 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:25.918216 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a37a9c-314d-4b01-a98e-372cd36e7c48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:25.919852 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a37a9c-314d-4b01-a98e-372cd36e7c48 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:25.942534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-f6a37a9c-314d-4b01-a98e-372cd36e7c48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:25.942534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:25.942534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:25.942534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:25.942534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:25.942534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:25.942534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:25.942534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:25.942534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:25.942534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:25.942534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:25.942534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:25.942534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:25.942534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:25.942534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:25.943620 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:25.943620 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:25.943620 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:25.943620 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:25.943620 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:25.943620 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:25.943620 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:25.943620 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:25.943620 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:25.943620 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:25.943620 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:25.943620 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:25.943620 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:25.943620 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:25.943620 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:25.943620 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:25.943620 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:25.944570 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:25.944570 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:25.944570 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:25.944570 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:25.947753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 343/698] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:25.949829 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a37a9c-314d-4b01-a98e-372cd36e7c48 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:25.963529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881c369-9943-4081-91ca-73a7560a16dd None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:26.002094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e74e55-19b8-422e-bcb3-0a360bbbf134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:26.003098 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e74e55-19b8-422e-bcb3-0a360bbbf134 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:26.003591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e74e55-19b8-422e-bcb3-0a360bbbf134 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:26.004092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e74e55-19b8-422e-bcb3-0a360bbbf134 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:26.005113 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e74e55-19b8-422e-bcb3-0a360bbbf134 None admin] RBAC: Adding query filter params (role.id=b57c4ebab8e842088df37b551053b113, scope.project.id=8addb03b903842609168ee2fafc8ec6b, user.id=b275a110936a44ce8d54793af1a34808) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:26.005647 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e74e55-19b8-422e-bcb3-0a360bbbf134 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:26.007067 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:26.007925 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e74e55-19b8-422e-bcb3-0a360bbbf134 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:26.017171 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 356/699] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:36:25 2022] GET /identity/v3/role_assignments?user.id=b275a110936a44ce8d54793af1a34808&scope.project.id=8addb03b903842609168ee2fafc8ec6b&role.id=b57c4ebab8e842088df37b551053b113 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:26.022204 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e74e55-19b8-422e-bcb3-0a360bbbf134 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:26.131318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a37a9c-314d-4b01-a98e-372cd36e7c48 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:26.188999 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798b009-9e5e-4b71-a9c1-1999e32b982e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:26.189870 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798b009-9e5e-4b71-a9c1-1999e32b982e None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:26.190147 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798b009-9e5e-4b71-a9c1-1999e32b982e None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:26.190490 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798b009-9e5e-4b71-a9c1-1999e32b982e None admin] PATH_INFO: `/v3/users/nova` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:26.225986 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8798b009-9e5e-4b71-a9c1-1999e32b982e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:26.228614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8798b009-9e5e-4b71-a9c1-1999e32b982e None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:26.231841 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e74e55-19b8-422e-bcb3-0a360bbbf134 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:26.257375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-8798b009-9e5e-4b71-a9c1-1999e32b982e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 15:36:26.257375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:26.257375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:26.257375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:26.257375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:26.257375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:26.257375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:26.257375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:26.257375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:26.257375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:26.257375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:26.257375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:26.257375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:36:26.257375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:36:26.257375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:36:26.257375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:36:26.258435 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:26.258435 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:26.258435 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:36:26.258435 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:26.258435 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:36:26.258435 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:26.258435 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:26.258435 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:26.258435 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:26.258435 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:26.258435 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:26.258435 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:26.258435 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:26.258435 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:26.258435 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:26.258435 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:26.258435 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:26.258435 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:26.259411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:26.259411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:26.259411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:36:26.259411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:36:26.259411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:36:26.259411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:36:26.259411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:36:26.259411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:36:26.259411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 15:36:26.259411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:26.265163 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 344/700] 10.222.0.39 () {56 vars in 1093 bytes} [Mon May 23 15:36:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:26.277507 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798b009-9e5e-4b71-a9c1-1999e32b982e None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:26.287780 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:26.312730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d2098-d158-4172-9bdc-bd92953c3f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:26.313229 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d2098-d158-4172-9bdc-bd92953c3f2f None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:26.314106 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d2098-d158-4172-9bdc-bd92953c3f2f None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:26.314106 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d2098-d158-4172-9bdc-bd92953c3f2f None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:26.314540 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d2098-d158-4172-9bdc-bd92953c3f2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:26.315450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d2098-d158-4172-9bdc-bd92953c3f2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:26.316798 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d2098-d158-4172-9bdc-bd92953c3f2f None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:26.335370 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 357/701] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:26.341424 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d2098-d158-4172-9bdc-bd92953c3f2f None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:26.415901 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:26.421134 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798b009-9e5e-4b71-a9c1-1999e32b982e None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:26.472216 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0232b-def1-4f57-87fc-6acffb4e659d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:26.472897 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0232b-def1-4f57-87fc-6acffb4e659d None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:26.473187 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0232b-def1-4f57-87fc-6acffb4e659d None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:26.473469 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0232b-def1-4f57-87fc-6acffb4e659d None admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:26.474316 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0232b-def1-4f57-87fc-6acffb4e659d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:26.474631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0232b-def1-4f57-87fc-6acffb4e659d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:26.476124 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0232b-def1-4f57-87fc-6acffb4e659d None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:26.484883 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d2098-d158-4172-9bdc-bd92953c3f2f None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:26.496221 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 345/702] 10.222.0.39 () {56 vars in 1133 bytes} [Mon May 23 15:36:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:36:26.502524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0232b-def1-4f57-87fc-6acffb4e659d None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:26.523555 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d515225-e9ed-4665-aa67-b80fc7b7abe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:26.524977 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d515225-e9ed-4665-aa67-b80fc7b7abe8 None admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:26.525514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d515225-e9ed-4665-aa67-b80fc7b7abe8 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:26.525978 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d515225-e9ed-4665-aa67-b80fc7b7abe8 None admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:26.527401 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d515225-e9ed-4665-aa67-b80fc7b7abe8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:26.529299 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d515225-e9ed-4665-aa67-b80fc7b7abe8 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:26.609447 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 358/703] 10.222.0.39 () {60 vars in 1132 bytes} [Mon May 23 15:36:26 2022] POST /identity/v3/users => generated 254 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:36:26.614994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0232b-def1-4f57-87fc-6acffb4e659d None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:26.616591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62b7da-93eb-4c11-b35f-b23bd342c312 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:26.617105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62b7da-93eb-4c11-b35f-b23bd342c312 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:26.617655 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62b7da-93eb-4c11-b35f-b23bd342c312 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:26.619644 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 359/704] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:26 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:26.625937 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0319612-547b-459c-bcc0-bea094023f2e None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:26.626569 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0319612-547b-459c-bcc0-bea094023f2e None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:26.627110 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0319612-547b-459c-bcc0-bea094023f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:26.657091 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-f0319612-547b-459c-bcc0-bea094023f2e None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:26.658684 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-f0319612-547b-459c-bcc0-bea094023f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:26.659711 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5dbefb-87ba-4d8f-832d-db1f914faa50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:26.660373 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5dbefb-87ba-4d8f-832d-db1f914faa50 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:26.660661 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5dbefb-87ba-4d8f-832d-db1f914faa50 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:26.660948 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5dbefb-87ba-4d8f-832d-db1f914faa50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:26.718595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:26.731972 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:26.812396 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5dbefb-87ba-4d8f-832d-db1f914faa50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:26.813888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5dbefb-87ba-4d8f-832d-db1f914faa50 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:26.835028 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 360/705] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:36:26.869674 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0319612-547b-459c-bcc0-bea094023f2e None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:26.937026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 346/706] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:36:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:36:26.943007 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5dbefb-87ba-4d8f-832d-db1f914faa50 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:26.989687 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0319612-547b-459c-bcc0-bea094023f2e None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:27.027783 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:27.035323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66717830-be99-427e-b42f-f78176c66ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:27.036180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66717830-be99-427e-b42f-f78176c66ed0 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:27.036463 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66717830-be99-427e-b42f-f78176c66ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:27.036742 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66717830-be99-427e-b42f-f78176c66ed0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:27.037474 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66717830-be99-427e-b42f-f78176c66ed0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:27.038773 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66717830-be99-427e-b42f-f78176c66ed0 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:27.055572 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-66717830-be99-427e-b42f-f78176c66ed0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 15:36:27.055572 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:27.055572 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:36:27.055572 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:36:27.055572 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:36:27.055572 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:36:27.055572 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:36:27.055572 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:36:27.055572 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 15:36:27.055572 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:27.055572 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:36:27.055572 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:27.055572 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:27.055572 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:27.055572 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:27.055572 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:27.056640 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:27.056640 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:27.056640 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:27.056640 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:27.056640 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:27.056640 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:27.056640 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:27.056640 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:36:27.056640 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:36:27.056640 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:36:27.056640 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:36:27.056640 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:27.056640 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:27.056640 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:27.056640 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:27.056640 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:27.057549 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:27.057549 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:27.057549 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:27.057549 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:27.057549 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:27.057549 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:27.057549 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:27.057549 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:27.057549 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:27.057549 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:27.057549 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:27.057549 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:36:27.057549 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:36:27.057549 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 15:36:27.057549 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:27.057549 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 361/707] 10.222.0.39 () {56 vars in 1129 bytes} [Mon May 23 15:36:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:27.063432 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66717830-be99-427e-b42f-f78176c66ed0 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:27.085617 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5dbefb-87ba-4d8f-832d-db1f914faa50 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:27.106218 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:27.133687 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58d0fa-ea11-423d-a27f-fb8b8280f0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:27.135385 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58d0fa-ea11-423d-a27f-fb8b8280f0d7 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:27.136634 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58d0fa-ea11-423d-a27f-fb8b8280f0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:27.137224 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58d0fa-ea11-423d-a27f-fb8b8280f0d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:27.152932 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58d0fa-ea11-423d-a27f-fb8b8280f0d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:27.157345 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58d0fa-ea11-423d-a27f-fb8b8280f0d7 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:27.177349 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-ed58d0fa-ea11-423d-a27f-fb8b8280f0d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:27.177349 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:27.177349 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:27.177349 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:27.177349 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:27.177349 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:27.177349 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:27.177349 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:27.177349 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:27.177349 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:27.177349 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:27.177349 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:27.177349 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:27.177349 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:27.177349 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:27.178534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:27.178534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:27.178534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:27.178534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:27.178534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:27.178534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:27.178534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:27.178534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:27.178534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:27.178534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:27.178534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:27.178534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:27.178534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:27.178534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:27.178534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:27.178534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:27.178534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:27.179684 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:27.179684 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:27.179684 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:27.179684 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:27.179684 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 347/708] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:27.187907 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58d0fa-ea11-423d-a27f-fb8b8280f0d7 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:27.197389 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66717830-be99-427e-b42f-f78176c66ed0 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:27.266347 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3df4e-ec0a-445d-90b5-7ff987c3d20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:27.266936 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3df4e-ec0a-445d-90b5-7ff987c3d20d None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:27.267216 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3df4e-ec0a-445d-90b5-7ff987c3d20d None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:27.267549 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3df4e-ec0a-445d-90b5-7ff987c3d20d None admin] PATH_INFO: `/v3/services` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:27.268300 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3df4e-ec0a-445d-90b5-7ff987c3d20d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:27.268658 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3df4e-ec0a-445d-90b5-7ff987c3d20d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:27.270045 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3df4e-ec0a-445d-90b5-7ff987c3d20d None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:27.285778 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 362/709] 10.222.0.39 () {56 vars in 1124 bytes} [Mon May 23 15:36:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:27.287429 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3df4e-ec0a-445d-90b5-7ff987c3d20d None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:27.372836 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58d0fa-ea11-423d-a27f-fb8b8280f0d7 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:27.403997 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:27.439433 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cca820-e52e-4a9b-ac3c-1bbdb98fd43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:27.440130 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cca820-e52e-4a9b-ac3c-1bbdb98fd43a None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:27.440410 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cca820-e52e-4a9b-ac3c-1bbdb98fd43a None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:27.440683 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cca820-e52e-4a9b-ac3c-1bbdb98fd43a None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:27.441410 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cca820-e52e-4a9b-ac3c-1bbdb98fd43a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:27.441718 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cca820-e52e-4a9b-ac3c-1bbdb98fd43a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:27.443107 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cca820-e52e-4a9b-ac3c-1bbdb98fd43a None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:27.456842 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 348/710] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:36:27.461958 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cca820-e52e-4a9b-ac3c-1bbdb98fd43a None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:27.476151 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:27.486433 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3df4e-ec0a-445d-90b5-7ff987c3d20d None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:27.542927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e3640-a67d-43e3-bf16-0f21139b3e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:27.543560 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e3640-a67d-43e3-bf16-0f21139b3e03 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:27.543850 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e3640-a67d-43e3-bf16-0f21139b3e03 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:27.544132 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e3640-a67d-43e3-bf16-0f21139b3e03 None admin] PATH_INFO: `/v3/services` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:27.544884 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e3640-a67d-43e3-bf16-0f21139b3e03 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:27.545170 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e3640-a67d-43e3-bf16-0f21139b3e03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:27.547700 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e3640-a67d-43e3-bf16-0f21139b3e03 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:27.552818 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 363/711] 10.222.0.39 () {56 vars in 1124 bytes} [Mon May 23 15:36:27 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:36:27.598985 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cca820-e52e-4a9b-ac3c-1bbdb98fd43a None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:27.638150 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0553ede-85ed-4bdd-b909-62afcf40eb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:27.639309 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0553ede-85ed-4bdd-b909-62afcf40eb06 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:27.639856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0553ede-85ed-4bdd-b909-62afcf40eb06 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:27.640348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0553ede-85ed-4bdd-b909-62afcf40eb06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:27.648071 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0553ede-85ed-4bdd-b909-62afcf40eb06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:27.649839 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0553ede-85ed-4bdd-b909-62afcf40eb06 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:27.665751 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-f0553ede-85ed-4bdd-b909-62afcf40eb06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:27.665751 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:27.665751 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:27.665751 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:27.665751 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:27.665751 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:27.665751 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:27.665751 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:27.665751 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:27.665751 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:27.665751 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:27.665751 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:27.665751 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:36:27.665751 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:36:27.665751 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:36:27.666746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:36:27.666746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:27.666746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:27.666746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:27.666746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:27.666746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:27.666746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:27.666746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:27.666746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:27.666746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:27.666746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:27.666746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:27.666746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:27.666746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:27.666746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:27.666746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:27.666746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:27.668191 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:36:27.668191 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:36:27.668191 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:36:27.668191 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:36:27.668191 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:36:27.668191 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:36:27.668191 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:27.668191 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:27.670750 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 349/712] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:36:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:27.676926 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e3640-a67d-43e3-bf16-0f21139b3e03 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:27.713392 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a6137-277e-4bfd-b5e8-83e88b192e16 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:27.713724 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a6137-277e-4bfd-b5e8-83e88b192e16 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:27.713946 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a6137-277e-4bfd-b5e8-83e88b192e16 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:27.715811 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 350/713] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:27.725713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cefd9-be5c-4700-983d-7beb491b7ddf None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:27.726026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cefd9-be5c-4700-983d-7beb491b7ddf None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:27.726838 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cefd9-be5c-4700-983d-7beb491b7ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:27.760667 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-837cefd9-be5c-4700-983d-7beb491b7ddf None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:27.762410 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-837cefd9-be5c-4700-983d-7beb491b7ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:27.815997 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:27.859064 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e3640-a67d-43e3-bf16-0f21139b3e03 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:27.888541 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 351/714] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:36:27.908375 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f3348-abc6-42e2-a834-d4a7544cfad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:27.909049 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f3348-abc6-42e2-a834-d4a7544cfad2 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:27.909391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f3348-abc6-42e2-a834-d4a7544cfad2 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:27.909680 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f3348-abc6-42e2-a834-d4a7544cfad2 None admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:27.910484 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f3348-abc6-42e2-a834-d4a7544cfad2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:27.910797 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f3348-abc6-42e2-a834-d4a7544cfad2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:27.911255 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837cefd9-be5c-4700-983d-7beb491b7ddf None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:27.912272 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f3348-abc6-42e2-a834-d4a7544cfad2 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:27.929820 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 364/715] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:36:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:27.935705 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f3348-abc6-42e2-a834-d4a7544cfad2 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:27.962298 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:28.040821 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f3348-abc6-42e2-a834-d4a7544cfad2 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:28.075964 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847feb0-3f5c-4963-8dfb-d97408e7f560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:28.076543 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847feb0-3f5c-4963-8dfb-d97408e7f560 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:28.076831 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847feb0-3f5c-4963-8dfb-d97408e7f560 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:28.077116 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847feb0-3f5c-4963-8dfb-d97408e7f560 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:28.077950 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e847feb0-3f5c-4963-8dfb-d97408e7f560 None admin] RBAC: Adding query filter params (role.id=3ab888f5f68740bd8f9df4447f4f5a7a, scope.project.id=8addb03b903842609168ee2fafc8ec6b, user.id=76f7895b7b5748e7b4461f7fde1d558a) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:28.078268 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e847feb0-3f5c-4963-8dfb-d97408e7f560 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:28.079903 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e847feb0-3f5c-4963-8dfb-d97408e7f560 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:28.086261 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 365/716] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:36:27 2022] GET /identity/v3/role_assignments?user.id=76f7895b7b5748e7b4461f7fde1d558a&scope.project.id=8addb03b903842609168ee2fafc8ec6b&role.id=3ab888f5f68740bd8f9df4447f4f5a7a => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:36:28.150892 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837cefd9-be5c-4700-983d-7beb491b7ddf None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:28.204687 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02109b-25c7-4df0-8d3a-d0efd3ef7695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:28.205530 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02109b-25c7-4df0-8d3a-d0efd3ef7695 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:28.205813 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02109b-25c7-4df0-8d3a-d0efd3ef7695 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:28.206089 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02109b-25c7-4df0-8d3a-d0efd3ef7695 None admin] PATH_INFO: `/v3/services/network` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:28.206771 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02109b-25c7-4df0-8d3a-d0efd3ef7695 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:28.208255 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02109b-25c7-4df0-8d3a-d0efd3ef7695 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:28.233190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-5f02109b-25c7-4df0-8d3a-d0efd3ef7695 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 23 15:36:28.233190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:28.233190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:36:28.233190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:36:28.233190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:36:28.233190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:36:28.233190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:36:28.233190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:36:28.233190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 15:36:28.233190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:28.233190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:36:28.233190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:28.233190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:28.233190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:28.233190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:28.233190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:28.233190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:28.235431 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:28.235431 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:28.235431 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:28.235431 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:28.235431 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:28.235431 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:28.235431 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:36:28.235431 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:36:28.235431 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:36:28.235431 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:36:28.235431 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:28.235431 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:28.235431 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:28.235431 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:28.235431 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:28.235431 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:28.236375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:28.236375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:28.236375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:28.236375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:28.236375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:28.236375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:28.236375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:28.236375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:28.236375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:28.236375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:28.236375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:36:28.236375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:36:28.236375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 15:36:28.236375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:28.236375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 352/717] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:36:27 2022] GET /identity/v3/services/network => generated 88 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:36:28.246098 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847feb0-3f5c-4963-8dfb-d97408e7f560 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:28.349100 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:28.364072 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847feb0-3f5c-4963-8dfb-d97408e7f560 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:28.399708 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52125c-0676-4df5-ae6d-3e4b707a1eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:28.400454 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52125c-0676-4df5-ae6d-3e4b707a1eb3 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:28.400983 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52125c-0676-4df5-ae6d-3e4b707a1eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:28.401268 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52125c-0676-4df5-ae6d-3e4b707a1eb3 None admin] PATH_INFO: `/v3/services` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:28.402018 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52125c-0676-4df5-ae6d-3e4b707a1eb3 None admin] RBAC: Adding query filter params (name=network) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:28.402315 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52125c-0676-4df5-ae6d-3e4b707a1eb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:28.403729 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52125c-0676-4df5-ae6d-3e4b707a1eb3 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:28.408513 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 366/718] 10.222.0.39 () {56 vars in 1112 bytes} [Mon May 23 15:36:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:28.416870 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02109b-25c7-4df0-8d3a-d0efd3ef7695 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:28.450791 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:28.555748 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02109b-25c7-4df0-8d3a-d0efd3ef7695 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:28.601540 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d0ef7-5953-40e2-9c48-af6925ff7e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:28.602127 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d0ef7-5953-40e2-9c48-af6925ff7e9e None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:28.602413 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d0ef7-5953-40e2-9c48-af6925ff7e9e None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:28.602692 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d0ef7-5953-40e2-9c48-af6925ff7e9e None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:28.603404 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d0ef7-5953-40e2-9c48-af6925ff7e9e None admin] RBAC: Adding query filter params (type=network) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:28.603740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d0ef7-5953-40e2-9c48-af6925ff7e9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:28.605881 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d0ef7-5953-40e2-9c48-af6925ff7e9e None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:28.616833 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 353/719] 10.222.0.39 () {56 vars in 1112 bytes} [Mon May 23 15:36:28 2022] GET /identity/v3/services?type=network => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:36:29.268428 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463a3fb-443b-4270-8249-90bcf51ad42d None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:29.268941 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463a3fb-443b-4270-8249-90bcf51ad42d None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:29.269020 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463a3fb-443b-4270-8249-90bcf51ad42d None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:29.270641 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 367/720] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:29.276004 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c6a65-e288-4df5-b792-51ed43930ce5 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:29.276411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c6a65-e288-4df5-b792-51ed43930ce5 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:29.276679 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c6a65-e288-4df5-b792-51ed43930ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:29.294031 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-a59c6a65-e288-4df5-b792-51ed43930ce5 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:29.295238 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-a59c6a65-e288-4df5-b792-51ed43930ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:29.385056 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 354/721] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:36:29.408352 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463a3fb-443b-4270-8249-90bcf51ad42d None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:29.517339 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463a3fb-443b-4270-8249-90bcf51ad42d None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:29.532122 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3000df-0420-4e9a-b72e-401ced5a3917 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:29.532430 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3000df-0420-4e9a-b72e-401ced5a3917 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:29.532687 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3000df-0420-4e9a-b72e-401ced5a3917 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:29.534188 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 355/722] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:29.539264 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e8975-aa9e-4293-8370-25eacdf30bc0 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:29.539580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e8975-aa9e-4293-8370-25eacdf30bc0 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:29.539895 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e8975-aa9e-4293-8370-25eacdf30bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:29.563649 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-9e3e8975-aa9e-4293-8370-25eacdf30bc0 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:29.564831 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-9e3e8975-aa9e-4293-8370-25eacdf30bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:29.581638 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:29.590563 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9cf49-5d64-4e71-9810-69d0793f6826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:29.591363 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9cf49-5d64-4e71-9810-69d0793f6826 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:29.591671 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9cf49-5d64-4e71-9810-69d0793f6826 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:29.592081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9cf49-5d64-4e71-9810-69d0793f6826 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:29.604921 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f9cf49-5d64-4e71-9810-69d0793f6826 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:36:29.612791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-b2f9cf49-5d64-4e71-9810-69d0793f6826 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:36:29.612791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:29.612791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:29.612791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:29.612791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:29.612791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:29.612791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:29.612791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:29.612791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:29.612791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:29.612791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:29.612791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:29.612791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:36:29.612791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:36:29.612791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:36:29.612791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:36:29.613727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:36:29.613727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:36:29.613727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:36:29.613727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:36:29.613727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:29.613727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:29.613727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:29.613727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:29.613727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:29.613727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:29.613727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:29.613727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:29.613727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:29.613727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:29.613727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:29.613727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:29.614558 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:29.614558 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:29.614558 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:29.614558 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:29.614558 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:36:29.614558 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:36:29.614558 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:36:29.614558 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:36:29.614558 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:36:29.614558 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:36:29.614558 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:36:29.614558 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:29.614558 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 368/723] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:36:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:29.619795 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9cf49-5d64-4e71-9810-69d0793f6826 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:29.644227 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:29.685316 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 356/724] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:36:29.726246 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e8975-aa9e-4293-8370-25eacdf30bc0 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:29.781074 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9cf49-5d64-4e71-9810-69d0793f6826 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:29.843778 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6dcd6-eb88-46f6-89d0-afcbe5dec2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:29.844451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6dcd6-eb88-46f6-89d0-afcbe5dec2a2 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:29.844737 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6dcd6-eb88-46f6-89d0-afcbe5dec2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:29.845074 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6dcd6-eb88-46f6-89d0-afcbe5dec2a2 None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:29.845829 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6dcd6-eb88-46f6-89d0-afcbe5dec2a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:29.846186 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6dcd6-eb88-46f6-89d0-afcbe5dec2a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:29.847628 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6dcd6-eb88-46f6-89d0-afcbe5dec2a2 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:29.862663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 369/725] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:36:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:36:29.868003 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6dcd6-eb88-46f6-89d0-afcbe5dec2a2 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:29.879130 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e8975-aa9e-4293-8370-25eacdf30bc0 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:29.947005 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e0832-8f37-4364-8d5d-2edaf7836edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:29.947837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e0832-8f37-4364-8d5d-2edaf7836edf None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:29.948126 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e0832-8f37-4364-8d5d-2edaf7836edf None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:29.948918 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e0832-8f37-4364-8d5d-2edaf7836edf None admin] PATH_INFO: `/v3/roles/service` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:29.969412 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e0832-8f37-4364-8d5d-2edaf7836edf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:36:29.982411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-2f7e0832-8f37-4364-8d5d-2edaf7836edf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:29.982411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:29.982411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:29.982411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:29.982411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:29.982411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:29.982411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:29.982411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:29.982411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:29.982411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:29.982411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:29.982411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:29.982411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:36:29.982411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:36:29.982411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:36:29.982411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:36:29.983740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:36:29.983740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:36:29.983740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:36:29.983740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:36:29.983740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:29.983740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:29.983740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:29.983740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:29.983740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:29.983740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:29.983740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:29.983740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:29.983740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:29.983740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:29.983740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:29.983740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:29.984575 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:29.984575 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:29.984575 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:29.984575 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:29.984575 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:36:29.984575 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:36:29.984575 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:36:29.984575 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:36:29.984575 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:36:29.984575 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:36:29.984575 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:29.984575 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:29.994884 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 357/726] 10.222.0.39 () {56 vars in 1102 bytes} [Mon May 23 15:36:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:29.997733 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e0832-8f37-4364-8d5d-2edaf7836edf None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:30.003564 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:30.015119 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:30.057426 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6dcd6-eb88-46f6-89d0-afcbe5dec2a2 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:30.120688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160af3df-01b8-4616-9556-57cb2756ae31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:30.121492 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160af3df-01b8-4616-9556-57cb2756ae31 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:30.121778 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160af3df-01b8-4616-9556-57cb2756ae31 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:30.122057 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160af3df-01b8-4616-9556-57cb2756ae31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:30.147450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160af3df-01b8-4616-9556-57cb2756ae31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:30.150394 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160af3df-01b8-4616-9556-57cb2756ae31 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:30.176473 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e0832-8f37-4364-8d5d-2edaf7836edf None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:30.178120 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-160af3df-01b8-4616-9556-57cb2756ae31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:30.178120 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:30.178120 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:30.178120 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:30.178120 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:30.178120 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:30.178120 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:30.178120 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:30.178120 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:30.178120 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:30.178120 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:30.178120 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:30.178120 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:30.178120 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:30.178120 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:30.180130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:30.180130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:30.180130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:30.180130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:30.180130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:30.180130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:30.180130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:30.180130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:30.180130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:30.180130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:30.180130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:30.180130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:30.180130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:30.180130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:30.180130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:30.180130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:30.180130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:30.181759 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:30.181759 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:30.181759 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:30.181759 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:30.181759 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 370/727] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:30.186513 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160af3df-01b8-4616-9556-57cb2756ae31 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:30.241063 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d2031-16bb-4cfc-a652-47227ff90280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:30.241736 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d2031-16bb-4cfc-a652-47227ff90280 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:30.242023 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d2031-16bb-4cfc-a652-47227ff90280 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:30.242301 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d2031-16bb-4cfc-a652-47227ff90280 None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:30.243050 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d2031-16bb-4cfc-a652-47227ff90280 None admin] RBAC: Adding query filter params (name=service) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:30.243362 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d2031-16bb-4cfc-a652-47227ff90280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:30.248929 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d2031-16bb-4cfc-a652-47227ff90280 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:30.263075 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 358/728] 10.222.0.39 () {56 vars in 1103 bytes} [Mon May 23 15:36:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:30.276402 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d2031-16bb-4cfc-a652-47227ff90280 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:30.328614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160af3df-01b8-4616-9556-57cb2756ae31 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:30.355046 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:30.366456 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888668a4-8315-4547-81b0-40d30fb4a329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:30.367403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888668a4-8315-4547-81b0-40d30fb4a329 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:30.367896 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888668a4-8315-4547-81b0-40d30fb4a329 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:30.368361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888668a4-8315-4547-81b0-40d30fb4a329 None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:30.369403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888668a4-8315-4547-81b0-40d30fb4a329 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:30.370041 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888668a4-8315-4547-81b0-40d30fb4a329 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:30.377439 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888668a4-8315-4547-81b0-40d30fb4a329 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:30.391633 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 371/729] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:30.402404 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:30.402900 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888668a4-8315-4547-81b0-40d30fb4a329 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:30.460086 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d2031-16bb-4cfc-a652-47227ff90280 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:30.501235 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c91d4-f67b-46b5-8cd0-cffba60b1542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:30.502061 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c91d4-f67b-46b5-8cd0-cffba60b1542 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:30.502422 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c91d4-f67b-46b5-8cd0-cffba60b1542 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:30.502703 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c91d4-f67b-46b5-8cd0-cffba60b1542 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:30.515939 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c91d4-f67b-46b5-8cd0-cffba60b1542 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:30.517425 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c91d4-f67b-46b5-8cd0-cffba60b1542 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:30.538629 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-931c91d4-f67b-46b5-8cd0-cffba60b1542 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:30.538629 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:30.538629 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:30.538629 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:30.538629 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:30.538629 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:30.538629 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:30.538629 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:30.538629 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:30.538629 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:30.538629 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:30.538629 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:30.538629 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:30.538629 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:30.538629 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:30.539817 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:30.539817 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:30.539817 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:30.539817 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:30.539817 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:30.539817 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:30.539817 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:30.539817 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:30.539817 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:30.539817 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:30.539817 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:30.539817 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:30.539817 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:30.539817 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:30.539817 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:30.539817 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:30.539817 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:30.540950 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:30.540950 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:30.540950 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:30.540950 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:30.540950 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 359/730] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:30.541424 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e9d28-5361-4854-89ec-c1f85c336e56 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:30.541716 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e9d28-5361-4854-89ec-c1f85c336e56 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:30.541994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e9d28-5361-4854-89ec-c1f85c336e56 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:30.548501 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 360/731] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:30.548501 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e9d28-5361-4854-89ec-c1f85c336e56 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:30.563915 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888668a4-8315-4547-81b0-40d30fb4a329 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:30.610793 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457042db-6862-4933-b419-c661ceb6922f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:30.612355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457042db-6862-4933-b419-c661ceb6922f None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:30.612819 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457042db-6862-4933-b419-c661ceb6922f None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:30.613529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457042db-6862-4933-b419-c661ceb6922f None admin] PATH_INFO: `/v3/users/swift` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:30.623419 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457042db-6862-4933-b419-c661ceb6922f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:30.625252 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457042db-6862-4933-b419-c661ceb6922f None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:30.645092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-457042db-6862-4933-b419-c661ceb6922f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 15:36:30.645092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:30.645092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:30.645092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:30.645092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:30.645092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:30.645092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:30.645092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:30.645092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:30.645092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:30.645092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:30.645092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:30.645092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:36:30.645092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:36:30.645092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:36:30.645092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:36:30.646094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:30.646094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:30.646094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:36:30.646094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:30.646094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:36:30.646094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:30.646094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:30.646094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:30.646094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:30.646094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:30.646094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:30.646094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:30.646094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:30.646094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:30.646094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:30.646094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:30.646094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:30.646094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:30.647040 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:30.647040 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:30.647040 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:36:30.647040 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:36:30.647040 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:36:30.647040 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:36:30.647040 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:36:30.647040 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:36:30.647040 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 15:36:30.647040 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:30.655003 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 372/732] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:36:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:30.656677 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe5eb5-5beb-41ab-804d-4e050501dbf8 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:30.656915 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe5eb5-5beb-41ab-804d-4e050501dbf8 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:30.657196 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe5eb5-5beb-41ab-804d-4e050501dbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:30.668247 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e9d28-5361-4854-89ec-c1f85c336e56 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:30.675933 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-3ebe5eb5-5beb-41ab-804d-4e050501dbf8 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:30.677281 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-3ebe5eb5-5beb-41ab-804d-4e050501dbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:30.692841 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:30.710741 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f0be0-756f-447d-8389-985aaff300cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:30.711737 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f0be0-756f-447d-8389-985aaff300cd None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:30.712053 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f0be0-756f-447d-8389-985aaff300cd None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:30.712438 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f0be0-756f-447d-8389-985aaff300cd None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:30.713158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f0be0-756f-447d-8389-985aaff300cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:30.713468 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f0be0-756f-447d-8389-985aaff300cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:30.715450 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f0be0-756f-447d-8389-985aaff300cd None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:30.723087 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:30.728906 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 361/733] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:30.729868 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f0be0-756f-447d-8389-985aaff300cd None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:30.756967 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 373/734] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:36:30.758383 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497fb97-101a-4f4c-870e-916f415ccc2b None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:30.758683 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497fb97-101a-4f4c-870e-916f415ccc2b None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:30.758966 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497fb97-101a-4f4c-870e-916f415ccc2b None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:30.760393 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 374/735] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:30.765534 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497fb97-101a-4f4c-870e-916f415ccc2b None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:30.846273 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f0be0-756f-447d-8389-985aaff300cd None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:30.867342 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497fb97-101a-4f4c-870e-916f415ccc2b None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:30.884220 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0df2a9-fd71-4e3b-a4ef-72fc117a5b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:30.885010 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0df2a9-fd71-4e3b-a4ef-72fc117a5b1c None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:30.885300 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0df2a9-fd71-4e3b-a4ef-72fc117a5b1c None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:30.885581 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0df2a9-fd71-4e3b-a4ef-72fc117a5b1c None admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:30.886511 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0df2a9-fd71-4e3b-a4ef-72fc117a5b1c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:30.886880 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0df2a9-fd71-4e3b-a4ef-72fc117a5b1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:30.888505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0df2a9-fd71-4e3b-a4ef-72fc117a5b1c None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:30.903184 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb0b29-2bea-410b-af5e-3f5e048679d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:30.904023 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb0b29-2bea-410b-af5e-3f5e048679d8 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:30.904304 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb0b29-2bea-410b-af5e-3f5e048679d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:30.904575 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb0b29-2bea-410b-af5e-3f5e048679d8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:30.907449 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 362/736] 10.222.0.39 () {56 vars in 1135 bytes} [Mon May 23 15:36:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:30.908812 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12760b4e-e16b-4280-a29f-a8ba595541d9 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:30.909108 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12760b4e-e16b-4280-a29f-a8ba595541d9 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:30.909388 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12760b4e-e16b-4280-a29f-a8ba595541d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:30.916485 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb0b29-2bea-410b-af5e-3f5e048679d8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:30.918595 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb0b29-2bea-410b-af5e-3f5e048679d8 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:30.927249 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-12760b4e-e16b-4280-a29f-a8ba595541d9 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:30.928460 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-12760b4e-e16b-4280-a29f-a8ba595541d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:30.934776 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-61bb0b29-2bea-410b-af5e-3f5e048679d8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:36:30.934776 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:30.934776 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:30.934776 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:30.934776 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:30.934776 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:30.934776 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:30.934776 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:30.934776 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:30.934776 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:30.934776 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:30.934776 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:30.934776 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:36:30.934776 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:36:30.934776 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:36:30.934776 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:36:30.935740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:30.935740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:30.935740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:36:30.935740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:30.935740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:36:30.935740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:30.935740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:30.935740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:30.935740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:30.935740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:30.935740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:30.935740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:30.935740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:30.935740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:30.935740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:30.935740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:30.935740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:30.935740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:30.937255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:30.937255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:30.937255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:36:30.937255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:36:30.937255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:36:30.937255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:36:30.937255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:36:30.937255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:36:30.937255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:36:30.937255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:30.937255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 375/737] 10.222.0.39 () {56 vars in 1117 bytes} [Mon May 23 15:36:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:30.937255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb0b29-2bea-410b-af5e-3f5e048679d8 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:30.964104 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:30.975529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:31.009459 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 363/738] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:36:31.010122 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12760b4e-e16b-4280-a29f-a8ba595541d9 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:31.057425 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb0b29-2bea-410b-af5e-3f5e048679d8 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:31.092472 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b44e4-d9ec-493b-b21a-10be4fce8ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:31.093136 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b44e4-d9ec-493b-b21a-10be4fce8ed7 None admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:31.093420 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b44e4-d9ec-493b-b21a-10be4fce8ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:31.093699 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b44e4-d9ec-493b-b21a-10be4fce8ed7 None admin] PATH_INFO: `/v3/services` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:31.094420 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b44e4-d9ec-493b-b21a-10be4fce8ed7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:31.095817 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b44e4-d9ec-493b-b21a-10be4fce8ed7 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:31.125738 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12760b4e-e16b-4280-a29f-a8ba595541d9 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:31.160156 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5bde7b-c5be-44ae-8532-4e3b0962638a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:31.160827 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bde7b-c5be-44ae-8532-4e3b0962638a None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:31.161112 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bde7b-c5be-44ae-8532-4e3b0962638a None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:31.161389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bde7b-c5be-44ae-8532-4e3b0962638a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:31.195152 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 376/739] 10.222.0.39 () {60 vars in 1141 bytes} [Mon May 23 15:36:30 2022] POST /identity/v3/services => generated 251 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:36:31.204829 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b44e4-d9ec-493b-b21a-10be4fce8ed7 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:31.215201 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:31.253199 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5bde7b-c5be-44ae-8532-4e3b0962638a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:31.254686 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5bde7b-c5be-44ae-8532-4e3b0962638a None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:31.378765 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:31.390677 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 364/740] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:36:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:36:31.390677 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5bde7b-c5be-44ae-8532-4e3b0962638a None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:31.404628 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b44e4-d9ec-493b-b21a-10be4fce8ed7 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:31.447640 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50eddda-bb40-46b1-afc8-33956a394ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:31.447640 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50eddda-bb40-46b1-afc8-33956a394ac6 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:31.448076 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50eddda-bb40-46b1-afc8-33956a394ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:31.448770 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50eddda-bb40-46b1-afc8-33956a394ac6 None admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:31.449612 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50eddda-bb40-46b1-afc8-33956a394ac6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:31.449928 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50eddda-bb40-46b1-afc8-33956a394ac6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:31.451378 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50eddda-bb40-46b1-afc8-33956a394ac6 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:31.464767 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:31.477611 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 377/741] 10.222.0.39 () {56 vars in 1149 bytes} [Mon May 23 15:36:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:31.478892 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791fa91-412a-416c-aa60-190e0be63fd8 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:31.479183 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791fa91-412a-416c-aa60-190e0be63fd8 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:31.479464 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791fa91-412a-416c-aa60-190e0be63fd8 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:31.482676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 378/742] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:31.482676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791fa91-412a-416c-aa60-190e0be63fd8 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:31.509662 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5bde7b-c5be-44ae-8532-4e3b0962638a None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:31.549952 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c1fa2-3f0c-481f-8d0d-48c2b6537012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:31.550737 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c1fa2-3f0c-481f-8d0d-48c2b6537012 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:31.551017 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c1fa2-3f0c-481f-8d0d-48c2b6537012 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:31.551290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c1fa2-3f0c-481f-8d0d-48c2b6537012 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:31.562777 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c1fa2-3f0c-481f-8d0d-48c2b6537012 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:36:31.570924 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-c05c1fa2-3f0c-481f-8d0d-48c2b6537012 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:36:31.570924 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:31.570924 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:31.570924 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:31.570924 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:31.570924 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:31.570924 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:31.570924 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:31.570924 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:31.570924 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:31.570924 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:31.570924 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:31.570924 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:36:31.570924 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:36:31.570924 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:36:31.570924 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:36:31.571885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:36:31.571885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:36:31.571885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:36:31.571885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:36:31.571885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:31.571885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:31.571885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:31.571885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:31.571885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:31.571885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:31.571885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:31.571885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:31.571885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:31.571885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:31.571885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:31.571885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:31.572716 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:31.572716 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:31.572716 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:31.572716 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:31.572716 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:36:31.572716 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:36:31.572716 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:36:31.572716 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:36:31.572716 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:36:31.572716 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:36:31.572716 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:36:31.572716 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:31.572716 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 365/743] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:36:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:31.573395 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c1fa2-3f0c-481f-8d0d-48c2b6537012 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:31.593661 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791fa91-412a-416c-aa60-190e0be63fd8 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:31.630434 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a94cb1-0830-407a-9e70-cafafe5f804d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:31.631140 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a94cb1-0830-407a-9e70-cafafe5f804d None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:31.631415 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a94cb1-0830-407a-9e70-cafafe5f804d None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:31.631713 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a94cb1-0830-407a-9e70-cafafe5f804d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:31.642468 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a94cb1-0830-407a-9e70-cafafe5f804d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:31.643930 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a94cb1-0830-407a-9e70-cafafe5f804d None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:31.652685 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:31.662351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-04a94cb1-0830-407a-9e70-cafafe5f804d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:31.662351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:31.662351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:31.662351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:31.662351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:31.662351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:31.662351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:31.662351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:31.662351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:31.662351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:31.662351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:31.662351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:31.662351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:31.662351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:31.662351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:31.663233 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:31.663233 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:31.663233 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:31.663233 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:31.663233 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:31.663233 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:31.663233 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:31.663233 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:31.663233 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:31.663233 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:31.663233 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:31.663233 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:31.663233 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:31.663233 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:31.663233 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:31.663233 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:31.663233 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:31.667808 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:31.667808 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:31.667808 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:31.667808 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:31.667808 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 379/744] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:31.667808 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335249b-569c-44cd-8cbe-c68f24573e9f None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:31.667808 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335249b-569c-44cd-8cbe-c68f24573e9f None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:31.667808 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335249b-569c-44cd-8cbe-c68f24573e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:31.685543 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-a335249b-569c-44cd-8cbe-c68f24573e9f None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:31.687230 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-a335249b-569c-44cd-8cbe-c68f24573e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:31.688507 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c1fa2-3f0c-481f-8d0d-48c2b6537012 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:31.717325 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:31.724945 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fdaf0-9152-4ef5-85b7-92840993a4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:31.725641 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fdaf0-9152-4ef5-85b7-92840993a4b4 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:31.725919 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fdaf0-9152-4ef5-85b7-92840993a4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:31.726188 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fdaf0-9152-4ef5-85b7-92840993a4b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:31.757737 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 380/745] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:31 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:36:31.758401 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335249b-569c-44cd-8cbe-c68f24573e9f None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:31.805278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fdaf0-9152-4ef5-85b7-92840993a4b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:31.806737 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fdaf0-9152-4ef5-85b7-92840993a4b4 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:31.869430 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335249b-569c-44cd-8cbe-c68f24573e9f None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:31.900624 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:31.906545 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc414b1-9396-4d02-a6e0-017115f4e50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:31.907217 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc414b1-9396-4d02-a6e0-017115f4e50d None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:31.907526 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc414b1-9396-4d02-a6e0-017115f4e50d None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:31.907906 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc414b1-9396-4d02-a6e0-017115f4e50d None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:31.908577 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc414b1-9396-4d02-a6e0-017115f4e50d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:31.908881 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc414b1-9396-4d02-a6e0-017115f4e50d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:31.910302 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc414b1-9396-4d02-a6e0-017115f4e50d None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:31.912035 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 366/746] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:36:31 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:36:31.917139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fdaf0-9152-4ef5-85b7-92840993a4b4 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:31.923535 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 381/747] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:36:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:31.928265 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc414b1-9396-4d02-a6e0-017115f4e50d None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:31.949935 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:32.023553 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fdaf0-9152-4ef5-85b7-92840993a4b4 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:32.033583 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc414b1-9396-4d02-a6e0-017115f4e50d None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:32.057169 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2aaa0-10e4-46ef-b367-3150966e1bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:32.058396 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2aaa0-10e4-46ef-b367-3150966e1bd9 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:32.058675 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2aaa0-10e4-46ef-b367-3150966e1bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:32.059047 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2aaa0-10e4-46ef-b367-3150966e1bd9 None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:32.059795 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2aaa0-10e4-46ef-b367-3150966e1bd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:32.060104 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2aaa0-10e4-46ef-b367-3150966e1bd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:32.061469 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2aaa0-10e4-46ef-b367-3150966e1bd9 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:32.068811 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb924a2a-2b22-4482-ac5f-a0244c63e4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:32.069466 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb924a2a-2b22-4482-ac5f-a0244c63e4d9 None admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:32.069756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb924a2a-2b22-4482-ac5f-a0244c63e4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:32.070035 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb924a2a-2b22-4482-ac5f-a0244c63e4d9 None admin] PATH_INFO: `/v3/services` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:32.070759 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb924a2a-2b22-4482-ac5f-a0244c63e4d9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:32.072153 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb924a2a-2b22-4482-ac5f-a0244c63e4d9 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:32.077934 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 367/748] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:32.077934 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2aaa0-10e4-46ef-b367-3150966e1bd9 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:32.135637 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 382/749] 10.222.0.39 () {60 vars in 1141 bytes} [Mon May 23 15:36:31 2022] POST /identity/v3/services => generated 240 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:36:32.135637 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb924a2a-2b22-4482-ac5f-a0244c63e4d9 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:32.179844 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:32.193208 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2aaa0-10e4-46ef-b367-3150966e1bd9 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:32.200819 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:32.244718 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da2471-55e4-4272-8ae5-629ab827c1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:32.246947 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da2471-55e4-4272-8ae5-629ab827c1ad None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:32.247418 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da2471-55e4-4272-8ae5-629ab827c1ad None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:32.247856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da2471-55e4-4272-8ae5-629ab827c1ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:32.260328 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb924a2a-2b22-4482-ac5f-a0244c63e4d9 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:32.261654 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da2471-55e4-4272-8ae5-629ab827c1ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:32.263303 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da2471-55e4-4272-8ae5-629ab827c1ad None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:32.283806 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-e8da2471-55e4-4272-8ae5-629ab827c1ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:32.283806 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:32.283806 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:32.283806 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:32.283806 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:32.283806 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:32.283806 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:32.283806 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:32.283806 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:32.283806 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:32.283806 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:32.283806 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:32.283806 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:32.283806 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:32.283806 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:32.284966 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:32.284966 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:32.284966 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:32.284966 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:32.284966 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:32.284966 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:32.284966 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:32.284966 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:32.284966 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:32.284966 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:32.284966 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:32.284966 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:32.284966 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:32.284966 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:32.284966 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:32.284966 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:32.284966 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:32.285893 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:32.285893 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:32.285893 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:32.285893 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:32.286596 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 368/750] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:32.287707 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da2471-55e4-4272-8ae5-629ab827c1ad None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:32.303343 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26417b5f-e00b-42f6-a0f9-3c9b0e285595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:32.304582 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26417b5f-e00b-42f6-a0f9-3c9b0e285595 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:32.305060 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26417b5f-e00b-42f6-a0f9-3c9b0e285595 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:32.305683 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26417b5f-e00b-42f6-a0f9-3c9b0e285595 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:32.319888 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26417b5f-e00b-42f6-a0f9-3c9b0e285595 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:32.321755 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26417b5f-e00b-42f6-a0f9-3c9b0e285595 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:32.342491 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-26417b5f-e00b-42f6-a0f9-3c9b0e285595 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:32.342491 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:32.342491 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:32.342491 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:32.342491 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:32.342491 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:32.342491 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:32.342491 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:32.342491 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:32.342491 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:32.342491 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:32.342491 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:32.342491 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:32.342491 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:32.342491 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:32.343459 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:32.343459 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:32.343459 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:32.343459 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:32.343459 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:32.343459 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:32.343459 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:32.343459 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:32.343459 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:32.343459 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:32.343459 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:32.343459 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:32.343459 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:32.343459 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:32.343459 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:32.343459 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:32.343459 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:32.344396 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:32.344396 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:32.344396 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:32.344396 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:32.346819 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 383/751] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:32.347954 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26417b5f-e00b-42f6-a0f9-3c9b0e285595 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:32.469202 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26417b5f-e00b-42f6-a0f9-3c9b0e285595 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:32.477218 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:32.507195 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092f01d-bca1-4c7e-99ad-11d43aa97fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:32.508188 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092f01d-bca1-4c7e-99ad-11d43aa97fe8 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:32.508635 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092f01d-bca1-4c7e-99ad-11d43aa97fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:32.509070 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092f01d-bca1-4c7e-99ad-11d43aa97fe8 None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:32.511115 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092f01d-bca1-4c7e-99ad-11d43aa97fe8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:32.511115 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092f01d-bca1-4c7e-99ad-11d43aa97fe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:32.513125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092f01d-bca1-4c7e-99ad-11d43aa97fe8 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:32.530271 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 384/752] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:32.531720 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092f01d-bca1-4c7e-99ad-11d43aa97fe8 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:32.540509 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da2471-55e4-4272-8ae5-629ab827c1ad None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:32.582737 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09202fb1-7d53-4b89-a52a-1a0af63f781d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:32.583580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09202fb1-7d53-4b89-a52a-1a0af63f781d None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:32.583893 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09202fb1-7d53-4b89-a52a-1a0af63f781d None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:32.584170 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09202fb1-7d53-4b89-a52a-1a0af63f781d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:32.587755 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:32.594971 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09202fb1-7d53-4b89-a52a-1a0af63f781d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:32.596896 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09202fb1-7d53-4b89-a52a-1a0af63f781d None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:32.614849 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-09202fb1-7d53-4b89-a52a-1a0af63f781d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:32.614849 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:32.614849 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:32.614849 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:32.614849 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:32.614849 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:32.614849 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:32.614849 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:32.614849 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:32.614849 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:32.614849 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:32.614849 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:32.614849 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:36:32.614849 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:36:32.614849 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:36:32.615870 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:36:32.615870 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:32.615870 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:32.615870 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:32.615870 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:32.615870 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:32.615870 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:32.615870 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:32.615870 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:32.615870 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:32.615870 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:32.615870 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:32.615870 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:32.615870 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:32.615870 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:32.615870 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:32.615870 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:32.616730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:36:32.616730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:36:32.616730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:36:32.616730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:36:32.616730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:36:32.616730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:36:32.616730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:32.616730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:32.616730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 369/753] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:36:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:32.617202 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09202fb1-7d53-4b89-a52a-1a0af63f781d None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:32.668751 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092f01d-bca1-4c7e-99ad-11d43aa97fe8 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:32.715810 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8de16-7cc6-43bb-bf36-aae066e88ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:32.717109 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8de16-7cc6-43bb-bf36-aae066e88ea7 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:32.718050 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8de16-7cc6-43bb-bf36-aae066e88ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:32.718649 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8de16-7cc6-43bb-bf36-aae066e88ea7 None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:32.719714 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8de16-7cc6-43bb-bf36-aae066e88ea7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:32.720411 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8de16-7cc6-43bb-bf36-aae066e88ea7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:32.722388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8de16-7cc6-43bb-bf36-aae066e88ea7 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:32.737503 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09202fb1-7d53-4b89-a52a-1a0af63f781d None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:32.738375 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 385/754] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:32.739399 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8de16-7cc6-43bb-bf36-aae066e88ea7 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:32.779320 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54d79c-bebb-4a3c-9f70-5dc2470fc4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:32.780301 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54d79c-bebb-4a3c-9f70-5dc2470fc4f7 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:32.780685 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54d79c-bebb-4a3c-9f70-5dc2470fc4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:32.781060 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54d79c-bebb-4a3c-9f70-5dc2470fc4f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:32.783994 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:32.788574 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54d79c-bebb-4a3c-9f70-5dc2470fc4f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:32.790260 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54d79c-bebb-4a3c-9f70-5dc2470fc4f7 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:32.805455 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-cb54d79c-bebb-4a3c-9f70-5dc2470fc4f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:32.805455 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:32.805455 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:32.805455 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:32.805455 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:32.805455 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:32.805455 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:32.805455 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:32.805455 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:32.805455 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:32.805455 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:32.805455 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:32.805455 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:36:32.805455 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:36:32.805455 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:36:32.806437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:36:32.806437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:32.806437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:32.806437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:32.806437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:32.806437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:32.806437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:32.806437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:32.806437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:32.806437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:32.806437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:32.806437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:32.806437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:32.806437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:32.806437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:32.806437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:32.806437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:32.807380 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:36:32.807380 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:36:32.807380 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:36:32.807380 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:36:32.807380 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:36:32.807380 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:36:32.807380 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:32.807380 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:32.815011 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 370/755] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:36:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:32.816168 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54d79c-bebb-4a3c-9f70-5dc2470fc4f7 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:32.858448 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8de16-7cc6-43bb-bf36-aae066e88ea7 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:32.891081 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:32.894707 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a3299-94b4-4bec-830c-1a95a5dbebab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:32.895630 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a3299-94b4-4bec-830c-1a95a5dbebab None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:32.896123 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a3299-94b4-4bec-830c-1a95a5dbebab None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:32.896632 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a3299-94b4-4bec-830c-1a95a5dbebab None admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:32.897716 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a3299-94b4-4bec-830c-1a95a5dbebab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:32.898196 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a3299-94b4-4bec-830c-1a95a5dbebab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:32.899835 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a3299-94b4-4bec-830c-1a95a5dbebab None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:32.918855 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 386/756] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:36:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:32.920113 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a3299-94b4-4bec-830c-1a95a5dbebab None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:32.942982 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54d79c-bebb-4a3c-9f70-5dc2470fc4f7 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:32.979342 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7217ffd-2036-4c32-8169-6bb49f61a0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:32.981273 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7217ffd-2036-4c32-8169-6bb49f61a0f5 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:32.981821 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7217ffd-2036-4c32-8169-6bb49f61a0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:32.982309 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7217ffd-2036-4c32-8169-6bb49f61a0f5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:32.990734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7217ffd-2036-4c32-8169-6bb49f61a0f5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:32.992503 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7217ffd-2036-4c32-8169-6bb49f61a0f5 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:33.009324 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-f7217ffd-2036-4c32-8169-6bb49f61a0f5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 15:36:33.009324 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:33.009324 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:33.009324 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:33.009324 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:33.009324 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:33.009324 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:33.009324 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:33.009324 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:33.009324 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:33.009324 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:33.009324 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:33.009324 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:36:33.009324 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:36:33.009324 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:36:33.009324 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:36:33.010348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:33.010348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:33.010348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:36:33.010348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:33.010348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:36:33.010348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:33.010348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:33.010348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:33.010348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:33.010348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:33.010348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:33.010348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:33.010348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:33.010348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:33.010348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:33.010348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:33.010348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:33.010348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:33.011310 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:33.011310 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:33.011310 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:36:33.011310 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:36:33.011310 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:36:33.011310 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:36:33.011310 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:36:33.011310 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:36:33.011310 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 15:36:33.011310 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:33.018395 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 371/757] 10.222.0.39 () {56 vars in 1093 bytes} [Mon May 23 15:36:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:33.019579 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7217ffd-2036-4c32-8169-6bb49f61a0f5 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:33.041145 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a3299-94b4-4bec-830c-1a95a5dbebab None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:33.046198 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:33.090257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f0c40-9c33-4b90-a49c-0ff9f0d217ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:33.090989 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f0c40-9c33-4b90-a49c-0ff9f0d217ec None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:33.091277 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f0c40-9c33-4b90-a49c-0ff9f0d217ec None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:33.091554 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f0c40-9c33-4b90-a49c-0ff9f0d217ec None admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:33.093038 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f0c40-9c33-4b90-a49c-0ff9f0d217ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:33.093370 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f0c40-9c33-4b90-a49c-0ff9f0d217ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:33.095093 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f0c40-9c33-4b90-a49c-0ff9f0d217ec None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:33.116257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 387/758] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:36:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:33.116257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f0c40-9c33-4b90-a49c-0ff9f0d217ec None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:33.134987 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7217ffd-2036-4c32-8169-6bb49f61a0f5 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:33.152636 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:33.171832 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286ead7-a2bc-4513-86f4-2456fee67b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:33.172488 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286ead7-a2bc-4513-86f4-2456fee67b03 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:33.172771 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286ead7-a2bc-4513-86f4-2456fee67b03 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:33.173043 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286ead7-a2bc-4513-86f4-2456fee67b03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:33.173880 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286ead7-a2bc-4513-86f4-2456fee67b03 None admin] RBAC: Adding query filter params (role.id=3ab888f5f68740bd8f9df4447f4f5a7a, scope.project.id=8addb03b903842609168ee2fafc8ec6b, user.id=b275a110936a44ce8d54793af1a34808) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:33.174174 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286ead7-a2bc-4513-86f4-2456fee67b03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:33.175799 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286ead7-a2bc-4513-86f4-2456fee67b03 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:33.188841 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 372/759] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:36:33 2022] GET /identity/v3/role_assignments?user.id=b275a110936a44ce8d54793af1a34808&scope.project.id=8addb03b903842609168ee2fafc8ec6b&role.id=3ab888f5f68740bd8f9df4447f4f5a7a => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:33.188841 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286ead7-a2bc-4513-86f4-2456fee67b03 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:33.300447 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f0c40-9c33-4b90-a49c-0ff9f0d217ec None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:33.371838 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286ead7-a2bc-4513-86f4-2456fee67b03 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:33.383992 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5949c-5146-485a-85fd-2a98ebba050c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:33.384686 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5949c-5146-485a-85fd-2a98ebba050c None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:33.384968 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5949c-5146-485a-85fd-2a98ebba050c None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:33.385243 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5949c-5146-485a-85fd-2a98ebba050c None admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:33.386414 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5949c-5146-485a-85fd-2a98ebba050c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:33.386726 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5949c-5146-485a-85fd-2a98ebba050c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:33.388258 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5949c-5146-485a-85fd-2a98ebba050c None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:33.428003 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 388/760] 10.222.0.39 () {56 vars in 1133 bytes} [Mon May 23 15:36:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:33.432180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5949c-5146-485a-85fd-2a98ebba050c None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:33.436348 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:33.443347 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db3a2b-1f5e-4699-867b-84122fd882ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:33.444291 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db3a2b-1f5e-4699-867b-84122fd882ec None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:33.444741 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db3a2b-1f5e-4699-867b-84122fd882ec None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:33.445181 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db3a2b-1f5e-4699-867b-84122fd882ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:33.446180 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db3a2b-1f5e-4699-867b-84122fd882ec None admin] RBAC: Adding query filter params (role.id=b57c4ebab8e842088df37b551053b113, scope.project.id=8addb03b903842609168ee2fafc8ec6b, user.id=048fc48dd55a43f7b342533a9484c3ad) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:33.450511 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db3a2b-1f5e-4699-867b-84122fd882ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:33.450511 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db3a2b-1f5e-4699-867b-84122fd882ec None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:33.457515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 373/761] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:36:33 2022] GET /identity/v3/role_assignments?user.id=048fc48dd55a43f7b342533a9484c3ad&scope.project.id=8addb03b903842609168ee2fafc8ec6b&role.id=b57c4ebab8e842088df37b551053b113 => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:33.510335 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e1b6d-fce7-4bd7-b72f-ad9f76d4293d None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:33.510930 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e1b6d-fce7-4bd7-b72f-ad9f76d4293d None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:33.511215 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e1b6d-fce7-4bd7-b72f-ad9f76d4293d None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:33.512915 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 374/762] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:36:33.519784 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af842c3-d7db-4848-a6a3-9db551a77237 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:33.520263 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af842c3-d7db-4848-a6a3-9db551a77237 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:33.520547 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af842c3-d7db-4848-a6a3-9db551a77237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:33.543647 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-8af842c3-d7db-4848-a6a3-9db551a77237 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:33.546360 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-8af842c3-d7db-4848-a6a3-9db551a77237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:33.573835 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5949c-5146-485a-85fd-2a98ebba050c None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:33.599479 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:33.640359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 375/763] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:36:33.657859 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff42379-8e21-4095-a328-fdb36fc31727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:33.658673 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff42379-8e21-4095-a328-fdb36fc31727 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:33.658954 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff42379-8e21-4095-a328-fdb36fc31727 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:33.659228 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff42379-8e21-4095-a328-fdb36fc31727 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:33.662726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af842c3-d7db-4848-a6a3-9db551a77237 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:33.678358 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff42379-8e21-4095-a328-fdb36fc31727 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:33.679927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff42379-8e21-4095-a328-fdb36fc31727 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:33.702515 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-fff42379-8e21-4095-a328-fdb36fc31727 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:33.702515 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:33.702515 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:33.702515 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:33.702515 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:33.702515 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:33.702515 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:33.702515 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:33.702515 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:33.702515 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:33.702515 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:33.702515 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:33.702515 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:33.702515 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:33.702515 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:33.703434 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:33.703434 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:33.703434 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:33.703434 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:33.703434 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:33.703434 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:33.703434 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:33.703434 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:33.703434 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:33.703434 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:33.703434 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:33.703434 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:33.703434 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:33.703434 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:33.703434 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:33.703434 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:33.703434 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:33.704602 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:33.704602 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:33.704602 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:33.704602 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:33.704602 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 389/764] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:33.710878 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff42379-8e21-4095-a328-fdb36fc31727 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:33.778974 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:33.783973 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af842c3-d7db-4848-a6a3-9db551a77237 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:33.827557 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff42379-8e21-4095-a328-fdb36fc31727 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:33.835081 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a38944-61b9-4b92-904e-9fde6bd319b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:33.835927 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a38944-61b9-4b92-904e-9fde6bd319b1 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:33.836207 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a38944-61b9-4b92-904e-9fde6bd319b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:33.836479 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a38944-61b9-4b92-904e-9fde6bd319b1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:33.837143 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a38944-61b9-4b92-904e-9fde6bd319b1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:33.838516 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a38944-61b9-4b92-904e-9fde6bd319b1 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:33.860296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-41a38944-61b9-4b92-904e-9fde6bd319b1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 15:36:33.860296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:33.860296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:36:33.860296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:36:33.860296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:36:33.860296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:36:33.860296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:36:33.860296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:36:33.860296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 15:36:33.860296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:33.860296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:36:33.860296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:33.860296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:33.860296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:33.860296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:33.860296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:33.862216 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:33.862216 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:33.862216 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:33.862216 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:33.862216 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:33.862216 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:33.862216 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:33.862216 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:36:33.862216 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:36:33.862216 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:36:33.862216 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:36:33.862216 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:33.862216 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:33.862216 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:33.862216 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:33.862216 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:33.863425 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:33.863425 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:33.863425 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:33.863425 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:33.863425 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:33.863425 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:33.863425 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:33.863425 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:33.863425 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:33.863425 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:33.863425 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:33.863425 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:36:33.863425 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:36:33.863425 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 15:36:33.863425 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:33.863425 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 376/765] 10.222.0.39 () {56 vars in 1129 bytes} [Mon May 23 15:36:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:36:33.869398 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b6d20-d9f3-4e22-bf0a-2a832e3376e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:33.870813 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b6d20-d9f3-4e22-bf0a-2a832e3376e1 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:33.871032 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a38944-61b9-4b92-904e-9fde6bd319b1 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:33.871282 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b6d20-d9f3-4e22-bf0a-2a832e3376e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:33.871694 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b6d20-d9f3-4e22-bf0a-2a832e3376e1 None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:33.872494 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b6d20-d9f3-4e22-bf0a-2a832e3376e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:33.872868 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b6d20-d9f3-4e22-bf0a-2a832e3376e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:33.874419 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b6d20-d9f3-4e22-bf0a-2a832e3376e1 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:33.891705 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 390/766] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:33.892954 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b6d20-d9f3-4e22-bf0a-2a832e3376e1 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:33.944136 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:34.002923 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b6d20-d9f3-4e22-bf0a-2a832e3376e1 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:34.030253 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:34.064995 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a38944-61b9-4b92-904e-9fde6bd319b1 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:34.070436 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada01cc3-7420-4183-8c13-28fe2b79aa78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:34.071235 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada01cc3-7420-4183-8c13-28fe2b79aa78 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:34.071516 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada01cc3-7420-4183-8c13-28fe2b79aa78 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:34.071826 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada01cc3-7420-4183-8c13-28fe2b79aa78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:34.085539 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada01cc3-7420-4183-8c13-28fe2b79aa78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:34.086973 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada01cc3-7420-4183-8c13-28fe2b79aa78 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:34.102963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-ada01cc3-7420-4183-8c13-28fe2b79aa78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:34.102963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:34.102963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:34.102963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:34.102963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:34.102963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:34.102963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:34.102963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:34.102963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:34.102963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:34.102963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:34.102963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:34.102963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:36:34.102963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:36:34.102963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:36:34.105471 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:36:34.105471 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:34.105471 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:34.105471 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:34.105471 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:34.105471 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:34.105471 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:34.105471 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:34.105471 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:34.105471 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:34.105471 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:34.105471 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:34.105471 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:34.105471 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:34.105471 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:34.105471 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:34.105471 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:34.107532 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:36:34.107532 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:36:34.107532 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:36:34.107532 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:36:34.107532 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:36:34.107532 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:36:34.107532 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:34.107532 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:34.107532 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 391/767] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:36:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:34.110318 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada01cc3-7420-4183-8c13-28fe2b79aa78 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:34.143811 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e58c01-d030-4b1d-9a54-4edde5711aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:34.144496 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e58c01-d030-4b1d-9a54-4edde5711aac None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:34.144782 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e58c01-d030-4b1d-9a54-4edde5711aac None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:34.145059 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e58c01-d030-4b1d-9a54-4edde5711aac None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:34.145779 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e58c01-d030-4b1d-9a54-4edde5711aac None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:34.146192 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e58c01-d030-4b1d-9a54-4edde5711aac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:34.152118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e58c01-d030-4b1d-9a54-4edde5711aac None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:34.161892 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 377/768] 10.222.0.39 () {56 vars in 1124 bytes} [Mon May 23 15:36:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:34.169033 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e58c01-d030-4b1d-9a54-4edde5711aac None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:34.218554 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada01cc3-7420-4183-8c13-28fe2b79aa78 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:34.255704 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76159b5e-02f4-4b03-9436-7211676e6dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:34.256394 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76159b5e-02f4-4b03-9436-7211676e6dc2 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:34.256761 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76159b5e-02f4-4b03-9436-7211676e6dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:34.257039 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76159b5e-02f4-4b03-9436-7211676e6dc2 None admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:34.257892 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76159b5e-02f4-4b03-9436-7211676e6dc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:34.258203 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76159b5e-02f4-4b03-9436-7211676e6dc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:34.259821 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76159b5e-02f4-4b03-9436-7211676e6dc2 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:34.273059 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 392/769] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:36:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:34.279390 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76159b5e-02f4-4b03-9436-7211676e6dc2 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:34.317174 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:34.345910 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e58c01-d030-4b1d-9a54-4edde5711aac None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:34.348243 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:34.388508 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76159b5e-02f4-4b03-9436-7211676e6dc2 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:34.416248 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b7464-ea9b-4b34-93a3-ec66874f4d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:34.418011 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b7464-ea9b-4b34-93a3-ec66874f4d2a None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:34.418532 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b7464-ea9b-4b34-93a3-ec66874f4d2a None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:34.419008 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b7464-ea9b-4b34-93a3-ec66874f4d2a None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:34.420088 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b7464-ea9b-4b34-93a3-ec66874f4d2a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:34.420686 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b7464-ea9b-4b34-93a3-ec66874f4d2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:34.422360 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b7464-ea9b-4b34-93a3-ec66874f4d2a None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:34.431638 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00850cf4-e11a-48b4-a4eb-63da4890b2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:34.431638 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00850cf4-e11a-48b4-a4eb-63da4890b2d4 None admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:34.431638 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00850cf4-e11a-48b4-a4eb-63da4890b2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:34.431638 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00850cf4-e11a-48b4-a4eb-63da4890b2d4 None admin] PATH_INFO: `/v3/projects/8addb03b903842609168ee2fafc8ec6b/users/76f7895b7b5748e7b4461f7fde1d558a/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:34.432068 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00850cf4-e11a-48b4-a4eb-63da4890b2d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=8addb03b903842609168ee2fafc8ec6b, user_id=76f7895b7b5748e7b4461f7fde1d558a, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:34.432068 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00850cf4-e11a-48b4-a4eb-63da4890b2d4 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:34.437482 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 378/770] 10.222.0.39 () {56 vars in 1124 bytes} [Mon May 23 15:36:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:36:34.443510 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b7464-ea9b-4b34-93a3-ec66874f4d2a None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:34.517591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 393/771] 10.222.0.39 () {58 vars in 1439 bytes} [Mon May 23 15:36:34 2022] PUT /identity/v3/projects/8addb03b903842609168ee2fafc8ec6b/users/76f7895b7b5748e7b4461f7fde1d558a/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:36:34.555055 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b7464-ea9b-4b34-93a3-ec66874f4d2a None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:34.593352 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e58315-521e-47d9-aaac-ffe437a493f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:34.594042 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e58315-521e-47d9-aaac-ffe437a493f4 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:34.594332 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e58315-521e-47d9-aaac-ffe437a493f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:34.594609 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e58315-521e-47d9-aaac-ffe437a493f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:34.595501 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e58315-521e-47d9-aaac-ffe437a493f4 None admin] RBAC: Adding query filter params (interface=public, service_id=0c538739cfa54f21963db0f087eeb367, region_id=RegionOne) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:34.595974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e58315-521e-47d9-aaac-ffe437a493f4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:34.597331 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e58315-521e-47d9-aaac-ffe437a493f4 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:34.606635 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 379/772] 10.222.0.39 () {56 vars in 1251 bytes} [Mon May 23 15:36:34 2022] GET /identity/v3/endpoints?service_id=0c538739cfa54f21963db0f087eeb367&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:34.611985 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00850cf4-e11a-48b4-a4eb-63da4890b2d4 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:34.622979 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08ce47-a05f-4ee0-b1cd-c3ad10f7f279 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:34.623306 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08ce47-a05f-4ee0-b1cd-c3ad10f7f279 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:34.623542 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08ce47-a05f-4ee0-b1cd-c3ad10f7f279 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:34.626624 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 380/773] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:36:34.631300 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6cfd7-0bf6-4ed6-b0b4-e1b2411e4055 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:34.631658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6cfd7-0bf6-4ed6-b0b4-e1b2411e4055 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:34.631914 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6cfd7-0bf6-4ed6-b0b4-e1b2411e4055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:34.654547 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-aed6cfd7-0bf6-4ed6-b0b4-e1b2411e4055 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:34.657293 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-aed6cfd7-0bf6-4ed6-b0b4-e1b2411e4055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:34.708014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:34.783956 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 381/774] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:36:34.791589 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:34.802561 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00850cf4-e11a-48b4-a4eb-63da4890b2d4 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:34.821492 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed6cfd7-0bf6-4ed6-b0b4-e1b2411e4055 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:34.842271 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1acfc0c-b55f-41c7-b0dd-889fb84f5b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:34.843704 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acfc0c-b55f-41c7-b0dd-889fb84f5b71 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:34.844219 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acfc0c-b55f-41c7-b0dd-889fb84f5b71 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:34.844509 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acfc0c-b55f-41c7-b0dd-889fb84f5b71 None admin] PATH_INFO: `/v3/services` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:34.845206 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1acfc0c-b55f-41c7-b0dd-889fb84f5b71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:34.847183 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1acfc0c-b55f-41c7-b0dd-889fb84f5b71 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:34.855803 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 394/775] 10.222.0.39 () {56 vars in 1087 bytes} [Mon May 23 15:36:34 2022] GET /identity/v3/services => generated 772 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:34.955025 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed6cfd7-0bf6-4ed6-b0b4-e1b2411e4055 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:35.002849 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0767c4-f474-4548-a6fe-6e9379f79195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:35.003667 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0767c4-f474-4548-a6fe-6e9379f79195 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:35.003951 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0767c4-f474-4548-a6fe-6e9379f79195 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:35.004224 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0767c4-f474-4548-a6fe-6e9379f79195 None admin] PATH_INFO: `/v3/services/network` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:35.004887 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0767c4-f474-4548-a6fe-6e9379f79195 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:35.006255 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0767c4-f474-4548-a6fe-6e9379f79195 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:35.024015 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-0a0767c4-f474-4548-a6fe-6e9379f79195 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 23 15:36:35.024015 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:35.024015 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:36:35.024015 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:36:35.024015 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:36:35.024015 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:36:35.024015 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:36:35.024015 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:36:35.024015 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 15:36:35.024015 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:35.024015 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:36:35.024015 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:35.024015 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:35.024015 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:35.024015 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:35.024015 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:35.024015 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:35.025073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:35.025073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:35.025073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:35.025073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:35.025073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:35.025073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:35.025073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:36:35.025073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:36:35.025073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:36:35.025073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:36:35.025073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:35.025073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:35.025073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:35.025073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:35.025073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:35.025073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:35.025929 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:35.025929 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:35.025929 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:35.025929 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:35.025929 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:35.025929 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:35.025929 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:35.025929 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:35.025929 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:35.025929 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:35.025929 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:36:35.025929 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:36:35.025929 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 15:36:35.025929 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:35.025929 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 382/776] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:36:34 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:36:35.034005 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1acfc0c-b55f-41c7-b0dd-889fb84f5b71 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:35.172430 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1acfc0c-b55f-41c7-b0dd-889fb84f5b71 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:35.209860 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896078f-7c7e-4129-977d-9bc39afabe83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:35.210527 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896078f-7c7e-4129-977d-9bc39afabe83 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:35.210811 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896078f-7c7e-4129-977d-9bc39afabe83 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:35.211083 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896078f-7c7e-4129-977d-9bc39afabe83 None admin] PATH_INFO: `/v3/services` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:35.211817 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3896078f-7c7e-4129-977d-9bc39afabe83 None admin] RBAC: Adding query filter params (name=network) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:35.212124 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3896078f-7c7e-4129-977d-9bc39afabe83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:35.213501 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3896078f-7c7e-4129-977d-9bc39afabe83 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:35.218675 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 395/777] 10.222.0.39 () {56 vars in 1112 bytes} [Mon May 23 15:36:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:35.224124 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0767c4-f474-4548-a6fe-6e9379f79195 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:35.287971 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:35.367551 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0767c4-f474-4548-a6fe-6e9379f79195 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:35.410597 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774eb314-f889-4a6c-9b4d-55dfd5fd42b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:35.411263 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774eb314-f889-4a6c-9b4d-55dfd5fd42b5 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:35.411544 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774eb314-f889-4a6c-9b4d-55dfd5fd42b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:35.411836 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774eb314-f889-4a6c-9b4d-55dfd5fd42b5 None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:35.412545 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774eb314-f889-4a6c-9b4d-55dfd5fd42b5 None admin] RBAC: Adding query filter params (type=network) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:35.412849 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774eb314-f889-4a6c-9b4d-55dfd5fd42b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:35.414217 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774eb314-f889-4a6c-9b4d-55dfd5fd42b5 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:35.423774 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 383/778] 10.222.0.39 () {56 vars in 1112 bytes} [Mon May 23 15:36:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:35.425503 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896078f-7c7e-4129-977d-9bc39afabe83 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:35.482450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:35.577779 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896078f-7c7e-4129-977d-9bc39afabe83 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:35.630179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b709f-a770-48a9-a837-d4cede16683c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:35.631809 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b709f-a770-48a9-a837-d4cede16683c None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:35.632317 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b709f-a770-48a9-a837-d4cede16683c None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:35.632798 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b709f-a770-48a9-a837-d4cede16683c None admin] PATH_INFO: `/v3/endpoints` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:35.633896 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b709f-a770-48a9-a837-d4cede16683c None admin] RBAC: Adding query filter params (interface=public, service_id=9846de0f520d4dfaa5882e37b60a65fe, region_id=RegionOne) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:35.634414 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b709f-a770-48a9-a837-d4cede16683c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:35.636128 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b709f-a770-48a9-a837-d4cede16683c None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:35.649966 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 396/779] 10.222.0.39 () {56 vars in 1251 bytes} [Mon May 23 15:36:35 2022] GET /identity/v3/endpoints?service_id=9846de0f520d4dfaa5882e37b60a65fe&interface=public®ion_id=RegionOne => generated 194 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:35.656262 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774eb314-f889-4a6c-9b4d-55dfd5fd42b5 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:35.780070 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:35.791731 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774eb314-f889-4a6c-9b4d-55dfd5fd42b5 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:35.826775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eaca3a-ec89-4291-809d-46dd61e7209d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:35.827433 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaca3a-ec89-4291-809d-46dd61e7209d None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:35.827749 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaca3a-ec89-4291-809d-46dd61e7209d None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:35.828028 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaca3a-ec89-4291-809d-46dd61e7209d None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:35.828706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eaca3a-ec89-4291-809d-46dd61e7209d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:35.830076 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eaca3a-ec89-4291-809d-46dd61e7209d None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:35.835556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 384/780] 10.222.0.39 () {56 vars in 1087 bytes} [Mon May 23 15:36:35 2022] GET /identity/v3/services => generated 772 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:36.087268 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379f276-b0bb-4c3a-b3a7-10421b673e3f None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:36.087701 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379f276-b0bb-4c3a-b3a7-10421b673e3f None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:36.087989 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379f276-b0bb-4c3a-b3a7-10421b673e3f None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:36.089848 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 397/781] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:36.095693 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca8253-c090-4ae2-8793-f12a0c3c251d None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:36.095994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca8253-c090-4ae2-8793-f12a0c3c251d None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:36.096278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca8253-c090-4ae2-8793-f12a0c3c251d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:36.117969 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-50ca8253-c090-4ae2-8793-f12a0c3c251d None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:36.119047 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-50ca8253-c090-4ae2-8793-f12a0c3c251d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:36.202342 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 385/782] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:36:36.225845 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379f276-b0bb-4c3a-b3a7-10421b673e3f None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:36.332703 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:36.354846 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379f276-b0bb-4c3a-b3a7-10421b673e3f None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:36.388172 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ddff2-f111-48ee-a21e-24a6f8e4496a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:36.388966 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ddff2-f111-48ee-a21e-24a6f8e4496a None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:36.389429 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ddff2-f111-48ee-a21e-24a6f8e4496a None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:36.389888 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ddff2-f111-48ee-a21e-24a6f8e4496a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:36.400959 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ddff2-f111-48ee-a21e-24a6f8e4496a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:36:36.409441 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-077ddff2-f111-48ee-a21e-24a6f8e4496a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:36:36.409441 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:36.409441 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:36.409441 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:36.409441 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:36.409441 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:36.409441 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:36.409441 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:36.409441 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:36.409441 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:36.409441 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:36.409441 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:36.409441 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:36:36.409441 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:36:36.409441 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:36:36.409441 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:36:36.410625 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:36:36.410625 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:36:36.410625 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:36:36.410625 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:36:36.410625 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:36.410625 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:36.410625 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:36.410625 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:36.410625 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:36.410625 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:36.410625 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:36.410625 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:36.410625 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:36.410625 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:36.410625 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:36.410625 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:36.411734 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:36.411734 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:36.411734 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:36.411734 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:36.411734 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:36:36.411734 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:36:36.411734 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:36:36.411734 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:36:36.411734 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:36:36.411734 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:36:36.411734 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:36:36.411734 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:36.414188 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 398/783] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:36:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:36.419812 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca8253-c090-4ae2-8793-f12a0c3c251d None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:36.430892 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0f10c-e61f-489a-9c2f-363069d30f68 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:36.431387 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0f10c-e61f-489a-9c2f-363069d30f68 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:36.431879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0f10c-e61f-489a-9c2f-363069d30f68 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:36.434331 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 399/784] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:36.440901 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf6081-c48b-4c44-83fa-c6d4012e6ea8 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:36.441464 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf6081-c48b-4c44-83fa-c6d4012e6ea8 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:36.442009 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf6081-c48b-4c44-83fa-c6d4012e6ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:36.477360 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-60cf6081-c48b-4c44-83fa-c6d4012e6ea8 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:36.480239 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-60cf6081-c48b-4c44-83fa-c6d4012e6ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:36.567467 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 400/785] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:36:36.602658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:36.606554 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf6081-c48b-4c44-83fa-c6d4012e6ea8 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:36.624424 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca8253-c090-4ae2-8793-f12a0c3c251d None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:36.681153 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3f3e2-64ae-4bad-94c5-a8c188072dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:36.683211 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3f3e2-64ae-4bad-94c5-a8c188072dcf None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:36.683795 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3f3e2-64ae-4bad-94c5-a8c188072dcf None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:36.684274 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3f3e2-64ae-4bad-94c5-a8c188072dcf None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:36.685343 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f3f3e2-64ae-4bad-94c5-a8c188072dcf None admin] RBAC: Adding query filter params (name=admin) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:36.685957 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f3f3e2-64ae-4bad-94c5-a8c188072dcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:36.687530 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f3f3e2-64ae-4bad-94c5-a8c188072dcf None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:36.696636 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:36.707249 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 386/786] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:36:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:36.712461 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3f3e2-64ae-4bad-94c5-a8c188072dcf None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:36.720882 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf6081-c48b-4c44-83fa-c6d4012e6ea8 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:36.758238 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb678861-b577-4c2b-9d9c-7ee555a118b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:36.759036 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb678861-b577-4c2b-9d9c-7ee555a118b6 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:36.759319 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb678861-b577-4c2b-9d9c-7ee555a118b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:36.759619 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb678861-b577-4c2b-9d9c-7ee555a118b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:36.772269 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb678861-b577-4c2b-9d9c-7ee555a118b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:36:36.781605 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-bb678861-b577-4c2b-9d9c-7ee555a118b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:36.781605 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:36.781605 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:36.781605 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:36.781605 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:36.781605 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:36.781605 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:36.781605 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:36.781605 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:36.781605 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:36.781605 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:36.781605 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:36.781605 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:36:36.781605 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:36:36.781605 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:36:36.781605 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:36:36.782544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:36:36.782544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:36:36.782544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:36:36.782544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:36:36.782544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:36.782544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:36.782544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:36.782544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:36.782544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:36.782544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:36.782544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:36.782544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:36.782544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:36.782544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:36.782544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:36.782544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:36.783514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:36.783514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:36.783514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:36.783514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:36.783514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:36:36.783514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:36:36.783514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:36:36.783514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:36:36.783514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:36:36.783514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:36:36.783514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:36.783514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:36.783514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 401/787] 10.222.0.39 () {56 vars in 1102 bytes} [Mon May 23 15:36:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:36:36.790385 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb678861-b577-4c2b-9d9c-7ee555a118b6 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:36.898756 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3f3e2-64ae-4bad-94c5-a8c188072dcf None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:36.934990 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd859bb8-8c94-4cf1-993f-8fb67d8c8808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:36.935841 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd859bb8-8c94-4cf1-993f-8fb67d8c8808 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:36.936129 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd859bb8-8c94-4cf1-993f-8fb67d8c8808 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:36.936410 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd859bb8-8c94-4cf1-993f-8fb67d8c8808 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:36.957335 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd859bb8-8c94-4cf1-993f-8fb67d8c8808 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:36.958809 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd859bb8-8c94-4cf1-993f-8fb67d8c8808 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:36.991259 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb678861-b577-4c2b-9d9c-7ee555a118b6 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:36.996140 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:37.002594 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-dd859bb8-8c94-4cf1-993f-8fb67d8c8808 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:37.002594 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:37.002594 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:37.002594 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:37.002594 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:37.002594 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:37.002594 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:37.002594 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:37.002594 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:37.002594 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:37.002594 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:37.002594 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:37.002594 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:37.002594 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:37.002594 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:37.003690 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:37.003690 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:37.003690 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:37.003690 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:37.003690 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:37.003690 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:37.003690 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:37.003690 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:37.003690 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:37.003690 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:37.003690 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:37.003690 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:37.003690 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:37.003690 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:37.003690 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:37.003690 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:37.003690 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:37.004678 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:37.004678 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:37.004678 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:37.004678 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:37.004678 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 387/788] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:37.016626 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd859bb8-8c94-4cf1-993f-8fb67d8c8808 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:37.041938 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d1181-656a-452f-932e-d20c76f9e195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:37.042622 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d1181-656a-452f-932e-d20c76f9e195 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:37.042905 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d1181-656a-452f-932e-d20c76f9e195 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:37.043181 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d1181-656a-452f-932e-d20c76f9e195 None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:37.043967 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d1181-656a-452f-932e-d20c76f9e195 None admin] RBAC: Adding query filter params (name=service) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:37.044284 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d1181-656a-452f-932e-d20c76f9e195 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:37.045850 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d1181-656a-452f-932e-d20c76f9e195 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:37.048377 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:37.056398 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 402/789] 10.222.0.39 () {56 vars in 1103 bytes} [Mon May 23 15:36:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:37.063113 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d1181-656a-452f-932e-d20c76f9e195 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:37.133135 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd859bb8-8c94-4cf1-993f-8fb67d8c8808 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:37.168606 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91572137-307b-416b-bc89-8ea61a4c37b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:37.169200 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91572137-307b-416b-bc89-8ea61a4c37b1 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:37.169487 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91572137-307b-416b-bc89-8ea61a4c37b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:37.169767 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91572137-307b-416b-bc89-8ea61a4c37b1 None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:37.170501 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91572137-307b-416b-bc89-8ea61a4c37b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:37.170812 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91572137-307b-416b-bc89-8ea61a4c37b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:37.172224 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91572137-307b-416b-bc89-8ea61a4c37b1 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:37.185718 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 388/790] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:37.203534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91572137-307b-416b-bc89-8ea61a4c37b1 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:37.278296 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d1181-656a-452f-932e-d20c76f9e195 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:37.331727 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:37.337282 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5772d-ed63-4ec1-a0ef-ab5e8fb91edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:37.338086 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5772d-ed63-4ec1-a0ef-ab5e8fb91edf None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:37.338460 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5772d-ed63-4ec1-a0ef-ab5e8fb91edf None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:37.338690 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5772d-ed63-4ec1-a0ef-ab5e8fb91edf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:37.356222 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5772d-ed63-4ec1-a0ef-ab5e8fb91edf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:37.360677 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5772d-ed63-4ec1-a0ef-ab5e8fb91edf None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:37.384832 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-9ee5772d-ed63-4ec1-a0ef-ab5e8fb91edf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:37.384832 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:37.384832 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:37.384832 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:37.384832 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:37.384832 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:37.384832 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:37.384832 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:37.384832 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:37.384832 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:37.384832 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:37.384832 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:37.384832 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:37.384832 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:37.384832 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:37.386391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:37.386391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:37.386391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:37.386391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:37.386391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:37.386391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:37.386391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:37.386391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:37.386391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:37.386391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:37.386391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:37.386391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:37.386391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:37.386391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:37.386391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:37.386391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:37.386391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:37.387384 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:37.387384 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:37.387384 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:37.387384 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:37.387384 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 403/791] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:36:37.393181 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5772d-ed63-4ec1-a0ef-ab5e8fb91edf None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:37.435379 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91572137-307b-416b-bc89-8ea61a4c37b1 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:37.456866 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:37.475378 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878ff91-4d06-44ee-b3c7-fb627a46a4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:37.476229 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878ff91-4d06-44ee-b3c7-fb627a46a4a1 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:37.476508 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878ff91-4d06-44ee-b3c7-fb627a46a4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:37.476779 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878ff91-4d06-44ee-b3c7-fb627a46a4a1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:37.490233 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878ff91-4d06-44ee-b3c7-fb627a46a4a1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:37.493288 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878ff91-4d06-44ee-b3c7-fb627a46a4a1 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:37.517001 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-8878ff91-4d06-44ee-b3c7-fb627a46a4a1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 15:36:37.517001 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:37.517001 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:37.517001 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:37.517001 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:37.517001 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:37.517001 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:37.517001 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:37.517001 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:37.517001 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:37.517001 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:37.517001 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:37.517001 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:36:37.517001 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:36:37.517001 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:36:37.517001 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:36:37.518020 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:37.518020 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:37.518020 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:36:37.518020 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:37.518020 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:36:37.518020 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:37.518020 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:37.518020 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:37.518020 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:37.518020 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:37.518020 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:37.518020 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:37.518020 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:37.518020 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:37.518020 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:37.518020 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:37.518020 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:37.518020 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:37.518956 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:37.518956 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:37.518956 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:36:37.518956 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:36:37.518956 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:36:37.518956 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:36:37.518956 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:36:37.518956 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:36:37.518956 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 15:36:37.518956 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:37.521108 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 389/792] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:36:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:37.526856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b8094-0b09-46b5-82f0-1bcf13f0681e None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:37.526856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b8094-0b09-46b5-82f0-1bcf13f0681e None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:37.526856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b8094-0b09-46b5-82f0-1bcf13f0681e None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:37.530427 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 390/793] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:37.532145 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b8094-0b09-46b5-82f0-1bcf13f0681e None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:37.538033 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5772d-ed63-4ec1-a0ef-ab5e8fb91edf None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:37.579383 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2b2ef-3ae7-4f12-bcc5-b49b2f191acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:37.580318 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2b2ef-3ae7-4f12-bcc5-b49b2f191acf None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:37.580633 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2b2ef-3ae7-4f12-bcc5-b49b2f191acf None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:37.580987 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2b2ef-3ae7-4f12-bcc5-b49b2f191acf None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:37.582378 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2b2ef-3ae7-4f12-bcc5-b49b2f191acf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:37.582378 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2b2ef-3ae7-4f12-bcc5-b49b2f191acf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:37.583711 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2b2ef-3ae7-4f12-bcc5-b49b2f191acf None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:37.601921 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 404/794] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:37.603383 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a8335-bc6d-40fa-816a-10e8c342e9ad None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:37.603777 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a8335-bc6d-40fa-816a-10e8c342e9ad None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:37.604741 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a8335-bc6d-40fa-816a-10e8c342e9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:37.625188 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-1e3a8335-bc6d-40fa-816a-10e8c342e9ad None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:37.626604 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-1e3a8335-bc6d-40fa-816a-10e8c342e9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:37.665285 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b8094-0b09-46b5-82f0-1bcf13f0681e None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:37.683898 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:37.703279 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06833a4b-198c-41c3-a4c9-e1f6abf2b220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:37.703907 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06833a4b-198c-41c3-a4c9-e1f6abf2b220 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:37.711865 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06833a4b-198c-41c3-a4c9-e1f6abf2b220 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:37.711995 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 405/795] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:36:37.712389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06833a4b-198c-41c3-a4c9-e1f6abf2b220 None admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:37.712501 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a8335-bc6d-40fa-816a-10e8c342e9ad None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:37.712577 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06833a4b-198c-41c3-a4c9-e1f6abf2b220 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:37.712577 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06833a4b-198c-41c3-a4c9-e1f6abf2b220 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:37.712577 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06833a4b-198c-41c3-a4c9-e1f6abf2b220 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:37.734581 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 391/796] 10.222.0.39 () {56 vars in 1135 bytes} [Mon May 23 15:36:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:37.737284 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65389d-fbb4-4560-bc1f-25fc2fb31c84 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:37.737761 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65389d-fbb4-4560-bc1f-25fc2fb31c84 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:37.738455 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65389d-fbb4-4560-bc1f-25fc2fb31c84 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:37.740924 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 392/797] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:37.742583 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65389d-fbb4-4560-bc1f-25fc2fb31c84 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:37.754718 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:37.814770 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a8335-bc6d-40fa-816a-10e8c342e9ad None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:37.854194 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777a225-c3c3-4aea-b423-9eccbb1a0a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:37.855437 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777a225-c3c3-4aea-b423-9eccbb1a0a00 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:37.855748 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777a225-c3c3-4aea-b423-9eccbb1a0a00 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:37.856020 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777a225-c3c3-4aea-b423-9eccbb1a0a00 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:37.868228 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65389d-fbb4-4560-bc1f-25fc2fb31c84 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:37.871806 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777a225-c3c3-4aea-b423-9eccbb1a0a00 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:37.873256 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777a225-c3c3-4aea-b423-9eccbb1a0a00 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:37.888150 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-2777a225-c3c3-4aea-b423-9eccbb1a0a00 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:36:37.888150 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:37.888150 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:37.888150 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:37.888150 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:37.888150 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:37.888150 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:37.888150 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:37.888150 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:37.888150 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:37.888150 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:37.888150 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:37.888150 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:36:37.888150 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:36:37.888150 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:36:37.888150 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:36:37.889323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:37.889323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:37.889323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:36:37.889323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:37.889323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:36:37.889323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:37.889323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:37.889323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:37.889323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:37.889323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:37.889323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:37.889323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:37.889323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:37.889323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:37.889323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:37.889323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:37.889323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:37.889323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:37.890466 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:37.890466 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:37.890466 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:36:37.890466 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:36:37.890466 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:36:37.890466 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:36:37.890466 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:36:37.890466 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:36:37.890466 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:36:37.890466 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:37.893950 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 406/798] 10.222.0.39 () {56 vars in 1117 bytes} [Mon May 23 15:36:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:37.894814 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777a225-c3c3-4aea-b423-9eccbb1a0a00 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:37.910546 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6e5ca-5f5a-458f-8576-7847d462b459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:37.911334 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6e5ca-5f5a-458f-8576-7847d462b459 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:37.911627 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6e5ca-5f5a-458f-8576-7847d462b459 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:37.911933 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6e5ca-5f5a-458f-8576-7847d462b459 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:37.923505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6e5ca-5f5a-458f-8576-7847d462b459 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:36:37.931026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-40f6e5ca-5f5a-458f-8576-7847d462b459 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:36:37.931026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:37.931026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:37.931026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:37.931026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:37.931026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:37.931026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:37.931026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:37.931026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:37.931026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:37.931026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:37.931026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:37.931026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:36:37.931026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:36:37.931026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:36:37.931026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:36:37.932815 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:36:37.932815 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:36:37.932815 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:36:37.932815 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:36:37.932815 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:37.932815 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:37.932815 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:37.932815 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:37.932815 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:37.932815 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:37.932815 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:37.932815 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:37.932815 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:37.932815 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:37.932815 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:37.932815 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:37.934322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:37.934322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:37.934322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:37.934322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:37.934322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:36:37.934322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:36:37.934322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:36:37.934322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:36:37.934322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:36:37.934322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:36:37.934322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:36:37.934322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:37.934322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 393/799] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:36:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:37.934322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f534cb-3909-40ea-a0dd-cceeff10b2ff None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:37.935090 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f534cb-3909-40ea-a0dd-cceeff10b2ff None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:37.935090 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f534cb-3909-40ea-a0dd-cceeff10b2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:37.951214 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-a3f534cb-3909-40ea-a0dd-cceeff10b2ff None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:37.952513 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-a3f534cb-3909-40ea-a0dd-cceeff10b2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:37.982504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:38.009445 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:38.013581 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777a225-c3c3-4aea-b423-9eccbb1a0a00 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:38.025055 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 394/800] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:36:38.026009 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f534cb-3909-40ea-a0dd-cceeff10b2ff None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:38.054011 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586f071-3406-4b17-ae6f-c5e3669c51d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:38.054813 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586f071-3406-4b17-ae6f-c5e3669c51d3 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:38.055093 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586f071-3406-4b17-ae6f-c5e3669c51d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:38.055370 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586f071-3406-4b17-ae6f-c5e3669c51d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:38.066775 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9586f071-3406-4b17-ae6f-c5e3669c51d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:38.068266 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9586f071-3406-4b17-ae6f-c5e3669c51d3 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:38.087406 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-9586f071-3406-4b17-ae6f-c5e3669c51d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:38.087406 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:38.087406 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:38.087406 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:38.087406 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:38.087406 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:38.087406 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:38.087406 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:38.087406 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:38.087406 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:38.087406 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:38.087406 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:38.087406 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:38.087406 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:38.087406 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:38.088614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:38.088614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:38.088614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:38.088614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:38.088614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:38.088614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:38.088614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:38.088614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:38.088614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:38.088614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:38.088614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:38.088614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:38.088614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:38.088614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:38.088614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:38.088614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:38.088614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:38.089542 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:38.089542 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:38.089542 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:38.089542 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:38.089542 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 407/801] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:38.089906 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586f071-3406-4b17-ae6f-c5e3669c51d3 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:38.150733 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f534cb-3909-40ea-a0dd-cceeff10b2ff None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:38.189940 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9649a-4dd2-42f8-9251-3dd5b3811938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:38.190868 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9649a-4dd2-42f8-9251-3dd5b3811938 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:38.191148 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9649a-4dd2-42f8-9251-3dd5b3811938 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:38.191415 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9649a-4dd2-42f8-9251-3dd5b3811938 None admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:38.195245 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9649a-4dd2-42f8-9251-3dd5b3811938 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:38.195245 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9649a-4dd2-42f8-9251-3dd5b3811938 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:38.195245 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9649a-4dd2-42f8-9251-3dd5b3811938 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:38.200006 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586f071-3406-4b17-ae6f-c5e3669c51d3 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:38.215873 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 395/802] 10.222.0.39 () {56 vars in 1149 bytes} [Mon May 23 15:36:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:38.216939 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9649a-4dd2-42f8-9251-3dd5b3811938 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:38.243638 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:38.245246 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f32161-da76-4ae4-8059-9dde38bcefc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:38.245971 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f32161-da76-4ae4-8059-9dde38bcefc7 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:38.246257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f32161-da76-4ae4-8059-9dde38bcefc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:38.246531 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f32161-da76-4ae4-8059-9dde38bcefc7 None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:38.247282 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f32161-da76-4ae4-8059-9dde38bcefc7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:38.247585 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f32161-da76-4ae4-8059-9dde38bcefc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:38.248978 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f32161-da76-4ae4-8059-9dde38bcefc7 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:38.258059 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 408/803] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:36:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:38.258960 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f32161-da76-4ae4-8059-9dde38bcefc7 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:38.276065 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:38.325228 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9649a-4dd2-42f8-9251-3dd5b3811938 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:38.362330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3584d9-33d9-4f21-aca7-a469158df665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:38.363163 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3584d9-33d9-4f21-aca7-a469158df665 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:38.363446 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3584d9-33d9-4f21-aca7-a469158df665 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:38.363757 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3584d9-33d9-4f21-aca7-a469158df665 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:38.364427 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3584d9-33d9-4f21-aca7-a469158df665 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:38.365832 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3584d9-33d9-4f21-aca7-a469158df665 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:38.366755 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f32161-da76-4ae4-8059-9dde38bcefc7 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:38.380598 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-ba3584d9-33d9-4f21-aca7-a469158df665 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 15:36:38.380598 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:38.380598 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:36:38.380598 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:36:38.380598 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:36:38.380598 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:36:38.380598 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:36:38.380598 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:36:38.380598 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 15:36:38.380598 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:38.380598 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:36:38.380598 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:38.380598 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:38.380598 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:38.380598 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:38.380598 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:38.381767 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:38.381767 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:38.381767 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:38.381767 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:38.381767 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:38.381767 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:38.381767 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:38.381767 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:36:38.381767 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:36:38.381767 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:36:38.381767 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:36:38.381767 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:38.381767 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:38.381767 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:38.381767 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:38.381767 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:38.382655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:38.382655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:38.382655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:38.382655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:38.382655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:38.382655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:38.382655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:38.382655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:38.382655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:38.382655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:38.382655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:38.382655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:36:38.382655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:36:38.382655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 15:36:38.382655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:38.382655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 396/804] 10.222.0.39 () {56 vars in 1129 bytes} [Mon May 23 15:36:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:38.383512 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3584d9-33d9-4f21-aca7-a469158df665 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:38.412227 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6d2f1-5f46-414d-865a-788188157ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:38.412885 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6d2f1-5f46-414d-865a-788188157ab7 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:38.413217 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6d2f1-5f46-414d-865a-788188157ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:38.413493 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6d2f1-5f46-414d-865a-788188157ab7 None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:38.414209 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a6d2f1-5f46-414d-865a-788188157ab7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:38.414514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a6d2f1-5f46-414d-865a-788188157ab7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:38.415895 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a6d2f1-5f46-414d-865a-788188157ab7 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:38.427758 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 409/805] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:38.428366 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6d2f1-5f46-414d-865a-788188157ab7 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:38.481453 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:38.497638 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3584d9-33d9-4f21-aca7-a469158df665 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:38.510927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:38.535036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577f89c-bcd5-408f-99c6-1cd6ac2bfd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:38.535873 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577f89c-bcd5-408f-99c6-1cd6ac2bfd28 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:38.536161 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577f89c-bcd5-408f-99c6-1cd6ac2bfd28 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:38.536489 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577f89c-bcd5-408f-99c6-1cd6ac2bfd28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:38.538389 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6d2f1-5f46-414d-865a-788188157ab7 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:38.548042 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577f89c-bcd5-408f-99c6-1cd6ac2bfd28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:38.549624 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577f89c-bcd5-408f-99c6-1cd6ac2bfd28 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:38.567235 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-6577f89c-bcd5-408f-99c6-1cd6ac2bfd28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:38.567235 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:38.567235 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:38.567235 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:38.567235 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:38.567235 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:38.567235 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:38.567235 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:38.567235 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:38.567235 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:38.567235 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:38.567235 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:38.567235 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:38.567235 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:38.567235 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:38.568313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:38.568313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:38.568313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:38.568313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:38.568313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:38.568313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:38.568313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:38.568313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:38.568313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:38.568313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:38.568313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:38.568313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:38.568313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:38.568313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:38.568313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:38.568313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:38.568313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:38.569205 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:38.569205 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:38.569205 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:38.569205 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:38.569205 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 397/806] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:38.569205 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577f89c-bcd5-408f-99c6-1cd6ac2bfd28 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:38.573939 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a7810f-4071-490f-827e-055a9fbce4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:38.574730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7810f-4071-490f-827e-055a9fbce4dd None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:38.575009 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7810f-4071-490f-827e-055a9fbce4dd None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:38.575277 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7810f-4071-490f-827e-055a9fbce4dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:38.586054 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a7810f-4071-490f-827e-055a9fbce4dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:38.587501 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a7810f-4071-490f-827e-055a9fbce4dd None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:38.604315 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-52a7810f-4071-490f-827e-055a9fbce4dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:38.604315 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:38.604315 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:38.604315 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:38.604315 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:38.604315 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:38.604315 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:38.604315 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:38.604315 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:38.604315 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:38.604315 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:38.604315 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:38.604315 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:38.604315 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:38.604315 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:38.605361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:38.605361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:38.605361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:38.605361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:38.605361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:38.605361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:38.605361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:38.605361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:38.605361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:38.605361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:38.605361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:38.605361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:38.605361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:38.605361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:38.605361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:38.605361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:38.605361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:38.606329 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:38.606329 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:38.606329 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:38.606329 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:38.606329 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 410/807] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:38.606877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a7810f-4071-490f-827e-055a9fbce4dd None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:38.671004 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577f89c-bcd5-408f-99c6-1cd6ac2bfd28 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:38.705058 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae2510-1d4c-4321-b930-0c7221d35550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:38.705675 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a7810f-4071-490f-827e-055a9fbce4dd None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:38.705866 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae2510-1d4c-4321-b930-0c7221d35550 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:38.706219 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae2510-1d4c-4321-b930-0c7221d35550 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:38.706563 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae2510-1d4c-4321-b930-0c7221d35550 None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:38.707341 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae2510-1d4c-4321-b930-0c7221d35550 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:38.707766 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae2510-1d4c-4321-b930-0c7221d35550 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:38.709211 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae2510-1d4c-4321-b930-0c7221d35550 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:38.713703 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 398/808] 10.222.0.39 () {56 vars in 1124 bytes} [Mon May 23 15:36:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:38.714918 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee6f3d-00cd-4028-80b7-7b737d3a6054 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:38.715209 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee6f3d-00cd-4028-80b7-7b737d3a6054 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:38.715488 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee6f3d-00cd-4028-80b7-7b737d3a6054 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:38.716753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 399/809] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:38.717446 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee6f3d-00cd-4028-80b7-7b737d3a6054 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:38.722208 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:38.735403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:38.743924 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b397a6-8bf2-4016-83f9-029deb183716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:38.745231 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b397a6-8bf2-4016-83f9-029deb183716 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:38.745516 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b397a6-8bf2-4016-83f9-029deb183716 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:38.745793 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b397a6-8bf2-4016-83f9-029deb183716 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:38.752582 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b397a6-8bf2-4016-83f9-029deb183716 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:38.753958 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b397a6-8bf2-4016-83f9-029deb183716 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:38.768742 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-24b397a6-8bf2-4016-83f9-029deb183716 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:38.768742 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:38.768742 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:38.768742 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:38.768742 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:38.768742 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:38.768742 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:38.768742 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:38.768742 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:38.768742 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:38.768742 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:38.768742 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:38.768742 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:36:38.768742 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:36:38.768742 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:36:38.769667 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:36:38.769667 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:38.769667 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:38.769667 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:38.769667 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:38.769667 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:38.769667 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:38.769667 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:38.769667 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:38.769667 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:38.769667 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:38.769667 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:38.769667 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:38.769667 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:38.769667 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:38.769667 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:38.769667 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:38.771141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:36:38.771141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:36:38.771141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:36:38.771141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:36:38.771141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:36:38.771141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:36:38.771141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:38.771141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:38.771141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 411/810] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:36:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:38.771141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b397a6-8bf2-4016-83f9-029deb183716 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:38.824454 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee6f3d-00cd-4028-80b7-7b737d3a6054 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:38.856992 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f96b1-e26b-4096-a22d-9bd379f961a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:38.857646 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f96b1-e26b-4096-a22d-9bd379f961a9 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:38.858180 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f96b1-e26b-4096-a22d-9bd379f961a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:38.858458 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f96b1-e26b-4096-a22d-9bd379f961a9 None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:38.859177 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f96b1-e26b-4096-a22d-9bd379f961a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:38.859480 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f96b1-e26b-4096-a22d-9bd379f961a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:38.860876 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f96b1-e26b-4096-a22d-9bd379f961a9 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:38.870916 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b397a6-8bf2-4016-83f9-029deb183716 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:38.872916 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 400/811] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:38.873689 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f96b1-e26b-4096-a22d-9bd379f961a9 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:38.910177 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34e570-30ce-4443-957f-2144ee77dcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:38.910830 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34e570-30ce-4443-957f-2144ee77dcb7 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:38.911504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34e570-30ce-4443-957f-2144ee77dcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:38.911813 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34e570-30ce-4443-957f-2144ee77dcb7 None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:38.912532 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34e570-30ce-4443-957f-2144ee77dcb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:38.913154 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34e570-30ce-4443-957f-2144ee77dcb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:38.914470 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34e570-30ce-4443-957f-2144ee77dcb7 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:38.925676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 412/812] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:38.926841 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f1d75-79cb-438b-a78a-d6a4acc25630 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:38.927133 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f1d75-79cb-438b-a78a-d6a4acc25630 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:38.927411 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f1d75-79cb-438b-a78a-d6a4acc25630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:38.932802 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:38.943642 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-fb5f1d75-79cb-438b-a78a-d6a4acc25630 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:38.944835 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-fb5f1d75-79cb-438b-a78a-d6a4acc25630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:38.969899 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f96b1-e26b-4096-a22d-9bd379f961a9 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:38.987234 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:39.004912 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644be8a5-6c42-49cd-9a31-bd1203dde958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:39.005501 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644be8a5-6c42-49cd-9a31-bd1203dde958 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:39.005781 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644be8a5-6c42-49cd-9a31-bd1203dde958 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:39.006052 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644be8a5-6c42-49cd-9a31-bd1203dde958 None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:39.006747 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644be8a5-6c42-49cd-9a31-bd1203dde958 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:39.007042 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644be8a5-6c42-49cd-9a31-bd1203dde958 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:39.008443 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644be8a5-6c42-49cd-9a31-bd1203dde958 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:39.011803 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 413/813] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:36:39.012619 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f1d75-79cb-438b-a78a-d6a4acc25630 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:39.017842 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 401/814] 10.222.0.39 () {56 vars in 1124 bytes} [Mon May 23 15:36:38 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:39.017842 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644be8a5-6c42-49cd-9a31-bd1203dde958 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:39.116256 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f1d75-79cb-438b-a78a-d6a4acc25630 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:39.122703 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644be8a5-6c42-49cd-9a31-bd1203dde958 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:39.148082 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:39.150666 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e59f8e-b88c-4e7b-a62b-955973bb451e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:39.152029 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e59f8e-b88c-4e7b-a62b-955973bb451e None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:39.152298 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e59f8e-b88c-4e7b-a62b-955973bb451e None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:39.152579 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e59f8e-b88c-4e7b-a62b-955973bb451e None admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:39.153358 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e59f8e-b88c-4e7b-a62b-955973bb451e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:39.153666 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e59f8e-b88c-4e7b-a62b-955973bb451e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:39.155138 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e59f8e-b88c-4e7b-a62b-955973bb451e None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:39.157212 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6361ce-1ad5-4740-bd68-23ccdbd33c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:39.158032 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6361ce-1ad5-4740-bd68-23ccdbd33c25 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:39.158338 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6361ce-1ad5-4740-bd68-23ccdbd33c25 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:39.160028 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6361ce-1ad5-4740-bd68-23ccdbd33c25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:39.165148 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6361ce-1ad5-4740-bd68-23ccdbd33c25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:39.167263 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6361ce-1ad5-4740-bd68-23ccdbd33c25 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:39.167885 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 414/815] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:36:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:39.168707 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e59f8e-b88c-4e7b-a62b-955973bb451e None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:39.183359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-cd6361ce-1ad5-4740-bd68-23ccdbd33c25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:39.183359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:39.183359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:39.183359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:39.183359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:39.183359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:39.183359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:39.183359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:39.183359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:39.183359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:39.183359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:39.183359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:39.183359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:36:39.183359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:36:39.183359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:36:39.184407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:36:39.184407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:39.184407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:39.184407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:39.184407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:39.184407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:39.184407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:39.184407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:39.184407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:39.184407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:39.184407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:39.184407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:39.184407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:39.184407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:39.184407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:39.184407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:39.184407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:39.190285 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:36:39.190285 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:36:39.190285 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:36:39.190285 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:36:39.190285 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:36:39.190285 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:36:39.190285 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:39.190285 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:39.190285 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 402/816] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:36:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:39.190285 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6361ce-1ad5-4740-bd68-23ccdbd33c25 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:39.206729 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:39.272362 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e59f8e-b88c-4e7b-a62b-955973bb451e None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:39.292177 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6361ce-1ad5-4740-bd68-23ccdbd33c25 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:39.305606 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40ff4a-0a7d-45fa-a4db-62a2f8fb33a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:39.306385 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40ff4a-0a7d-45fa-a4db-62a2f8fb33a4 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:39.306665 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40ff4a-0a7d-45fa-a4db-62a2f8fb33a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:39.306937 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40ff4a-0a7d-45fa-a4db-62a2f8fb33a4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:39.314324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40ff4a-0a7d-45fa-a4db-62a2f8fb33a4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:39.315787 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40ff4a-0a7d-45fa-a4db-62a2f8fb33a4 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:39.325042 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc91e7-13cf-4a06-a351-6b9a72795c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:39.325686 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc91e7-13cf-4a06-a351-6b9a72795c3b None admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:39.325966 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc91e7-13cf-4a06-a351-6b9a72795c3b None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:39.326237 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc91e7-13cf-4a06-a351-6b9a72795c3b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:39.326983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc91e7-13cf-4a06-a351-6b9a72795c3b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:39.328360 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc91e7-13cf-4a06-a351-6b9a72795c3b None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:39.329523 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-ba40ff4a-0a7d-45fa-a4db-62a2f8fb33a4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 15:36:39.329523 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:39.329523 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:39.329523 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:39.329523 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:39.329523 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:39.329523 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:39.329523 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:39.329523 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:39.329523 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:39.329523 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:39.329523 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:39.329523 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:36:39.329523 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:36:39.329523 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:36:39.329523 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:36:39.330591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:39.330591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:39.330591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:36:39.330591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:39.330591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:36:39.330591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:39.330591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:39.330591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:39.330591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:39.330591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:39.330591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:39.330591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:39.330591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:39.330591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:39.330591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:39.330591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:39.330591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:39.330591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:39.331898 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:39.331898 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:39.331898 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:36:39.331898 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:36:39.331898 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:36:39.331898 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:36:39.331898 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:36:39.331898 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:36:39.331898 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 15:36:39.331898 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:39.331898 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 415/817] 10.222.0.39 () {56 vars in 1093 bytes} [Mon May 23 15:36:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:39.331898 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40ff4a-0a7d-45fa-a4db-62a2f8fb33a4 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:39.427049 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:39.433393 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40ff4a-0a7d-45fa-a4db-62a2f8fb33a4 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:39.436353 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 403/818] 10.222.0.39 () {60 vars in 1144 bytes} [Mon May 23 15:36:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:36:39.437150 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc91e7-13cf-4a06-a351-6b9a72795c3b None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:39.479462 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7c0ed-d27f-4f86-bc0b-5612dfd5624c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:39.480341 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7c0ed-d27f-4f86-bc0b-5612dfd5624c None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:39.480624 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7c0ed-d27f-4f86-bc0b-5612dfd5624c None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:39.480901 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7c0ed-d27f-4f86-bc0b-5612dfd5624c None admin] PATH_INFO: `/v3/services/network` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:39.481582 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb7c0ed-d27f-4f86-bc0b-5612dfd5624c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:39.483235 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb7c0ed-d27f-4f86-bc0b-5612dfd5624c None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:39.490739 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:39.498180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-6eb7c0ed-d27f-4f86-bc0b-5612dfd5624c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 23 15:36:39.498180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:39.498180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:36:39.498180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:36:39.498180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:36:39.498180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:36:39.498180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:36:39.498180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:36:39.498180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 15:36:39.498180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:39.498180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:36:39.498180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:39.498180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:39.498180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:39.498180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:39.498180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:39.498180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:39.505746 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:39.505746 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:39.505746 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:39.505746 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:39.505746 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:39.505746 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:39.505746 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:36:39.505746 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:36:39.505746 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:36:39.505746 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:36:39.505746 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:39.505746 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:39.505746 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:39.505746 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:39.505746 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:39.505746 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:39.506636 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:39.506636 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:39.506636 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:39.506636 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:39.506636 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:39.506636 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:39.506636 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:39.506636 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:39.506636 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:39.506636 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:39.506636 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:36:39.506636 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:36:39.506636 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 15:36:39.506636 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:39.506636 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 416/819] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:36:39 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:39.507450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7c0ed-d27f-4f86-bc0b-5612dfd5624c None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:39.560940 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc91e7-13cf-4a06-a351-6b9a72795c3b None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:39.598888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad038cb-ddeb-416e-8a9b-3006cb044b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:39.599822 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad038cb-ddeb-416e-8a9b-3006cb044b32 None admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:39.600109 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad038cb-ddeb-416e-8a9b-3006cb044b32 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:39.600365 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad038cb-ddeb-416e-8a9b-3006cb044b32 None admin] PATH_INFO: `/v3/projects/8addb03b903842609168ee2fafc8ec6b/users/b275a110936a44ce8d54793af1a34808/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:39.602391 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad038cb-ddeb-416e-8a9b-3006cb044b32 None admin] RBAC: Authorizing `identity:create_grant(project_id=8addb03b903842609168ee2fafc8ec6b, user_id=b275a110936a44ce8d54793af1a34808, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:39.603902 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad038cb-ddeb-416e-8a9b-3006cb044b32 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:39.614449 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7c0ed-d27f-4f86-bc0b-5612dfd5624c None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:39.649802 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25857962-166c-499d-a8e7-345aa18846d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:39.650458 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25857962-166c-499d-a8e7-345aa18846d0 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:39.650746 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25857962-166c-499d-a8e7-345aa18846d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:39.651158 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25857962-166c-499d-a8e7-345aa18846d0 None admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:39.652087 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25857962-166c-499d-a8e7-345aa18846d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:39.652423 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25857962-166c-499d-a8e7-345aa18846d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:39.653879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25857962-166c-499d-a8e7-345aa18846d0 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:39.668682 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 417/820] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:36:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:39.669321 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25857962-166c-499d-a8e7-345aa18846d0 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:39.673166 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 404/821] 10.222.0.39 () {58 vars in 1439 bytes} [Mon May 23 15:36:39 2022] PUT /identity/v3/projects/8addb03b903842609168ee2fafc8ec6b/users/b275a110936a44ce8d54793af1a34808/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:36:39.675221 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad038cb-ddeb-416e-8a9b-3006cb044b32 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:39.697100 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:39.814816 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad038cb-ddeb-416e-8a9b-3006cb044b32 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:39.816306 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25857962-166c-499d-a8e7-345aa18846d0 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:39.817723 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:39.856188 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e3356-f0ce-4338-badd-f3e8a8556096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:39.857215 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e3356-f0ce-4338-badd-f3e8a8556096 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:39.857915 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf504489-9107-476d-af29-4c1e2f0c62dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:39.858128 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e3356-f0ce-4338-badd-f3e8a8556096 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:39.858591 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e3356-f0ce-4338-badd-f3e8a8556096 None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:39.858740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf504489-9107-476d-af29-4c1e2f0c62dc None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:39.859118 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf504489-9107-476d-af29-4c1e2f0c62dc None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:39.859844 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e3356-f0ce-4338-badd-f3e8a8556096 None admin] RBAC: Adding query filter params (name=network) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:39.860152 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf504489-9107-476d-af29-4c1e2f0c62dc None admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:39.860527 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e3356-f0ce-4338-badd-f3e8a8556096 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:39.861143 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf504489-9107-476d-af29-4c1e2f0c62dc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:39.861520 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf504489-9107-476d-af29-4c1e2f0c62dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:39.862429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e3356-f0ce-4338-badd-f3e8a8556096 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:39.863093 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf504489-9107-476d-af29-4c1e2f0c62dc None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:39.868628 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 405/822] 10.222.0.39 () {56 vars in 1112 bytes} [Mon May 23 15:36:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:39.869809 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e3356-f0ce-4338-badd-f3e8a8556096 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:39.889965 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 418/823] 10.222.0.39 () {56 vars in 1133 bytes} [Mon May 23 15:36:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:39.891841 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf504489-9107-476d-af29-4c1e2f0c62dc None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:39.988776 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e3356-f0ce-4338-badd-f3e8a8556096 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:40.002919 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:40.031381 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf504489-9107-476d-af29-4c1e2f0c62dc None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:40.031661 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4a971-8df7-47b7-99b0-128b25de1458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:40.032720 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4a971-8df7-47b7-99b0-128b25de1458 None admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:40.033585 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4a971-8df7-47b7-99b0-128b25de1458 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:40.035390 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4a971-8df7-47b7-99b0-128b25de1458 None admin] PATH_INFO: `/v3/projects/8addb03b903842609168ee2fafc8ec6b/users/048fc48dd55a43f7b342533a9484c3ad/roles/b57c4ebab8e842088df37b551053b113` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:40.055961 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca4a971-8df7-47b7-99b0-128b25de1458 None admin] RBAC: Authorizing `identity:create_grant(project_id=8addb03b903842609168ee2fafc8ec6b, user_id=048fc48dd55a43f7b342533a9484c3ad, role_id=b57c4ebab8e842088df37b551053b113)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:40.058906 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca4a971-8df7-47b7-99b0-128b25de1458 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:40.069593 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99d68e-9e93-4e2a-8714-9ca16955a074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:40.070196 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99d68e-9e93-4e2a-8714-9ca16955a074 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:40.070479 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99d68e-9e93-4e2a-8714-9ca16955a074 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:40.070753 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99d68e-9e93-4e2a-8714-9ca16955a074 None admin] PATH_INFO: `/v3/services` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:40.071459 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99d68e-9e93-4e2a-8714-9ca16955a074 None admin] RBAC: Adding query filter params (type=network) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:40.071815 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99d68e-9e93-4e2a-8714-9ca16955a074 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:40.073248 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99d68e-9e93-4e2a-8714-9ca16955a074 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:40.079042 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 419/824] 10.222.0.39 () {56 vars in 1112 bytes} [Mon May 23 15:36:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:40.083652 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99d68e-9e93-4e2a-8714-9ca16955a074 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:40.140725 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 406/825] 10.222.0.39 () {58 vars in 1439 bytes} [Mon May 23 15:36:39 2022] PUT /identity/v3/projects/8addb03b903842609168ee2fafc8ec6b/users/048fc48dd55a43f7b342533a9484c3ad/roles/b57c4ebab8e842088df37b551053b113 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:36:40.142464 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4a971-8df7-47b7-99b0-128b25de1458 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:40.172005 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:40.207088 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99d68e-9e93-4e2a-8714-9ca16955a074 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:40.264865 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800be298-dd18-4019-a169-ee6e22b76628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:40.265702 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800be298-dd18-4019-a169-ee6e22b76628 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:40.266090 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800be298-dd18-4019-a169-ee6e22b76628 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:40.266961 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800be298-dd18-4019-a169-ee6e22b76628 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:40.281659 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4a971-8df7-47b7-99b0-128b25de1458 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:40.284964 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:40.327288 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db064de-d0fd-44e5-aad9-059e2d1e53c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:40.329952 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db064de-d0fd-44e5-aad9-059e2d1e53c6 None admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:40.331686 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db064de-d0fd-44e5-aad9-059e2d1e53c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:40.332278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db064de-d0fd-44e5-aad9-059e2d1e53c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:40.333287 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db064de-d0fd-44e5-aad9-059e2d1e53c6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:40.336924 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db064de-d0fd-44e5-aad9-059e2d1e53c6 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:40.399533 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800be298-dd18-4019-a169-ee6e22b76628 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:40.402001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800be298-dd18-4019-a169-ee6e22b76628 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:40.425283 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 407/826] 10.222.0.39 () {60 vars in 1144 bytes} [Mon May 23 15:36:40 2022] POST /identity/v3/endpoints => generated 327 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:36:40.531201 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 420/827] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:36:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:36:40.533019 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db064de-d0fd-44e5-aad9-059e2d1e53c6 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:40.620227 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:40.674799 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db064de-d0fd-44e5-aad9-059e2d1e53c6 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:40.712079 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9231362-8ca1-473a-bb95-051dfc311569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:40.714173 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9231362-8ca1-473a-bb95-051dfc311569 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:40.714862 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9231362-8ca1-473a-bb95-051dfc311569 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:40.715364 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9231362-8ca1-473a-bb95-051dfc311569 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:40.726610 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9231362-8ca1-473a-bb95-051dfc311569 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:40.728408 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9231362-8ca1-473a-bb95-051dfc311569 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:40.749655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-d9231362-8ca1-473a-bb95-051dfc311569 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:40.749655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:40.749655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:40.749655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:40.749655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:40.749655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:40.749655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:40.749655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:40.749655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:40.749655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:40.749655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:40.749655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:40.749655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:40.749655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:40.749655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:40.750658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:40.750658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:40.750658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:40.750658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:40.750658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:40.750658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:40.750658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:40.750658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:40.750658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:40.750658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:40.750658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:40.750658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:40.750658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:40.750658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:40.750658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:40.750658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:40.750658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:40.751569 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:40.751569 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:40.751569 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:40.751569 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:40.753988 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 408/828] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:40.759349 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800be298-dd18-4019-a169-ee6e22b76628 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:40.815082 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:40.880146 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800be298-dd18-4019-a169-ee6e22b76628 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:40.921888 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb72331-08f0-4de2-b00f-69fb507d3e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:40.922561 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb72331-08f0-4de2-b00f-69fb507d3e18 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:40.922846 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb72331-08f0-4de2-b00f-69fb507d3e18 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:40.923126 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb72331-08f0-4de2-b00f-69fb507d3e18 None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:40.923914 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb72331-08f0-4de2-b00f-69fb507d3e18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:40.924227 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb72331-08f0-4de2-b00f-69fb507d3e18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:40.925599 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb72331-08f0-4de2-b00f-69fb507d3e18 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:40.938171 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 421/829] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:40.943551 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9231362-8ca1-473a-bb95-051dfc311569 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:41.071448 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9231362-8ca1-473a-bb95-051dfc311569 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:41.094662 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:41.113496 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00248a9-f14d-4a01-9cf7-1191448899b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:41.114580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00248a9-f14d-4a01-9cf7-1191448899b8 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:41.115044 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00248a9-f14d-4a01-9cf7-1191448899b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:41.115524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00248a9-f14d-4a01-9cf7-1191448899b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:41.122784 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00248a9-f14d-4a01-9cf7-1191448899b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:41.124484 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00248a9-f14d-4a01-9cf7-1191448899b8 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:41.141505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-e00248a9-f14d-4a01-9cf7-1191448899b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:41.141505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:41.141505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:41.141505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:41.141505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:41.141505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:41.141505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:41.141505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:41.141505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:41.141505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:41.141505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:41.141505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:41.141505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:36:41.141505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:36:41.141505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:36:41.142423 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:36:41.142423 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:41.142423 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:41.142423 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:41.142423 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:41.142423 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:41.142423 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:41.142423 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:41.142423 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:41.142423 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:41.142423 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:41.142423 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:41.142423 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:41.142423 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:41.142423 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:41.142423 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:41.142423 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:41.143381 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:36:41.143381 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:36:41.143381 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:36:41.143381 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:36:41.143381 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:36:41.143381 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:36:41.143381 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:41.143381 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:41.143841 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 409/830] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:36:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:36:41.146839 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb72331-08f0-4de2-b00f-69fb507d3e18 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:41.253808 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb72331-08f0-4de2-b00f-69fb507d3e18 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:41.261842 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:41.290448 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c0e18-c720-45e6-a7fe-5875188c4797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:41.291113 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c0e18-c720-45e6-a7fe-5875188c4797 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:41.291930 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c0e18-c720-45e6-a7fe-5875188c4797 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:41.292701 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c0e18-c720-45e6-a7fe-5875188c4797 None admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:41.293195 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c0e18-c720-45e6-a7fe-5875188c4797 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:41.293510 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c0e18-c720-45e6-a7fe-5875188c4797 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:41.294948 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c0e18-c720-45e6-a7fe-5875188c4797 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:41.312012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 422/831] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:36:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:41.314277 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00248a9-f14d-4a01-9cf7-1191448899b8 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:41.422025 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00248a9-f14d-4a01-9cf7-1191448899b8 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:41.457426 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991a438-15c5-48b5-b833-683cef84c026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:41.458081 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991a438-15c5-48b5-b833-683cef84c026 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:41.458365 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991a438-15c5-48b5-b833-683cef84c026 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:41.458643 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991a438-15c5-48b5-b833-683cef84c026 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:41.459465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991a438-15c5-48b5-b833-683cef84c026 None admin] RBAC: Adding query filter params (role.id=3ab888f5f68740bd8f9df4447f4f5a7a, scope.project.id=8addb03b903842609168ee2fafc8ec6b, user.id=76f7895b7b5748e7b4461f7fde1d558a) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:41.459807 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991a438-15c5-48b5-b833-683cef84c026 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:41.461240 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991a438-15c5-48b5-b833-683cef84c026 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:41.471715 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 410/832] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:36:41 2022] GET /identity/v3/role_assignments?user.id=76f7895b7b5748e7b4461f7fde1d558a&scope.project.id=8addb03b903842609168ee2fafc8ec6b&role.id=3ab888f5f68740bd8f9df4447f4f5a7a => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:41.787493 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7c1ca-e13b-4981-a24c-7068b4c826ac None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:41.787864 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7c1ca-e13b-4981-a24c-7068b4c826ac None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:41.787987 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7c1ca-e13b-4981-a24c-7068b4c826ac None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:41.789607 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 423/833] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:41.795098 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed02f34-3407-4e6f-89d4-9689b3d694a2 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:41.795394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed02f34-3407-4e6f-89d4-9689b3d694a2 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:41.795697 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed02f34-3407-4e6f-89d4-9689b3d694a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:41.813803 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-4ed02f34-3407-4e6f-89d4-9689b3d694a2 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:41.815329 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-4ed02f34-3407-4e6f-89d4-9689b3d694a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:41.860303 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:41.889696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 411/834] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:36:41.910738 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7c1ca-e13b-4981-a24c-7068b4c826ac None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:42.029519 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7c1ca-e13b-4981-a24c-7068b4c826ac None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:42.070937 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058a9e8-cad6-4407-a807-175951f2548e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:42.072015 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058a9e8-cad6-4407-a807-175951f2548e None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:42.072478 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058a9e8-cad6-4407-a807-175951f2548e None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:42.072939 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058a9e8-cad6-4407-a807-175951f2548e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:42.073742 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058a9e8-cad6-4407-a807-175951f2548e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:42.075264 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058a9e8-cad6-4407-a807-175951f2548e None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:42.087382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-6058a9e8-cad6-4407-a807-175951f2548e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 15:36:42.087382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:42.087382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:36:42.087382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:36:42.087382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:36:42.087382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:36:42.087382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:36:42.087382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:36:42.087382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 15:36:42.087382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:42.087382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:36:42.087382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:42.087382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:42.087382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:42.087382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:42.087382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:42.087382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:42.088673 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:42.088673 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:42.088673 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:42.088673 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:42.088673 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:42.088673 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:42.088673 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:36:42.088673 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:36:42.088673 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:36:42.088673 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:36:42.088673 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:42.088673 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:42.088673 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:42.088673 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:42.088673 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:42.088673 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:42.089688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:42.089688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:42.089688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:42.089688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:42.089688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:42.089688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:42.089688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:42.089688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:42.089688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:42.089688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:42.089688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:36:42.089688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:36:42.089688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 15:36:42.089688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:42.092258 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 424/835] 10.222.0.39 () {56 vars in 1114 bytes} [Mon May 23 15:36:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:42.099751 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed02f34-3407-4e6f-89d4-9689b3d694a2 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:42.140278 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce21ce9-9652-457c-b7a8-7b0a1451945f None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:42.140591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce21ce9-9652-457c-b7a8-7b0a1451945f None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:42.140846 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce21ce9-9652-457c-b7a8-7b0a1451945f None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:42.142556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 425/836] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:42.147731 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f4037-8789-4b7e-9f7b-7afd7326de74 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:42.148067 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f4037-8789-4b7e-9f7b-7afd7326de74 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:42.148357 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f4037-8789-4b7e-9f7b-7afd7326de74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:42.173461 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-4d6f4037-8789-4b7e-9f7b-7afd7326de74 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:42.174664 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-4d6f4037-8789-4b7e-9f7b-7afd7326de74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:42.200181 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:42.220376 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed02f34-3407-4e6f-89d4-9689b3d694a2 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:42.258457 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb574c5-d161-4677-9557-2c4cc94c01e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:42.259124 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb574c5-d161-4677-9557-2c4cc94c01e7 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:42.259406 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb574c5-d161-4677-9557-2c4cc94c01e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:42.259730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb574c5-d161-4677-9557-2c4cc94c01e7 None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:42.260756 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb574c5-d161-4677-9557-2c4cc94c01e7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:42.261242 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb574c5-d161-4677-9557-2c4cc94c01e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:42.262748 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb574c5-d161-4677-9557-2c4cc94c01e7 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:42.273108 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 412/837] 10.222.0.39 () {56 vars in 1114 bytes} [Mon May 23 15:36:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:42.274117 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb574c5-d161-4677-9557-2c4cc94c01e7 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:42.276218 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 426/838] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:42 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:36:42.305140 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f4037-8789-4b7e-9f7b-7afd7326de74 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:42.332514 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:42.409070 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb574c5-d161-4677-9557-2c4cc94c01e7 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:42.427502 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f4037-8789-4b7e-9f7b-7afd7326de74 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:42.452688 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77311f7b-4b26-4024-9b7a-e38f6a7fdeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:42.453350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77311f7b-4b26-4024-9b7a-e38f6a7fdeab None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:42.453629 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77311f7b-4b26-4024-9b7a-e38f6a7fdeab None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:42.453903 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77311f7b-4b26-4024-9b7a-e38f6a7fdeab None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:42.454701 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77311f7b-4b26-4024-9b7a-e38f6a7fdeab None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:42.454913 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77311f7b-4b26-4024-9b7a-e38f6a7fdeab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:42.456406 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77311f7b-4b26-4024-9b7a-e38f6a7fdeab None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:42.467738 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 413/839] 10.222.0.39 () {56 vars in 1114 bytes} [Mon May 23 15:36:42 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:42.473992 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd063a-feac-4219-adc3-b7178aec65cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:42.475176 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd063a-feac-4219-adc3-b7178aec65cb None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:42.475730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd063a-feac-4219-adc3-b7178aec65cb None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:42.476231 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd063a-feac-4219-adc3-b7178aec65cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:42.490077 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd063a-feac-4219-adc3-b7178aec65cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:36:42.499264 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-0bfd063a-feac-4219-adc3-b7178aec65cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:36:42.499264 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:42.499264 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:42.499264 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:42.499264 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:42.499264 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:42.499264 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:42.499264 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:42.499264 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:42.499264 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:42.499264 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:42.499264 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:42.499264 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:36:42.499264 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:36:42.499264 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:36:42.499264 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:36:42.500319 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:36:42.500319 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:36:42.500319 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:36:42.500319 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:36:42.500319 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:42.500319 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:42.500319 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:42.500319 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:42.500319 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:42.500319 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:42.500319 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:42.500319 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:42.500319 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:42.500319 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:42.500319 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:42.500319 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:42.501153 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:42.501153 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:42.501153 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:42.501153 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:42.501153 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:36:42.501153 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:36:42.501153 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:36:42.501153 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:36:42.501153 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:36:42.501153 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:36:42.501153 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:36:42.501153 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:42.504093 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 427/840] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:36:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:36:42.510414 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77311f7b-4b26-4024-9b7a-e38f6a7fdeab None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:42.630317 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77311f7b-4b26-4024-9b7a-e38f6a7fdeab None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:42.632637 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:42.672190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23a94c-1d26-4dd0-97bd-f3a4ab3fc5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:42.673307 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23a94c-1d26-4dd0-97bd-f3a4ab3fc5c2 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:42.673928 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23a94c-1d26-4dd0-97bd-f3a4ab3fc5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:42.674287 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23a94c-1d26-4dd0-97bd-f3a4ab3fc5c2 None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:42.675003 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23a94c-1d26-4dd0-97bd-f3a4ab3fc5c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:42.675314 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23a94c-1d26-4dd0-97bd-f3a4ab3fc5c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:42.676784 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23a94c-1d26-4dd0-97bd-f3a4ab3fc5c2 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:42.692441 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd063a-feac-4219-adc3-b7178aec65cb None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:42.693431 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 414/841] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:36:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:42.728149 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:42.801502 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd063a-feac-4219-adc3-b7178aec65cb None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:42.824607 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa7055-f658-4b83-9ab1-38030f35d127 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:42.825054 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa7055-f658-4b83-9ab1-38030f35d127 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:42.825471 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa7055-f658-4b83-9ab1-38030f35d127 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:42.827541 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 415/842] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:42.832091 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5f2e1-6850-46fd-8da6-e77021eab916 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:42.832374 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5f2e1-6850-46fd-8da6-e77021eab916 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:42.832652 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5f2e1-6850-46fd-8da6-e77021eab916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:42.838517 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0b23a-5288-42fb-86ed-f1eb06bd6fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:42.839957 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0b23a-5288-42fb-86ed-f1eb06bd6fe0 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:42.840245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0b23a-5288-42fb-86ed-f1eb06bd6fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:42.840521 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0b23a-5288-42fb-86ed-f1eb06bd6fe0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:42.851386 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-bfa5f2e1-6850-46fd-8da6-e77021eab916 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:42.852613 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-bfa5f2e1-6850-46fd-8da6-e77021eab916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:42.856917 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd0b23a-5288-42fb-86ed-f1eb06bd6fe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:42.858881 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd0b23a-5288-42fb-86ed-f1eb06bd6fe0 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:42.883853 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-8dd0b23a-5288-42fb-86ed-f1eb06bd6fe0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:42.883853 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:42.883853 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:42.883853 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:42.883853 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:42.883853 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:42.883853 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:42.883853 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:42.883853 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:42.883853 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:42.883853 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:42.883853 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:42.883853 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:42.883853 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:42.883853 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:42.884929 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:42.884929 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:42.884929 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:42.884929 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:42.884929 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:42.884929 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:42.884929 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:42.884929 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:42.884929 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:42.884929 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:42.884929 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:42.884929 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:42.884929 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:42.884929 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:42.884929 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:42.884929 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:42.884929 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:42.886568 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:42.886568 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:42.886568 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:42.886568 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:42.889279 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 428/843] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:42.895826 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0b23a-5288-42fb-86ed-f1eb06bd6fe0 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:42.935725 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 416/844] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:42 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:36:42.955778 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5f2e1-6850-46fd-8da6-e77021eab916 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:42.976075 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:43.030346 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0b23a-5288-42fb-86ed-f1eb06bd6fe0 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:43.068930 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:43.069326 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf61fe-a3a3-49dc-a372-cd58c2315807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:43.070111 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf61fe-a3a3-49dc-a372-cd58c2315807 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:43.070569 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf61fe-a3a3-49dc-a372-cd58c2315807 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:43.070943 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf61fe-a3a3-49dc-a372-cd58c2315807 None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:43.071812 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf61fe-a3a3-49dc-a372-cd58c2315807 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:43.072215 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf61fe-a3a3-49dc-a372-cd58c2315807 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:43.074399 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf61fe-a3a3-49dc-a372-cd58c2315807 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:43.079726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5f2e1-6850-46fd-8da6-e77021eab916 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:43.086908 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 429/845] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:43.093629 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf61fe-a3a3-49dc-a372-cd58c2315807 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:43.129696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63fdef-77c8-4852-a923-882d41b08c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:43.130502 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63fdef-77c8-4852-a923-882d41b08c2a None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:43.130784 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63fdef-77c8-4852-a923-882d41b08c2a None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:43.131219 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63fdef-77c8-4852-a923-882d41b08c2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:43.145296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63fdef-77c8-4852-a923-882d41b08c2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:36:43.155969 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-9d63fdef-77c8-4852-a923-882d41b08c2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:43.155969 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:43.155969 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:43.155969 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:43.155969 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:43.155969 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:43.155969 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:43.155969 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:43.155969 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:43.155969 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:43.155969 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:43.155969 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:43.155969 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:36:43.155969 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:36:43.155969 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:36:43.155969 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:36:43.156970 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:36:43.156970 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:36:43.156970 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:36:43.156970 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:36:43.156970 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:43.156970 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:43.156970 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:43.156970 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:43.156970 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:43.156970 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:43.156970 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:43.156970 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:43.156970 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:43.156970 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:43.156970 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:43.156970 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:43.157810 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:43.157810 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:43.157810 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:43.157810 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:43.157810 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:36:43.157810 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:36:43.157810 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:36:43.157810 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:36:43.157810 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:36:43.157810 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:36:43.157810 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:36:43.157810 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:43.158444 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 417/846] 10.222.0.39 () {56 vars in 1102 bytes} [Mon May 23 15:36:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:43.163986 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63fdef-77c8-4852-a923-882d41b08c2a None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:43.211799 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf61fe-a3a3-49dc-a372-cd58c2315807 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:43.237420 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:43.249687 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc654e-6dfb-45ce-b2b1-abb4b7f29716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:43.251528 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc654e-6dfb-45ce-b2b1-abb4b7f29716 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:43.251528 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc654e-6dfb-45ce-b2b1-abb4b7f29716 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:43.251528 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc654e-6dfb-45ce-b2b1-abb4b7f29716 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:43.259444 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc654e-6dfb-45ce-b2b1-abb4b7f29716 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:43.261126 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc654e-6dfb-45ce-b2b1-abb4b7f29716 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:43.278879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-8bcc654e-6dfb-45ce-b2b1-abb4b7f29716 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 15:36:43.278879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:43.278879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:43.278879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:43.278879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:43.278879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:43.278879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:43.278879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:43.278879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:43.278879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:43.278879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:43.278879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:43.278879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:36:43.278879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:36:43.278879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:36:43.278879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:36:43.280081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:43.280081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:43.280081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:36:43.280081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:43.280081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:36:43.280081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:43.280081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:43.280081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:43.280081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:43.280081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:43.280081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:43.280081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:43.280081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:43.280081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:43.280081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:43.280081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:43.280081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:43.280081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:43.281163 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:43.281163 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:43.281163 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:36:43.281163 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:36:43.281163 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:36:43.281163 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:36:43.281163 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:36:43.281163 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:36:43.281163 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 15:36:43.281163 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:43.284854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 430/847] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:36:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:43.285682 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc654e-6dfb-45ce-b2b1-abb4b7f29716 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:43.305573 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63fdef-77c8-4852-a923-882d41b08c2a None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:43.344948 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535b43a-ca87-462b-9345-f564cda0f867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:43.345883 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535b43a-ca87-462b-9345-f564cda0f867 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:43.346006 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535b43a-ca87-462b-9345-f564cda0f867 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:43.346262 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535b43a-ca87-462b-9345-f564cda0f867 None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:43.347105 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3535b43a-ca87-462b-9345-f564cda0f867 None admin] RBAC: Adding query filter params (name=service) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:43.347369 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3535b43a-ca87-462b-9345-f564cda0f867 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:43.348933 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3535b43a-ca87-462b-9345-f564cda0f867 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:43.363419 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 418/848] 10.222.0.39 () {56 vars in 1103 bytes} [Mon May 23 15:36:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:36:43.364535 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535b43a-ca87-462b-9345-f564cda0f867 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:43.385416 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:43.413980 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc654e-6dfb-45ce-b2b1-abb4b7f29716 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:43.456639 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5afd7-3c2c-4ab9-8a7d-522c80af2378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:43.457311 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5afd7-3c2c-4ab9-8a7d-522c80af2378 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:43.457797 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5afd7-3c2c-4ab9-8a7d-522c80af2378 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:43.457963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5afd7-3c2c-4ab9-8a7d-522c80af2378 None admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:43.458867 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5afd7-3c2c-4ab9-8a7d-522c80af2378 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:43.459182 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5afd7-3c2c-4ab9-8a7d-522c80af2378 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:43.460674 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5afd7-3c2c-4ab9-8a7d-522c80af2378 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:43.475347 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535b43a-ca87-462b-9345-f564cda0f867 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:43.484792 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 431/849] 10.222.0.39 () {56 vars in 1135 bytes} [Mon May 23 15:36:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:43.485663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5afd7-3c2c-4ab9-8a7d-522c80af2378 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:43.514737 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b87077-81ed-47a6-914d-dd9aba29522e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:43.515701 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b87077-81ed-47a6-914d-dd9aba29522e None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:43.515983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b87077-81ed-47a6-914d-dd9aba29522e None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:43.516254 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b87077-81ed-47a6-914d-dd9aba29522e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:43.528394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b87077-81ed-47a6-914d-dd9aba29522e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:43.529922 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b87077-81ed-47a6-914d-dd9aba29522e None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:43.536788 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:43.549908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-39b87077-81ed-47a6-914d-dd9aba29522e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:43.549908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:43.549908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:43.549908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:43.549908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:43.549908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:43.549908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:43.549908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:43.549908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:43.549908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:43.549908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:43.549908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:43.549908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:43.549908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:43.549908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:43.556632 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:43.556632 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:43.556632 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:43.556632 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:43.556632 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:43.556632 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:43.556632 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:43.556632 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:43.556632 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:43.556632 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:43.556632 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:43.556632 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:43.556632 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:43.556632 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:43.556632 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:43.556632 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:43.556632 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:43.557640 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:43.557640 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:43.557640 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:43.557640 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:43.558248 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 419/850] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:43.559930 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b87077-81ed-47a6-914d-dd9aba29522e None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:43.613643 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5afd7-3c2c-4ab9-8a7d-522c80af2378 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:43.641192 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:43.664231 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594dde9f-f511-46e6-9f0b-a634f974095c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:43.665016 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594dde9f-f511-46e6-9f0b-a634f974095c None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:43.665299 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594dde9f-f511-46e6-9f0b-a634f974095c None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:43.665657 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594dde9f-f511-46e6-9f0b-a634f974095c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:43.682686 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b87077-81ed-47a6-914d-dd9aba29522e None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:43.719577 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0a6a7-d7c2-430e-87d3-5622fcca4aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:43.720266 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0a6a7-d7c2-430e-87d3-5622fcca4aa0 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:43.720546 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0a6a7-d7c2-430e-87d3-5622fcca4aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:43.720817 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0a6a7-d7c2-430e-87d3-5622fcca4aa0 None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:43.721540 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0a6a7-d7c2-430e-87d3-5622fcca4aa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:43.721844 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0a6a7-d7c2-430e-87d3-5622fcca4aa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:43.723228 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0a6a7-d7c2-430e-87d3-5622fcca4aa0 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:43.740942 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 420/851] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:36:43.741840 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0a6a7-d7c2-430e-87d3-5622fcca4aa0 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:43.760415 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594dde9f-f511-46e6-9f0b-a634f974095c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:43.762635 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594dde9f-f511-46e6-9f0b-a634f974095c None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:43.810756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:43.850162 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0a6a7-d7c2-430e-87d3-5622fcca4aa0 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:43.874904 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 432/852] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:36:43 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:36:43.874904 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737b26f-b4cf-46e4-8424-bc50f504efa1 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:43.874904 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737b26f-b4cf-46e4-8424-bc50f504efa1 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:43.874904 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737b26f-b4cf-46e4-8424-bc50f504efa1 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:43.875707 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 433/853] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:43.876656 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737b26f-b4cf-46e4-8424-bc50f504efa1 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:43.882127 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:43.890484 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adeefd-cb9e-404f-9310-ffde4e3a8adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:43.895118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adeefd-cb9e-404f-9310-ffde4e3a8adc None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:43.895118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adeefd-cb9e-404f-9310-ffde4e3a8adc None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:43.895118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adeefd-cb9e-404f-9310-ffde4e3a8adc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:43.899104 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47adeefd-cb9e-404f-9310-ffde4e3a8adc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:43.900614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47adeefd-cb9e-404f-9310-ffde4e3a8adc None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:43.917070 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-47adeefd-cb9e-404f-9310-ffde4e3a8adc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:36:43.917070 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:43.917070 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:43.917070 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:43.917070 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:43.917070 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:43.917070 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:43.917070 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:43.917070 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:43.917070 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:43.917070 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:43.917070 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:43.917070 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:36:43.917070 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:36:43.917070 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:36:43.917070 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:36:43.918232 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:43.918232 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:43.918232 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:36:43.918232 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:43.918232 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:36:43.918232 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:43.918232 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:43.918232 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:43.918232 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:43.918232 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:43.918232 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:43.918232 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:43.918232 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:43.918232 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:43.918232 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:43.918232 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:43.918232 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:43.918232 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:43.919189 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:43.919189 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:43.919189 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:36:43.919189 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:36:43.919189 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:36:43.919189 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:36:43.919189 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:36:43.919189 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:36:43.919189 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:36:43.919189 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:43.919189 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 421/854] 10.222.0.39 () {56 vars in 1117 bytes} [Mon May 23 15:36:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:43.919869 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7236dc-8157-418c-a922-61c1e8ee8f42 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:43.920163 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7236dc-8157-418c-a922-61c1e8ee8f42 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:43.920441 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7236dc-8157-418c-a922-61c1e8ee8f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:43.939101 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-eb7236dc-8157-418c-a922-61c1e8ee8f42 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:43.940426 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-eb7236dc-8157-418c-a922-61c1e8ee8f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:43.996678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737b26f-b4cf-46e4-8424-bc50f504efa1 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:44.018517 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 422/855] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:36:44.019575 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7236dc-8157-418c-a922-61c1e8ee8f42 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:44.032348 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01953307-2a01-452a-9293-906e56d34361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:44.033212 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01953307-2a01-452a-9293-906e56d34361 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:44.033564 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01953307-2a01-452a-9293-906e56d34361 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:44.033912 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01953307-2a01-452a-9293-906e56d34361 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:44.044881 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01953307-2a01-452a-9293-906e56d34361 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:44.046343 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01953307-2a01-452a-9293-906e56d34361 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:44.048257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:44.065081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-01953307-2a01-452a-9293-906e56d34361 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:44.065081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:44.065081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:44.065081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:44.065081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:44.065081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:44.065081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:44.065081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:44.065081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:44.065081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:44.065081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:44.065081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:44.065081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:44.065081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:44.065081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:44.066021 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:44.066021 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:44.066021 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:44.066021 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:44.066021 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:44.066021 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:44.066021 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:44.066021 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:44.066021 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:44.066021 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:44.066021 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:44.066021 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:44.066021 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:44.066021 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:44.066021 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:44.066021 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:44.066021 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:44.066944 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:44.066944 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:44.066944 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:44.066944 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:44.068000 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 434/856] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:44.068550 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01953307-2a01-452a-9293-906e56d34361 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:44.131462 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7236dc-8157-418c-a922-61c1e8ee8f42 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:44.150343 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:44.168310 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d243eb-67ed-49e2-8c9b-8d4041340bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:44.168907 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d243eb-67ed-49e2-8c9b-8d4041340bb0 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:44.169192 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d243eb-67ed-49e2-8c9b-8d4041340bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:44.169462 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d243eb-67ed-49e2-8c9b-8d4041340bb0 None admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:44.170292 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d243eb-67ed-49e2-8c9b-8d4041340bb0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:44.170600 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d243eb-67ed-49e2-8c9b-8d4041340bb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:44.172155 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d243eb-67ed-49e2-8c9b-8d4041340bb0 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:44.180997 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01953307-2a01-452a-9293-906e56d34361 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:44.192173 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 423/857] 10.222.0.39 () {56 vars in 1149 bytes} [Mon May 23 15:36:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:44.197315 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d243eb-67ed-49e2-8c9b-8d4041340bb0 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:44.221652 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22893bef-660a-42fe-928a-05b460c653e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:44.222325 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22893bef-660a-42fe-928a-05b460c653e7 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:44.222677 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22893bef-660a-42fe-928a-05b460c653e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:44.223042 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22893bef-660a-42fe-928a-05b460c653e7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:44.223803 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22893bef-660a-42fe-928a-05b460c653e7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:44.225249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22893bef-660a-42fe-928a-05b460c653e7 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:44.239179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-22893bef-660a-42fe-928a-05b460c653e7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 15:36:44.239179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:44.239179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:36:44.239179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:36:44.239179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:36:44.239179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:36:44.239179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:36:44.239179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:36:44.239179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 15:36:44.239179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:44.239179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:36:44.239179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:44.239179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:44.239179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:44.239179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:44.239179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:44.240354 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:44.240354 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:44.240354 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:44.240354 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:44.240354 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:44.240354 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:44.240354 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:44.240354 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:36:44.240354 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:36:44.240354 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:36:44.240354 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:36:44.240354 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:44.240354 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:44.240354 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:44.240354 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:44.240354 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:44.241301 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:44.241301 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:44.241301 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:44.241301 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:44.241301 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:44.241301 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:44.241301 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:44.241301 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:44.241301 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:44.241301 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:44.241301 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:44.241301 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:36:44.241301 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:36:44.241301 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 15:36:44.241301 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:44.241301 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 435/858] 10.222.0.39 () {56 vars in 1132 bytes} [Mon May 23 15:36:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:44.242138 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22893bef-660a-42fe-928a-05b460c653e7 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:44.310106 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:44.314914 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d243eb-67ed-49e2-8c9b-8d4041340bb0 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:44.354031 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac76b78-a809-40aa-b245-6562fa6da0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:44.354673 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac76b78-a809-40aa-b245-6562fa6da0e3 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:44.355102 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac76b78-a809-40aa-b245-6562fa6da0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:44.355440 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac76b78-a809-40aa-b245-6562fa6da0e3 None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:44.355537 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22893bef-660a-42fe-928a-05b460c653e7 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:44.356226 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac76b78-a809-40aa-b245-6562fa6da0e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:44.356533 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac76b78-a809-40aa-b245-6562fa6da0e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:44.358161 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac76b78-a809-40aa-b245-6562fa6da0e3 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:44.370247 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 424/859] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:44.372479 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac76b78-a809-40aa-b245-6562fa6da0e3 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:44.394220 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d00c3d-08b8-4c72-a444-92fcd0f42658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:44.394878 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d00c3d-08b8-4c72-a444-92fcd0f42658 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:44.395162 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d00c3d-08b8-4c72-a444-92fcd0f42658 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:44.395440 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d00c3d-08b8-4c72-a444-92fcd0f42658 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:44.419491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:44.468724 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d00c3d-08b8-4c72-a444-92fcd0f42658 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:44.470176 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d00c3d-08b8-4c72-a444-92fcd0f42658 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:44.491337 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac76b78-a809-40aa-b245-6562fa6da0e3 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:44.526699 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f9988-c4f0-43b0-9fea-b6b934863f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:44.527369 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f9988-c4f0-43b0-9fea-b6b934863f88 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:44.527678 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f9988-c4f0-43b0-9fea-b6b934863f88 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:44.527959 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f9988-c4f0-43b0-9fea-b6b934863f88 None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:44.528990 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f9988-c4f0-43b0-9fea-b6b934863f88 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:44.529302 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f9988-c4f0-43b0-9fea-b6b934863f88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:44.530682 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f9988-c4f0-43b0-9fea-b6b934863f88 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:44.531361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:44.536088 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 425/860] 10.222.0.39 () {56 vars in 1126 bytes} [Mon May 23 15:36:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:44.536889 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f9988-c4f0-43b0-9fea-b6b934863f88 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:44.586357 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 436/861] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:36:44 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:36:44.586357 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d00c3d-08b8-4c72-a444-92fcd0f42658 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:44.642395 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:44.645599 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f9988-c4f0-43b0-9fea-b6b934863f88 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:44.681702 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d3f90-be14-4504-a6fa-1e3a56c5cd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:44.683010 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d3f90-be14-4504-a6fa-1e3a56c5cd99 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:44.683359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d3f90-be14-4504-a6fa-1e3a56c5cd99 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:44.683733 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d3f90-be14-4504-a6fa-1e3a56c5cd99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:44.691196 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d3f90-be14-4504-a6fa-1e3a56c5cd99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:44.692790 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d3f90-be14-4504-a6fa-1e3a56c5cd99 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:44.693558 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d00c3d-08b8-4c72-a444-92fcd0f42658 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:44.708036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-f86d3f90-be14-4504-a6fa-1e3a56c5cd99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:44.708036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:44.708036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:44.708036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:44.708036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:44.708036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:44.708036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:44.708036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:44.708036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:44.708036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:44.708036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:44.708036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:44.708036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:36:44.708036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:36:44.708036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:36:44.709151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:36:44.709151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:44.709151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:44.709151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:44.709151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:44.709151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:44.709151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:44.709151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:44.709151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:44.709151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:44.709151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:44.709151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:44.709151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:44.709151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:44.709151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:44.709151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:44.709151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:44.715436 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:36:44.715436 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:36:44.715436 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:36:44.715436 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:36:44.715436 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:36:44.715436 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:36:44.715436 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:44.715436 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:44.715436 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 426/862] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:36:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:44.715436 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d3f90-be14-4504-a6fa-1e3a56c5cd99 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:44.739527 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4537c3dc-6473-4e77-98bb-faf2be974c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:44.740289 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537c3dc-6473-4e77-98bb-faf2be974c42 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:44.740641 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537c3dc-6473-4e77-98bb-faf2be974c42 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:44.740993 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537c3dc-6473-4e77-98bb-faf2be974c42 None admin] PATH_INFO: `/v3/services` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:44.741795 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4537c3dc-6473-4e77-98bb-faf2be974c42 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:44.742198 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4537c3dc-6473-4e77-98bb-faf2be974c42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:44.743675 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4537c3dc-6473-4e77-98bb-faf2be974c42 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:44.748435 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 437/863] 10.222.0.39 () {56 vars in 1126 bytes} [Mon May 23 15:36:44 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:44.760706 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4537c3dc-6473-4e77-98bb-faf2be974c42 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:44.800559 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:44.827991 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d3f90-be14-4504-a6fa-1e3a56c5cd99 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:44.874085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f479ad6-87bd-4122-9335-68af6db82d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:44.875007 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f479ad6-87bd-4122-9335-68af6db82d92 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:44.875184 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f479ad6-87bd-4122-9335-68af6db82d92 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:44.875460 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f479ad6-87bd-4122-9335-68af6db82d92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:44.885238 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4537c3dc-6473-4e77-98bb-faf2be974c42 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:44.887093 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f479ad6-87bd-4122-9335-68af6db82d92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:44.888614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f479ad6-87bd-4122-9335-68af6db82d92 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:44.907583 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-5f479ad6-87bd-4122-9335-68af6db82d92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:44.907583 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:44.907583 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:44.907583 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:44.907583 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:44.907583 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:44.907583 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:44.907583 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:44.907583 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:44.907583 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:44.907583 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:44.907583 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:44.907583 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:44.907583 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:44.907583 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:44.908787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:44.908787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:44.908787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:44.908787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:44.908787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:44.908787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:44.908787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:44.908787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:44.908787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:44.908787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:44.908787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:44.908787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:44.908787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:44.908787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:44.908787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:44.908787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:44.908787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:44.909917 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:44.909917 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:44.909917 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:44.909917 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:44.913758 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 427/864] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:44.915118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858734a-5a1c-4e76-afef-f09f395980ef None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:44.915417 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858734a-5a1c-4e76-afef-f09f395980ef None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:44.915750 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858734a-5a1c-4e76-afef-f09f395980ef None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:44.919659 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 428/865] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:44.919659 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858734a-5a1c-4e76-afef-f09f395980ef None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:44.932394 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d43b4c-72fc-42a2-ace7-ad4de3d9f7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:44.933445 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d43b4c-72fc-42a2-ace7-ad4de3d9f7be None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:44.933904 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d43b4c-72fc-42a2-ace7-ad4de3d9f7be None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:44.934188 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d43b4c-72fc-42a2-ace7-ad4de3d9f7be None admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:44.934975 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d43b4c-72fc-42a2-ace7-ad4de3d9f7be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:44.935278 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d43b4c-72fc-42a2-ace7-ad4de3d9f7be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:44.936653 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:44.936786 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d43b4c-72fc-42a2-ace7-ad4de3d9f7be None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:44.951134 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 438/866] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:36:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:44.952736 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857baa2-6958-4a3e-891e-341a3cdb1c3f None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:44.952736 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857baa2-6958-4a3e-891e-341a3cdb1c3f None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:44.952933 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857baa2-6958-4a3e-891e-341a3cdb1c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:44.971284 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-1857baa2-6958-4a3e-891e-341a3cdb1c3f None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:44.972502 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-1857baa2-6958-4a3e-891e-341a3cdb1c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:45.034103 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858734a-5a1c-4e76-afef-f09f395980ef None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:45.050720 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 439/867] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:36:45.057483 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857baa2-6958-4a3e-891e-341a3cdb1c3f None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:45.071435 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268f425-0ba3-4851-9b10-f6b6c25cf63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:45.072141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268f425-0ba3-4851-9b10-f6b6c25cf63e None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:45.073039 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268f425-0ba3-4851-9b10-f6b6c25cf63e None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:45.073326 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268f425-0ba3-4851-9b10-f6b6c25cf63e None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:45.074178 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268f425-0ba3-4851-9b10-f6b6c25cf63e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:45.074460 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268f425-0ba3-4851-9b10-f6b6c25cf63e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:45.075970 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268f425-0ba3-4851-9b10-f6b6c25cf63e None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:45.076659 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:45.088815 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 429/868] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:45.089629 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268f425-0ba3-4851-9b10-f6b6c25cf63e None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:45.166788 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:45.176987 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857baa2-6958-4a3e-891e-341a3cdb1c3f None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:45.199862 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268f425-0ba3-4851-9b10-f6b6c25cf63e None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:45.216212 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9ffbb-e598-49a6-b736-c722d2d27296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:45.217180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9ffbb-e598-49a6-b736-c722d2d27296 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:45.217854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9ffbb-e598-49a6-b736-c722d2d27296 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:45.218142 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9ffbb-e598-49a6-b736-c722d2d27296 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:45.218975 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9ffbb-e598-49a6-b736-c722d2d27296 None admin] RBAC: Adding query filter params (role.id=3ab888f5f68740bd8f9df4447f4f5a7a, scope.project.id=8addb03b903842609168ee2fafc8ec6b, user.id=b275a110936a44ce8d54793af1a34808) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:45.219286 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9ffbb-e598-49a6-b736-c722d2d27296 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:45.220802 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9ffbb-e598-49a6-b736-c722d2d27296 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:45.235633 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 440/869] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:36:45 2022] GET /identity/v3/role_assignments?user.id=b275a110936a44ce8d54793af1a34808&scope.project.id=8addb03b903842609168ee2fafc8ec6b&role.id=3ab888f5f68740bd8f9df4447f4f5a7a => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:45.235633 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9ffbb-e598-49a6-b736-c722d2d27296 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:45.259497 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba2664-df07-4038-8905-22350d06ca4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:45.260774 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba2664-df07-4038-8905-22350d06ca4f None admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:45.261063 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba2664-df07-4038-8905-22350d06ca4f None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:45.261897 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba2664-df07-4038-8905-22350d06ca4f None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:45.262968 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba2664-df07-4038-8905-22350d06ca4f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:45.265251 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba2664-df07-4038-8905-22350d06ca4f None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:45.324185 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:45.350528 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9ffbb-e598-49a6-b736-c722d2d27296 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:45.368462 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 430/870] 10.222.0.39 () {60 vars in 1141 bytes} [Mon May 23 15:36:45 2022] POST /identity/v3/services => generated 251 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:36:45.409586 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bfd11f-9d33-4305-90f0-8c421f064c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:45.410829 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfd11f-9d33-4305-90f0-8c421f064c0d None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:45.411371 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfd11f-9d33-4305-90f0-8c421f064c0d None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:45.411892 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfd11f-9d33-4305-90f0-8c421f064c0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:45.420910 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bfd11f-9d33-4305-90f0-8c421f064c0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:45.422943 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bfd11f-9d33-4305-90f0-8c421f064c0d None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:45.440355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-35bfd11f-9d33-4305-90f0-8c421f064c0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:45.440355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:45.440355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:45.440355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:45.440355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:45.440355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:45.440355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:45.440355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:45.440355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:45.440355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:45.440355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:45.440355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:45.440355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:36:45.440355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:36:45.440355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:36:45.441324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:36:45.441324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:45.441324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:45.441324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:45.441324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:45.441324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:45.441324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:45.441324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:45.441324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:45.441324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:45.441324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:45.441324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:45.441324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:45.441324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:45.441324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:45.441324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:45.441324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:45.442269 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:36:45.442269 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:36:45.442269 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:36:45.442269 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:36:45.442269 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:36:45.442269 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:36:45.442269 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:45.442269 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:45.444032 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 441/871] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:36:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:45.450031 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba2664-df07-4038-8905-22350d06ca4f None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:45.564322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba2664-df07-4038-8905-22350d06ca4f None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:45.595899 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:45.601847 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b767c-f6b0-4fab-a15c-c7b21023acc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:45.602516 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b767c-f6b0-4fab-a15c-c7b21023acc3 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:45.602890 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b767c-f6b0-4fab-a15c-c7b21023acc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:45.603169 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b767c-f6b0-4fab-a15c-c7b21023acc3 None admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:45.604107 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b767c-f6b0-4fab-a15c-c7b21023acc3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:45.608038 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b767c-f6b0-4fab-a15c-c7b21023acc3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:45.608038 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b767c-f6b0-4fab-a15c-c7b21023acc3 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:45.619744 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 431/872] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:36:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:36:45.625485 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bfd11f-9d33-4305-90f0-8c421f064c0d None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:45.734408 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bfd11f-9d33-4305-90f0-8c421f064c0d None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:45.766146 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:45.771807 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c9afd-d385-4a7f-bcfb-9de445400e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:45.772468 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c9afd-d385-4a7f-bcfb-9de445400e71 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:45.772752 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c9afd-d385-4a7f-bcfb-9de445400e71 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:45.773027 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c9afd-d385-4a7f-bcfb-9de445400e71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:45.773860 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c9afd-d385-4a7f-bcfb-9de445400e71 None admin] RBAC: Adding query filter params (role.id=b57c4ebab8e842088df37b551053b113, scope.project.id=8addb03b903842609168ee2fafc8ec6b, user.id=048fc48dd55a43f7b342533a9484c3ad) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:45.774294 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c9afd-d385-4a7f-bcfb-9de445400e71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:45.776354 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c9afd-d385-4a7f-bcfb-9de445400e71 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:45.782942 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 442/873] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:36:45 2022] GET /identity/v3/role_assignments?user.id=048fc48dd55a43f7b342533a9484c3ad&scope.project.id=8addb03b903842609168ee2fafc8ec6b&role.id=b57c4ebab8e842088df37b551053b113 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:47.007319 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e409cbc-f386-4b19-abbc-951ece826248 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:47.007975 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e409cbc-f386-4b19-abbc-951ece826248 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:47.007975 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e409cbc-f386-4b19-abbc-951ece826248 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:47.009524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 432/874] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:47.015103 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d5430-60c3-4bb9-be13-942c25e30913 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:47.015521 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d5430-60c3-4bb9-be13-942c25e30913 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:47.015738 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d5430-60c3-4bb9-be13-942c25e30913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:47.033685 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-2f9d5430-60c3-4bb9-be13-942c25e30913 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:47.034875 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-2f9d5430-60c3-4bb9-be13-942c25e30913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:47.115714 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 443/875] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:47 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:36:47.131620 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e409cbc-f386-4b19-abbc-951ece826248 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:47.244643 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e409cbc-f386-4b19-abbc-951ece826248 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:47.281456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f89158-0373-454e-93ba-235517566ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:47.282040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f89158-0373-454e-93ba-235517566ac5 None admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:47.282323 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f89158-0373-454e-93ba-235517566ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:47.282599 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f89158-0373-454e-93ba-235517566ac5 None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:47.283318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f89158-0373-454e-93ba-235517566ac5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:47.284743 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f89158-0373-454e-93ba-235517566ac5 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:47.367762 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 433/876] 10.222.0.39 () {60 vars in 1141 bytes} [Mon May 23 15:36:47 2022] POST /identity/v3/services => generated 269 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:36:47.519756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3af7c7-bd19-42bb-a208-f57cb7c0de23 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:47.520161 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3af7c7-bd19-42bb-a208-f57cb7c0de23 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:47.520341 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3af7c7-bd19-42bb-a208-f57cb7c0de23 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:47.522138 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 444/877] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:47.528450 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc06403-94fb-46e0-9cb6-d4afa772bc33 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:47.528744 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc06403-94fb-46e0-9cb6-d4afa772bc33 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:47.529012 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc06403-94fb-46e0-9cb6-d4afa772bc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:47.548074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-ccc06403-94fb-46e0-9cb6-d4afa772bc33 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:47.549273 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-ccc06403-94fb-46e0-9cb6-d4afa772bc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:47.601841 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:47.629597 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 434/878] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:47 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:36:47.653343 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3af7c7-bd19-42bb-a208-f57cb7c0de23 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:47.679679 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8039c08-1f6a-41f2-acb1-058d41462914 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:47.679986 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8039c08-1f6a-41f2-acb1-058d41462914 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:47.680245 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8039c08-1f6a-41f2-acb1-058d41462914 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:47.682574 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 435/879] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:47.687975 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d63d6-8bed-4109-b9f8-b6a3ad91c3b6 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:47.688262 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d63d6-8bed-4109-b9f8-b6a3ad91c3b6 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:47.688546 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d63d6-8bed-4109-b9f8-b6a3ad91c3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:47.710350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-541d63d6-8bed-4109-b9f8-b6a3ad91c3b6 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:47.711730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-541d63d6-8bed-4109-b9f8-b6a3ad91c3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:47.767542 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3af7c7-bd19-42bb-a208-f57cb7c0de23 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:47.796987 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 436/880] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:47 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:36:47.804168 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:47.814060 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c0190-f9c9-4b7f-b7a7-d48b83c1323a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:47.815135 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c0190-f9c9-4b7f-b7a7-d48b83c1323a None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:47.815585 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c0190-f9c9-4b7f-b7a7-d48b83c1323a None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:47.818792 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c0190-f9c9-4b7f-b7a7-d48b83c1323a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:47.818792 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c0190-f9c9-4b7f-b7a7-d48b83c1323a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:47.818792 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c0190-f9c9-4b7f-b7a7-d48b83c1323a None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:47.820198 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d63d6-8bed-4109-b9f8-b6a3ad91c3b6 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:47.833125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-315c0190-f9c9-4b7f-b7a7-d48b83c1323a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:36:47.833125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:47.833125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:36:47.833125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:36:47.833125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:36:47.833125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:36:47.833125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:36:47.833125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:36:47.833125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:36:47.833125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:47.833125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:36:47.833125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:47.833125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:47.833125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:47.833125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:47.833125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:47.833125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:47.834345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:47.834345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:47.834345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:47.834345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:47.834345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:47.834345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:47.834345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:36:47.834345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:36:47.834345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:36:47.834345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:36:47.834345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:47.834345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:47.834345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:47.834345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:47.834345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:47.834345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:47.835499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:47.835499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:47.835499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:47.835499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:47.835499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:47.835499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:47.835499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:47.835499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:47.835499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:47.835499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:47.835499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:36:47.835499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:36:47.835499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:36:47.835499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:47.835499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 445/881] 10.222.0.39 () {56 vars in 1126 bytes} [Mon May 23 15:36:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:47.840119 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c0190-f9c9-4b7f-b7a7-d48b83c1323a None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:47.935287 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d63d6-8bed-4109-b9f8-b6a3ad91c3b6 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:47.945908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:47.976478 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b09c6-f4de-4df8-b76b-17eade2b96a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:47.977709 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b09c6-f4de-4df8-b76b-17eade2b96a4 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:47.978203 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b09c6-f4de-4df8-b76b-17eade2b96a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:47.979835 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b09c6-f4de-4df8-b76b-17eade2b96a4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:47.980801 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b09c6-f4de-4df8-b76b-17eade2b96a4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:47.982773 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b09c6-f4de-4df8-b76b-17eade2b96a4 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:47.983788 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c0190-f9c9-4b7f-b7a7-d48b83c1323a None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:48.004343 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-776b09c6-f4de-4df8-b76b-17eade2b96a4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 15:36:48.004343 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:48.004343 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:36:48.004343 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:36:48.004343 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:36:48.004343 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:36:48.004343 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:36:48.004343 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:36:48.004343 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 15:36:48.004343 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:48.004343 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:36:48.004343 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:48.004343 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:48.004343 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:48.004343 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:48.004343 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:48.004343 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:48.005394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:48.005394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:48.005394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:48.005394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:48.005394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:48.005394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:48.005394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:36:48.005394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:36:48.005394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:36:48.005394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:36:48.005394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:48.005394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:48.005394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:48.005394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:48.005394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:48.005394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:48.006829 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:48.006829 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:48.006829 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:48.006829 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:48.006829 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:48.006829 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:48.006829 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:48.006829 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:48.006829 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:48.006829 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:48.006829 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:36:48.006829 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:36:48.006829 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 15:36:48.006829 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:48.006829 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 437/882] 10.222.0.39 () {56 vars in 1114 bytes} [Mon May 23 15:36:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:36:48.013569 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b09c6-f4de-4df8-b76b-17eade2b96a4 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:48.029649 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56467d-9409-4f94-893a-b0ce60c56165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:48.031260 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56467d-9409-4f94-893a-b0ce60c56165 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:48.032250 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56467d-9409-4f94-893a-b0ce60c56165 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:48.032865 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56467d-9409-4f94-893a-b0ce60c56165 None admin] PATH_INFO: `/v3/services` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:48.033859 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56467d-9409-4f94-893a-b0ce60c56165 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:48.034588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56467d-9409-4f94-893a-b0ce60c56165 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:48.036549 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56467d-9409-4f94-893a-b0ce60c56165 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:48.044716 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 446/883] 10.222.0.39 () {56 vars in 1122 bytes} [Mon May 23 15:36:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:36:48.057501 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56467d-9409-4f94-893a-b0ce60c56165 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:48.115762 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:48.140223 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b09c6-f4de-4df8-b76b-17eade2b96a4 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:48.163740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56467d-9409-4f94-893a-b0ce60c56165 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:48.185962 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541de512-f74d-4f04-9e20-4aecacc5f5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:48.186638 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541de512-f74d-4f04-9e20-4aecacc5f5a9 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:48.186924 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541de512-f74d-4f04-9e20-4aecacc5f5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:48.187257 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541de512-f74d-4f04-9e20-4aecacc5f5a9 None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:48.188001 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541de512-f74d-4f04-9e20-4aecacc5f5a9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:48.188310 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541de512-f74d-4f04-9e20-4aecacc5f5a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:48.189692 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541de512-f74d-4f04-9e20-4aecacc5f5a9 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:48.207651 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 438/884] 10.222.0.39 () {56 vars in 1114 bytes} [Mon May 23 15:36:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:36:48.207862 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cacc79f-6b6b-4e7d-a527-cac68fe88ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:48.207862 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cacc79f-6b6b-4e7d-a527-cac68fe88ae9 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:48.208066 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083714f-d190-4087-a287-2fa951c32d3c None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:48.208154 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cacc79f-6b6b-4e7d-a527-cac68fe88ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:48.208237 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083714f-d190-4087-a287-2fa951c32d3c None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:48.208319 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cacc79f-6b6b-4e7d-a527-cac68fe88ae9 None admin] PATH_INFO: `/v3/services` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:48.208400 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083714f-d190-4087-a287-2fa951c32d3c None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:48.208489 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cacc79f-6b6b-4e7d-a527-cac68fe88ae9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:48.208489 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cacc79f-6b6b-4e7d-a527-cac68fe88ae9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:48.208639 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 439/885] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:48.208719 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cacc79f-6b6b-4e7d-a527-cac68fe88ae9 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:48.208806 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083714f-d190-4087-a287-2fa951c32d3c None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:48.223638 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 447/886] 10.222.0.39 () {56 vars in 1122 bytes} [Mon May 23 15:36:48 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:36:48.223638 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53473ed6-6917-463a-9515-896386e1b635 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:48.223638 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53473ed6-6917-463a-9515-896386e1b635 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:48.223638 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53473ed6-6917-463a-9515-896386e1b635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:48.248416 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-53473ed6-6917-463a-9515-896386e1b635 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:48.249765 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-53473ed6-6917-463a-9515-896386e1b635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:48.252449 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:48.340673 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083714f-d190-4087-a287-2fa951c32d3c None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:48.345284 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 448/887] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:48 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:36:48.376266 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53473ed6-6917-463a-9515-896386e1b635 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:48.388808 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b98c66-9b9c-4cf5-93f8-5e985d6c90f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:48.389911 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b98c66-9b9c-4cf5-93f8-5e985d6c90f5 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:48.390397 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b98c66-9b9c-4cf5-93f8-5e985d6c90f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:48.390966 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b98c66-9b9c-4cf5-93f8-5e985d6c90f5 None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:48.391916 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b98c66-9b9c-4cf5-93f8-5e985d6c90f5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:48.392448 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b98c66-9b9c-4cf5-93f8-5e985d6c90f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:48.394163 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b98c66-9b9c-4cf5-93f8-5e985d6c90f5 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:48.401017 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 440/888] 10.222.0.39 () {56 vars in 1114 bytes} [Mon May 23 15:36:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:36:48.406569 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b98c66-9b9c-4cf5-93f8-5e985d6c90f5 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:48.438004 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:48.497205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53473ed6-6917-463a-9515-896386e1b635 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:48.526464 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:48.530007 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b98c66-9b9c-4cf5-93f8-5e985d6c90f5 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:48.543327 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061aab1-eb55-4f8a-942f-9fe66a9c4cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:48.544803 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061aab1-eb55-4f8a-942f-9fe66a9c4cd8 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:48.545518 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061aab1-eb55-4f8a-942f-9fe66a9c4cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:48.545972 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061aab1-eb55-4f8a-942f-9fe66a9c4cd8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:48.562547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061aab1-eb55-4f8a-942f-9fe66a9c4cd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:36:48.567197 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9c708-9f33-44fe-8d1d-16586bd0f65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:48.568054 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9c708-9f33-44fe-8d1d-16586bd0f65a None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:48.568449 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9c708-9f33-44fe-8d1d-16586bd0f65a None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:48.568820 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9c708-9f33-44fe-8d1d-16586bd0f65a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:48.569714 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9c708-9f33-44fe-8d1d-16586bd0f65a None admin] RBAC: Adding query filter params (interface=public, service_id=fdd93420e20b49d0a4ed25c957a7aa4a, region_id=RegionOne) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:48.570121 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9c708-9f33-44fe-8d1d-16586bd0f65a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:48.571579 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9c708-9f33-44fe-8d1d-16586bd0f65a None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:48.574053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-8061aab1-eb55-4f8a-942f-9fe66a9c4cd8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:36:48.574053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:48.574053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:48.574053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:48.574053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:48.574053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:48.574053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:48.574053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:48.574053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:48.574053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:48.574053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:48.574053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:48.574053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:36:48.574053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:36:48.574053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:36:48.574053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:36:48.575164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:36:48.575164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:36:48.575164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:36:48.575164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:36:48.575164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:48.575164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:48.575164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:48.575164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:48.575164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:48.575164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:48.575164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:48.575164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:48.575164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:48.575164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:48.575164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:48.575164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:48.576244 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:48.576244 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:48.576244 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:48.576244 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:48.576244 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:36:48.576244 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:36:48.576244 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:36:48.576244 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:36:48.576244 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:36:48.576244 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:36:48.576244 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:36:48.576244 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:48.584300 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 441/890] 10.222.0.39 () {56 vars in 1251 bytes} [Mon May 23 15:36:48 2022] GET /identity/v3/endpoints?service_id=fdd93420e20b49d0a4ed25c957a7aa4a&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:48.584455 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 449/890] 10.222.0.39 () {56 vars in 1120 bytes} [Mon May 23 15:36:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:36:48.585734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9c708-9f33-44fe-8d1d-16586bd0f65a None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:48.585995 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061aab1-eb55-4f8a-942f-9fe66a9c4cd8 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:48.698571 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9c708-9f33-44fe-8d1d-16586bd0f65a None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:48.727476 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061aab1-eb55-4f8a-942f-9fe66a9c4cd8 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:48.737033 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a6cb7-34e6-4a9e-a7b4-c76ca4ae1215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:48.737708 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a6cb7-34e6-4a9e-a7b4-c76ca4ae1215 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:48.737991 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a6cb7-34e6-4a9e-a7b4-c76ca4ae1215 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:48.738277 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a6cb7-34e6-4a9e-a7b4-c76ca4ae1215 None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:48.739283 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a6cb7-34e6-4a9e-a7b4-c76ca4ae1215 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:48.743712 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a6cb7-34e6-4a9e-a7b4-c76ca4ae1215 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:48.744931 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:48.752129 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 442/891] 10.222.0.39 () {56 vars in 1087 bytes} [Mon May 23 15:36:48 2022] GET /identity/v3/services => generated 1268 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:36:48.782624 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9080a-f41b-413b-a2ce-acd468e12c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:48.787209 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9080a-f41b-413b-a2ce-acd468e12c26 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:48.787209 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9080a-f41b-413b-a2ce-acd468e12c26 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:48.787209 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9080a-f41b-413b-a2ce-acd468e12c26 None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:48.787209 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9080a-f41b-413b-a2ce-acd468e12c26 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:48.787209 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9080a-f41b-413b-a2ce-acd468e12c26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:48.787209 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9080a-f41b-413b-a2ce-acd468e12c26 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:48.797615 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 450/892] 10.222.0.39 () {56 vars in 1115 bytes} [Mon May 23 15:36:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:36:48.803026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a6cb7-34e6-4a9e-a7b4-c76ca4ae1215 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:48.835587 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:48.920634 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a6cb7-34e6-4a9e-a7b4-c76ca4ae1215 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:48.959666 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266e852-92bd-4f35-adc6-6e9c3db56ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:48.960388 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266e852-92bd-4f35-adc6-6e9c3db56ce6 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:48.960672 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266e852-92bd-4f35-adc6-6e9c3db56ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:48.960948 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266e852-92bd-4f35-adc6-6e9c3db56ce6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:48.974265 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266e852-92bd-4f35-adc6-6e9c3db56ce6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:48.975778 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266e852-92bd-4f35-adc6-6e9c3db56ce6 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:48.996888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-5266e852-92bd-4f35-adc6-6e9c3db56ce6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:48.996888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:48.996888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:48.996888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:48.996888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:48.996888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:48.996888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:48.996888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:48.996888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:48.996888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:48.996888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:48.996888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:48.996888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:48.996888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:48.996888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:48.997888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:48.997888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:48.997888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:48.997888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:48.997888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:48.997888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:48.997888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:48.997888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:48.997888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:48.997888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:48.997888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:48.997888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:48.997888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:48.997888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:48.997888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:48.997888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:48.997888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:48.998841 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:48.998841 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:48.998841 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:48.998841 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:48.998841 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 443/893] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:36:49.004997 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9080a-f41b-413b-a2ce-acd468e12c26 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:49.123831 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9080a-f41b-413b-a2ce-acd468e12c26 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:49.161994 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7d59d-22bf-4577-b363-d98b4fc9bd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:49.162670 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7d59d-22bf-4577-b363-d98b4fc9bd02 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:49.162998 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7d59d-22bf-4577-b363-d98b4fc9bd02 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:49.163474 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7d59d-22bf-4577-b363-d98b4fc9bd02 None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:49.164496 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7d59d-22bf-4577-b363-d98b4fc9bd02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:49.170147 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7d59d-22bf-4577-b363-d98b4fc9bd02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:49.170147 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7d59d-22bf-4577-b363-d98b4fc9bd02 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:49.187042 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 451/894] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:49.188659 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266e852-92bd-4f35-adc6-6e9c3db56ce6 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:49.287149 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:49.308417 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266e852-92bd-4f35-adc6-6e9c3db56ce6 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:49.345772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb5342-b27b-41e4-bfb3-a04368322979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:49.346645 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb5342-b27b-41e4-bfb3-a04368322979 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:49.346928 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb5342-b27b-41e4-bfb3-a04368322979 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:49.347262 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb5342-b27b-41e4-bfb3-a04368322979 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:49.356006 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb5342-b27b-41e4-bfb3-a04368322979 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:49.357729 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb5342-b27b-41e4-bfb3-a04368322979 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:49.374159 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-decb5342-b27b-41e4-bfb3-a04368322979 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:36:49.374159 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:49.374159 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:49.374159 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:49.374159 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:49.374159 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:49.374159 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:49.374159 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:49.374159 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:49.374159 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:49.374159 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:49.374159 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:49.374159 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:36:49.374159 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:36:49.374159 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:36:49.374159 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:36:49.375186 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:49.375186 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:49.375186 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:36:49.375186 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:49.375186 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:36:49.375186 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:49.375186 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:49.375186 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:49.375186 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:49.375186 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:49.375186 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:49.375186 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:49.375186 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:49.375186 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:49.375186 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:49.375186 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:49.375186 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:49.375186 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:49.376779 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:49.376779 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:49.376779 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:36:49.376779 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:36:49.376779 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:36:49.376779 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:36:49.376779 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:36:49.376779 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:36:49.376779 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:36:49.376779 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:49.376779 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 444/895] 10.222.0.39 () {56 vars in 1117 bytes} [Mon May 23 15:36:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:49.381438 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7d59d-22bf-4577-b363-d98b4fc9bd02 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:49.415485 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:49.501070 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7d59d-22bf-4577-b363-d98b4fc9bd02 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:49.542411 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf1394-7bfb-4011-9f6a-da513d1b4f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:49.543097 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf1394-7bfb-4011-9f6a-da513d1b4f9a None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:49.543384 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf1394-7bfb-4011-9f6a-da513d1b4f9a None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:49.543681 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf1394-7bfb-4011-9f6a-da513d1b4f9a None admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:49.544543 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf1394-7bfb-4011-9f6a-da513d1b4f9a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:49.544856 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf1394-7bfb-4011-9f6a-da513d1b4f9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:49.546339 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf1394-7bfb-4011-9f6a-da513d1b4f9a None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:49.571762 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 452/896] 10.222.0.39 () {56 vars in 1149 bytes} [Mon May 23 15:36:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:49.575454 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb5342-b27b-41e4-bfb3-a04368322979 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:49.689210 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb5342-b27b-41e4-bfb3-a04368322979 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:49.725344 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9f591-8ef7-4fe6-be9d-2eea50687088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:49.726053 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9f591-8ef7-4fe6-be9d-2eea50687088 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:49.726330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9f591-8ef7-4fe6-be9d-2eea50687088 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:49.726611 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9f591-8ef7-4fe6-be9d-2eea50687088 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:49.737950 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:49.762169 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310f511-42ad-460b-97b9-0ead562bde19 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:49.762351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310f511-42ad-460b-97b9-0ead562bde19 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:49.762638 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310f511-42ad-460b-97b9-0ead562bde19 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:49.764313 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 453/897] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:49.770890 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173e53f-ffe2-4d30-9bbd-2fe21209f9c5 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:49.771434 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173e53f-ffe2-4d30-9bbd-2fe21209f9c5 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:49.771961 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173e53f-ffe2-4d30-9bbd-2fe21209f9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:49.788809 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-5173e53f-ffe2-4d30-9bbd-2fe21209f9c5 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:49.790313 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-5173e53f-ffe2-4d30-9bbd-2fe21209f9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:49.808101 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb9f591-8ef7-4fe6-be9d-2eea50687088 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:49.809920 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb9f591-8ef7-4fe6-be9d-2eea50687088 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:49.871621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 454/898] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:49 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:36:49.886655 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173e53f-ffe2-4d30-9bbd-2fe21209f9c5 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:49.907355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:49.929395 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 445/899] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:36:49 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:36:49.941089 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9f591-8ef7-4fe6-be9d-2eea50687088 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:49.983755 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:50.007968 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173e53f-ffe2-4d30-9bbd-2fe21209f9c5 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:50.046852 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676b0ea-bac4-4cf9-8f93-276ce984c258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:50.047946 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676b0ea-bac4-4cf9-8f93-276ce984c258 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:50.048397 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676b0ea-bac4-4cf9-8f93-276ce984c258 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:50.048841 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676b0ea-bac4-4cf9-8f93-276ce984c258 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:50.049645 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676b0ea-bac4-4cf9-8f93-276ce984c258 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:50.051169 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676b0ea-bac4-4cf9-8f93-276ce984c258 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:50.062924 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9f591-8ef7-4fe6-be9d-2eea50687088 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:50.064805 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-7676b0ea-bac4-4cf9-8f93-276ce984c258 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 15:36:50.064805 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:50.064805 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:36:50.064805 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:36:50.064805 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:36:50.064805 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:36:50.064805 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:36:50.064805 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:36:50.064805 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 15:36:50.064805 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:50.064805 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:36:50.064805 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:50.064805 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:50.064805 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:50.064805 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:50.064805 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:50.065997 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:50.065997 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:50.065997 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:50.065997 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:50.065997 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:50.065997 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:50.065997 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:50.065997 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:36:50.065997 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:36:50.065997 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:36:50.065997 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:36:50.065997 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:50.065997 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:50.065997 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:50.065997 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:50.065997 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:50.067062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:50.067062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:50.067062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:50.067062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:50.067062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:50.067062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:50.067062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:50.067062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:50.067062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:50.067062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:50.067062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:50.067062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:36:50.067062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:36:50.067062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 15:36:50.067062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:50.069661 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 455/900] 10.222.0.39 () {56 vars in 1132 bytes} [Mon May 23 15:36:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:36:50.079657 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676b0ea-bac4-4cf9-8f93-276ce984c258 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:50.107620 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64a869-979c-405d-ae79-d0e6175eb6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:50.108675 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64a869-979c-405d-ae79-d0e6175eb6f0 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:50.108965 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64a869-979c-405d-ae79-d0e6175eb6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:50.109243 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64a869-979c-405d-ae79-d0e6175eb6f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:50.123892 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64a869-979c-405d-ae79-d0e6175eb6f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:50.125369 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64a869-979c-405d-ae79-d0e6175eb6f0 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:50.150040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-2d64a869-979c-405d-ae79-d0e6175eb6f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:50.150040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:50.150040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:50.150040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:50.150040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:50.150040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:50.150040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:50.150040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:50.150040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:50.150040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:50.150040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:50.150040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:50.150040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:50.150040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:50.150040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:50.151013 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:50.151013 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:50.151013 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:50.151013 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:50.151013 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:50.151013 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:50.151013 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:50.151013 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:50.151013 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:50.151013 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:50.151013 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:50.151013 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:50.151013 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:50.151013 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:50.151013 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:50.151013 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:50.151013 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:50.151930 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:50.151930 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:50.151930 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:50.151930 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:50.151930 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 446/901] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:50.160596 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64a869-979c-405d-ae79-d0e6175eb6f0 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:50.177819 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:50.204738 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676b0ea-bac4-4cf9-8f93-276ce984c258 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:50.248584 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f47f1f-da27-4aba-a53b-256b2e7c3698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:50.249525 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f47f1f-da27-4aba-a53b-256b2e7c3698 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:50.249923 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f47f1f-da27-4aba-a53b-256b2e7c3698 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:50.250296 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f47f1f-da27-4aba-a53b-256b2e7c3698 None admin] PATH_INFO: `/v3/services` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:50.251210 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f47f1f-da27-4aba-a53b-256b2e7c3698 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:50.251584 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f47f1f-da27-4aba-a53b-256b2e7c3698 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:50.253025 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f47f1f-da27-4aba-a53b-256b2e7c3698 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:50.263660 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 456/902] 10.222.0.39 () {56 vars in 1126 bytes} [Mon May 23 15:36:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:50.264686 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f47f1f-da27-4aba-a53b-256b2e7c3698 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:50.266546 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:50.278979 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64a869-979c-405d-ae79-d0e6175eb6f0 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:50.328429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f9a0e-af34-4f62-9bac-a6f6ddd3e7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:50.329099 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f9a0e-af34-4f62-9bac-a6f6ddd3e7a4 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:50.329573 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f9a0e-af34-4f62-9bac-a6f6ddd3e7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:50.330005 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f9a0e-af34-4f62-9bac-a6f6ddd3e7a4 None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:50.330874 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f9a0e-af34-4f62-9bac-a6f6ddd3e7a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:50.331337 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f9a0e-af34-4f62-9bac-a6f6ddd3e7a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:50.332885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f9a0e-af34-4f62-9bac-a6f6ddd3e7a4 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:50.344894 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 447/903] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:50.350646 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f9a0e-af34-4f62-9bac-a6f6ddd3e7a4 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:50.380387 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f47f1f-da27-4aba-a53b-256b2e7c3698 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:50.423770 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196d30c-40b5-411d-8e70-c4316d43fa10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:50.424928 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196d30c-40b5-411d-8e70-c4316d43fa10 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:50.425370 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196d30c-40b5-411d-8e70-c4316d43fa10 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:50.425810 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196d30c-40b5-411d-8e70-c4316d43fa10 None admin] PATH_INFO: `/v3/services` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:50.426678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196d30c-40b5-411d-8e70-c4316d43fa10 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:50.427299 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196d30c-40b5-411d-8e70-c4316d43fa10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:50.428946 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196d30c-40b5-411d-8e70-c4316d43fa10 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:50.434644 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 457/904] 10.222.0.39 () {56 vars in 1126 bytes} [Mon May 23 15:36:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:50.441034 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196d30c-40b5-411d-8e70-c4316d43fa10 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:50.459882 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:50.476845 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f9a0e-af34-4f62-9bac-a6f6ddd3e7a4 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:50.521424 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1cc16-55c9-4ad1-85ca-dce460880350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:50.522497 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1cc16-55c9-4ad1-85ca-dce460880350 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:50.523063 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1cc16-55c9-4ad1-85ca-dce460880350 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:50.523482 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1cc16-55c9-4ad1-85ca-dce460880350 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:50.532846 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1cc16-55c9-4ad1-85ca-dce460880350 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:50.535301 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1cc16-55c9-4ad1-85ca-dce460880350 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:50.553915 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-dae1cc16-55c9-4ad1-85ca-dce460880350 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:50.553915 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:50.553915 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:50.553915 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:50.553915 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:50.553915 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:50.553915 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:50.553915 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:50.553915 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:50.553915 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:50.553915 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:50.553915 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:50.553915 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:36:50.553915 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:36:50.553915 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:36:50.554919 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:36:50.554919 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:50.554919 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:50.554919 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:50.554919 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:50.554919 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:50.554919 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:50.554919 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:50.554919 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:50.554919 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:50.554919 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:50.554919 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:50.554919 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:50.554919 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:50.554919 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:50.554919 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:50.554919 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:50.555853 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:36:50.555853 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:36:50.555853 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:36:50.555853 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:36:50.555853 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:36:50.555853 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:36:50.555853 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:50.555853 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:50.562692 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 448/905] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:36:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:36:50.563282 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1cc16-55c9-4ad1-85ca-dce460880350 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:50.578230 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196d30c-40b5-411d-8e70-c4316d43fa10 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:50.582941 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:50.616349 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d297a-2c1a-4b42-8639-66fc5f4ae94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:50.617162 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d297a-2c1a-4b42-8639-66fc5f4ae94f None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:50.617450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d297a-2c1a-4b42-8639-66fc5f4ae94f None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:50.618083 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d297a-2c1a-4b42-8639-66fc5f4ae94f None admin] PATH_INFO: `/v3/endpoints` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:50.619484 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d297a-2c1a-4b42-8639-66fc5f4ae94f None admin] RBAC: Adding query filter params (interface=public, service_id=12e864c3aff043f0bba1b0275210b789, region_id=RegionOne) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:50.619781 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d297a-2c1a-4b42-8639-66fc5f4ae94f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:50.621262 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d297a-2c1a-4b42-8639-66fc5f4ae94f None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:50.626640 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 458/906] 10.222.0.39 () {56 vars in 1251 bytes} [Mon May 23 15:36:50 2022] GET /identity/v3/endpoints?service_id=12e864c3aff043f0bba1b0275210b789&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:50.629750 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e5336-e1b5-4513-bc8a-5e5bb0176c74 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:50.630531 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e5336-e1b5-4513-bc8a-5e5bb0176c74 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:50.631100 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e5336-e1b5-4513-bc8a-5e5bb0176c74 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:50.632992 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 459/907] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:50.636368 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e5336-e1b5-4513-bc8a-5e5bb0176c74 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:50.676146 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1cc16-55c9-4ad1-85ca-dce460880350 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:50.712821 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6235bc-d229-46a4-a955-088a8882e82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:50.713724 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6235bc-d229-46a4-a955-088a8882e82c None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:50.713919 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6235bc-d229-46a4-a955-088a8882e82c None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:50.714196 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6235bc-d229-46a4-a955-088a8882e82c None admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:50.714983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6235bc-d229-46a4-a955-088a8882e82c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:50.715293 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6235bc-d229-46a4-a955-088a8882e82c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:50.716762 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6235bc-d229-46a4-a955-088a8882e82c None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:50.725784 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:50.734177 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 449/908] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:36:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:36:50.735491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f7064-0054-49e2-aa81-f8fea7e466b4 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:50.738161 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f7064-0054-49e2-aa81-f8fea7e466b4 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:50.738161 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f7064-0054-49e2-aa81-f8fea7e466b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:50.752100 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e5336-e1b5-4513-bc8a-5e5bb0176c74 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:50.753370 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-236f7064-0054-49e2-aa81-f8fea7e466b4 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:50.754549 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-236f7064-0054-49e2-aa81-f8fea7e466b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:50.788289 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b4b9e-3eb4-4113-b87a-f5ac0be8b9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:50.788952 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b4b9e-3eb4-4113-b87a-f5ac0be8b9b7 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:50.789237 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b4b9e-3eb4-4113-b87a-f5ac0be8b9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:50.789560 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b4b9e-3eb4-4113-b87a-f5ac0be8b9b7 None admin] PATH_INFO: `/v3/services` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:50.790249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1b4b9e-3eb4-4113-b87a-f5ac0be8b9b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:50.792035 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1b4b9e-3eb4-4113-b87a-f5ac0be8b9b7 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:50.807626 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 460/909] 10.222.0.39 () {56 vars in 1087 bytes} [Mon May 23 15:36:50 2022] GET /identity/v3/services => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:36:50.807626 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b4b9e-3eb4-4113-b87a-f5ac0be8b9b7 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:50.844112 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 450/910] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:36:50.867362 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f7064-0054-49e2-aa81-f8fea7e466b4 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:50.870437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:50.959650 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b4b9e-3eb4-4113-b87a-f5ac0be8b9b7 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:50.986412 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f7064-0054-49e2-aa81-f8fea7e466b4 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:51.014227 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed619f0f-4b4f-4d04-a739-44edd775e5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:51.015162 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed619f0f-4b4f-4d04-a739-44edd775e5ab None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:51.015589 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed619f0f-4b4f-4d04-a739-44edd775e5ab None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:51.016087 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed619f0f-4b4f-4d04-a739-44edd775e5ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:51.017059 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed619f0f-4b4f-4d04-a739-44edd775e5ab None admin] RBAC: Adding query filter params (role.id=c5b2044766b04373a9900a04296f71c3, scope.project.id=8addb03b903842609168ee2fafc8ec6b, user.id=048fc48dd55a43f7b342533a9484c3ad) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:51.017523 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed619f0f-4b4f-4d04-a739-44edd775e5ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:51.019091 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed619f0f-4b4f-4d04-a739-44edd775e5ab None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:51.028051 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 461/911] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:36:50 2022] GET /identity/v3/role_assignments?user.id=048fc48dd55a43f7b342533a9484c3ad&scope.project.id=8addb03b903842609168ee2fafc8ec6b&role.id=c5b2044766b04373a9900a04296f71c3 => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:51.030982 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b053908-e6df-4f11-8248-39a46cdae7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:51.031746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b053908-e6df-4f11-8248-39a46cdae7ee None admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:51.032035 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b053908-e6df-4f11-8248-39a46cdae7ee None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:51.032312 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b053908-e6df-4f11-8248-39a46cdae7ee None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:51.033057 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b053908-e6df-4f11-8248-39a46cdae7ee None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:51.034471 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b053908-e6df-4f11-8248-39a46cdae7ee None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:51.128419 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 451/912] 10.222.0.39 () {60 vars in 1141 bytes} [Mon May 23 15:36:50 2022] POST /identity/v3/services => generated 241 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:36:51.266021 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc10e4-d778-40bb-b57f-caadb66cd4d9 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:51.266580 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc10e4-d778-40bb-b57f-caadb66cd4d9 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:51.266580 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc10e4-d778-40bb-b57f-caadb66cd4d9 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:51.268255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 462/913] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:51.274266 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42f81c-39ff-4bc7-b93d-46b6e142b7be None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:51.275845 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42f81c-39ff-4bc7-b93d-46b6e142b7be None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:51.276439 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42f81c-39ff-4bc7-b93d-46b6e142b7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:51.294631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-1e42f81c-39ff-4bc7-b93d-46b6e142b7be None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:51.296239 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-1e42f81c-39ff-4bc7-b93d-46b6e142b7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:51.360499 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:51.377812 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 452/914] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:36:51.402571 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc10e4-d778-40bb-b57f-caadb66cd4d9 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:51.405835 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:51.517026 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc10e4-d778-40bb-b57f-caadb66cd4d9 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:51.554333 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf295e2-ac5f-4d21-93c8-e13e90b77870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:51.555147 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf295e2-ac5f-4d21-93c8-e13e90b77870 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:51.555438 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf295e2-ac5f-4d21-93c8-e13e90b77870 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:51.555747 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf295e2-ac5f-4d21-93c8-e13e90b77870 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:51.557136 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf295e2-ac5f-4d21-93c8-e13e90b77870 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:51.558800 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf295e2-ac5f-4d21-93c8-e13e90b77870 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:51.571012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-0cf295e2-ac5f-4d21-93c8-e13e90b77870 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 15:36:51.571012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:51.571012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:36:51.571012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:36:51.571012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:36:51.571012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:36:51.571012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:36:51.571012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:36:51.571012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 15:36:51.571012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:51.571012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:36:51.571012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:51.571012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:51.571012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:51.571012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:51.571012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:51.571012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:51.572141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:51.572141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:51.572141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:51.572141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:51.572141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:51.572141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:51.572141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:36:51.572141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:36:51.572141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:36:51.572141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:36:51.572141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:51.572141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:51.572141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:51.572141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:51.572141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:51.572141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:51.572984 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:51.572984 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:51.572984 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:51.572984 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:51.572984 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:51.572984 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:51.572984 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:51.572984 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:51.572984 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:51.572984 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:51.572984 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:36:51.572984 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:36:51.572984 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 15:36:51.572984 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:51.574169 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 463/915] 10.222.0.39 () {56 vars in 1114 bytes} [Mon May 23 15:36:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:51.583864 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42f81c-39ff-4bc7-b93d-46b6e142b7be None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:51.690854 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42f81c-39ff-4bc7-b93d-46b6e142b7be None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:51.728950 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07b4f3-6615-496a-a462-15f6caeefe42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:51.730281 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07b4f3-6615-496a-a462-15f6caeefe42 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:51.730828 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07b4f3-6615-496a-a462-15f6caeefe42 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:51.731309 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07b4f3-6615-496a-a462-15f6caeefe42 None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:51.732538 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07b4f3-6615-496a-a462-15f6caeefe42 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:51.733049 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07b4f3-6615-496a-a462-15f6caeefe42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:51.734707 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07b4f3-6615-496a-a462-15f6caeefe42 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:51.740425 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 453/916] 10.222.0.39 () {56 vars in 1114 bytes} [Mon May 23 15:36:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:51.748678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf295e2-ac5f-4d21-93c8-e13e90b77870 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:51.823680 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:51.862092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf295e2-ac5f-4d21-93c8-e13e90b77870 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:51.898740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99ae63-3d32-428f-a082-fe9fd816db19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:51.899411 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99ae63-3d32-428f-a082-fe9fd816db19 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:51.899782 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99ae63-3d32-428f-a082-fe9fd816db19 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:51.900127 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99ae63-3d32-428f-a082-fe9fd816db19 None admin] PATH_INFO: `/v3/services` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:51.901406 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99ae63-3d32-428f-a082-fe9fd816db19 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:51.901719 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99ae63-3d32-428f-a082-fe9fd816db19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:51.903098 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99ae63-3d32-428f-a082-fe9fd816db19 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:51.908409 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 464/917] 10.222.0.39 () {56 vars in 1114 bytes} [Mon May 23 15:36:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:51.913930 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07b4f3-6615-496a-a462-15f6caeefe42 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:51.977560 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:52.041100 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07b4f3-6615-496a-a462-15f6caeefe42 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:52.079438 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce2fed-f61f-405f-9421-f967cbefbb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:52.080489 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce2fed-f61f-405f-9421-f967cbefbb3c None admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:52.080990 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce2fed-f61f-405f-9421-f967cbefbb3c None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:52.081497 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce2fed-f61f-405f-9421-f967cbefbb3c None admin] PATH_INFO: `/v3/endpoints` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:52.082439 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ce2fed-f61f-405f-9421-f967cbefbb3c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:52.084081 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ce2fed-f61f-405f-9421-f967cbefbb3c None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:52.156926 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 454/918] 10.222.0.39 () {60 vars in 1144 bytes} [Mon May 23 15:36:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:36:53.198513 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d66ac-fe55-49f6-a663-89216bca6d05 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:53.199555 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d66ac-fe55-49f6-a663-89216bca6d05 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:53.200138 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d66ac-fe55-49f6-a663-89216bca6d05 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:53.202574 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 465/919] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:53.207781 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf8bd6-cbbb-4dfd-b604-5aa629340ba1 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:53.208385 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf8bd6-cbbb-4dfd-b604-5aa629340ba1 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:53.208385 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf8bd6-cbbb-4dfd-b604-5aa629340ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:53.227014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-4faf8bd6-cbbb-4dfd-b604-5aa629340ba1 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:53.229030 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-4faf8bd6-cbbb-4dfd-b604-5aa629340ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:53.303383 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105fc86-4271-489d-917d-eb84c2375918 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:53.303584 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105fc86-4271-489d-917d-eb84c2375918 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:53.303847 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105fc86-4271-489d-917d-eb84c2375918 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:53.305470 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 466/920] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:36:53.311326 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b5fb0-9fe8-4db1-9e34-5e782d0383a0 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:53.311648 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b5fb0-9fe8-4db1-9e34-5e782d0383a0 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:53.311936 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b5fb0-9fe8-4db1-9e34-5e782d0383a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:53.316963 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 455/921] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:36:53.333082 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-f22b5fb0-9fe8-4db1-9e34-5e782d0383a0 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:53.334555 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-f22b5fb0-9fe8-4db1-9e34-5e782d0383a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:53.341831 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf8bd6-cbbb-4dfd-b604-5aa629340ba1 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:53.380689 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:53.436040 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 467/922] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:36:53.453657 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b5fb0-9fe8-4db1-9e34-5e782d0383a0 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:53.461848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf8bd6-cbbb-4dfd-b604-5aa629340ba1 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:53.505513 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd4fcb-2abc-430a-804c-d337fd02640a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:53.506328 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd4fcb-2abc-430a-804c-d337fd02640a None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:53.506608 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd4fcb-2abc-430a-804c-d337fd02640a None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:53.506876 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd4fcb-2abc-430a-804c-d337fd02640a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:53.507527 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd4fcb-2abc-430a-804c-d337fd02640a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:53.508938 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd4fcb-2abc-430a-804c-d337fd02640a None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:53.522026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-c3dd4fcb-2abc-430a-804c-d337fd02640a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 15:36:53.522026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:53.522026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:36:53.522026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:36:53.522026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:36:53.522026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:36:53.522026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:36:53.522026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:36:53.522026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 15:36:53.522026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:53.522026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:36:53.522026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:53.522026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:53.522026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:53.522026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:53.522026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:53.522996 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:53.522996 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:53.522996 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:53.522996 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:53.522996 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:53.522996 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:53.522996 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:53.522996 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:36:53.522996 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:36:53.522996 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:36:53.522996 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:36:53.522996 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:53.522996 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:53.522996 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:53.522996 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:53.522996 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:53.523872 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:53.523872 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:53.523872 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:53.523872 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:53.523872 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:53.523872 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:53.523872 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:53.523872 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:53.523872 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:53.523872 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:53.523872 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:53.523872 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:36:53.523872 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:36:53.523872 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 15:36:53.523872 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:53.529057 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 456/923] 10.222.0.39 () {56 vars in 1132 bytes} [Mon May 23 15:36:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:36:53.530013 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd4fcb-2abc-430a-804c-d337fd02640a None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:53.537502 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:53.598196 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b5fb0-9fe8-4db1-9e34-5e782d0383a0 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:53.640728 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:53.644683 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd4fcb-2abc-430a-804c-d337fd02640a None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:53.648085 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0666f08-9108-42e0-b468-799a216a6aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:53.649181 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0666f08-9108-42e0-b468-799a216a6aef None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:53.649661 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0666f08-9108-42e0-b468-799a216a6aef None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:53.650849 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0666f08-9108-42e0-b468-799a216a6aef None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:53.665318 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0666f08-9108-42e0-b468-799a216a6aef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:36:53.679205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-d0666f08-9108-42e0-b468-799a216a6aef None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:36:53.679205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:53.679205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:53.679205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:53.679205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:53.679205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:53.679205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:53.679205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:53.679205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:53.679205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:53.679205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:53.679205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:53.679205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:36:53.679205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:36:53.679205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:36:53.679205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:36:53.680312 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:36:53.680312 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:36:53.680312 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:36:53.680312 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:36:53.680312 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:53.680312 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:53.680312 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:53.680312 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:53.680312 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:53.680312 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:53.680312 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:53.680312 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:53.680312 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:53.680312 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:53.680312 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:53.680312 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:53.681730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:53.681730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:53.681730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:53.681730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:53.681730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:36:53.681730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:36:53.681730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:36:53.681730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:36:53.681730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:36:53.681730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:36:53.681730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:36:53.681730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:53.681730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 468/924] 10.222.0.39 () {56 vars in 1120 bytes} [Mon May 23 15:36:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:53.689176 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0666f08-9108-42e0-b468-799a216a6aef None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:53.691956 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daed094-74b1-41a4-ae9d-350547975066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:53.692629 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daed094-74b1-41a4-ae9d-350547975066 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:53.692963 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daed094-74b1-41a4-ae9d-350547975066 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:53.693243 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daed094-74b1-41a4-ae9d-350547975066 None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:53.694131 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daed094-74b1-41a4-ae9d-350547975066 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:53.694446 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daed094-74b1-41a4-ae9d-350547975066 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:53.695966 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daed094-74b1-41a4-ae9d-350547975066 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:53.707353 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 457/925] 10.222.0.39 () {56 vars in 1126 bytes} [Mon May 23 15:36:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:36:53.708700 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e695834-9f44-43a6-8425-111ec1183dd7 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:53.708996 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e695834-9f44-43a6-8425-111ec1183dd7 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:53.709280 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e695834-9f44-43a6-8425-111ec1183dd7 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:53.710671 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 458/926] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:53.711642 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e695834-9f44-43a6-8425-111ec1183dd7 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:53.813282 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0666f08-9108-42e0-b468-799a216a6aef None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:53.820878 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e695834-9f44-43a6-8425-111ec1183dd7 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:53.834714 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:53.849935 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e5b81-47d1-4b80-a371-beca942e2324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:53.850603 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e5b81-47d1-4b80-a371-beca942e2324 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:53.850884 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e5b81-47d1-4b80-a371-beca942e2324 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:53.851159 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e5b81-47d1-4b80-a371-beca942e2324 None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:53.852063 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e5b81-47d1-4b80-a371-beca942e2324 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:53.852455 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e5b81-47d1-4b80-a371-beca942e2324 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:53.854028 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e5b81-47d1-4b80-a371-beca942e2324 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:53.858412 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073515e-68c8-4f9f-b253-95d345d3a263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:53.859080 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073515e-68c8-4f9f-b253-95d345d3a263 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:53.859364 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073515e-68c8-4f9f-b253-95d345d3a263 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:53.859746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073515e-68c8-4f9f-b253-95d345d3a263 None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:53.860458 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073515e-68c8-4f9f-b253-95d345d3a263 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:53.860771 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073515e-68c8-4f9f-b253-95d345d3a263 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:53.862166 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073515e-68c8-4f9f-b253-95d345d3a263 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:53.864273 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 469/927] 10.222.0.39 () {56 vars in 1115 bytes} [Mon May 23 15:36:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:53.865661 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf7573-b1ab-4cbf-92cf-d57cce2da6b4 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:53.866376 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf7573-b1ab-4cbf-92cf-d57cce2da6b4 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:53.866654 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf7573-b1ab-4cbf-92cf-d57cce2da6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:53.877046 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 459/928] 10.222.0.39 () {56 vars in 1126 bytes} [Mon May 23 15:36:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:53.877046 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073515e-68c8-4f9f-b253-95d345d3a263 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:53.889547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-bcdf7573-b1ab-4cbf-92cf-d57cce2da6b4 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:53.890763 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-bcdf7573-b1ab-4cbf-92cf-d57cce2da6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:53.906349 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:53.962512 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 470/929] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:36:53.963717 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf7573-b1ab-4cbf-92cf-d57cce2da6b4 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:54.001926 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073515e-68c8-4f9f-b253-95d345d3a263 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:54.037979 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14b0a2-fd54-45c3-863f-a539b79bbc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:54.038783 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14b0a2-fd54-45c3-863f-a539b79bbc2f None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:54.039067 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14b0a2-fd54-45c3-863f-a539b79bbc2f None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:54.039348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14b0a2-fd54-45c3-863f-a539b79bbc2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:54.052413 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14b0a2-fd54-45c3-863f-a539b79bbc2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:54.054203 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14b0a2-fd54-45c3-863f-a539b79bbc2f None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:54.072794 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf7573-b1ab-4cbf-92cf-d57cce2da6b4 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:54.073921 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-fb14b0a2-fd54-45c3-863f-a539b79bbc2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:54.073921 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:54.073921 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:54.073921 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:54.073921 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:54.073921 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:54.073921 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:54.073921 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:54.073921 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:54.073921 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:54.073921 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:54.073921 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:54.073921 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:54.073921 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:54.073921 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:54.074775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:54.074775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:54.074775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:54.074775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:54.074775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:54.074775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:54.074775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:54.074775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:54.074775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:54.074775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:54.074775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:54.074775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:54.074775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:54.074775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:54.074775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:54.074775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:54.074775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:54.075692 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:54.075692 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:54.075692 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:54.075692 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:54.075692 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 460/930] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:54.075980 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14b0a2-fd54-45c3-863f-a539b79bbc2f None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:54.093088 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:54.116166 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0127d-ab4f-43af-814b-4b3bd84f727a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:54.116850 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0127d-ab4f-43af-814b-4b3bd84f727a None admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:54.117137 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0127d-ab4f-43af-814b-4b3bd84f727a None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:54.117403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0127d-ab4f-43af-814b-4b3bd84f727a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:54.118161 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d0127d-ab4f-43af-814b-4b3bd84f727a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:54.119980 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d0127d-ab4f-43af-814b-4b3bd84f727a None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:54.161909 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:54.183754 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14b0a2-fd54-45c3-863f-a539b79bbc2f None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:54.219747 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca32fc-270d-4e1a-b777-8635819734c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:54.220566 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca32fc-270d-4e1a-b777-8635819734c0 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:54.220846 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca32fc-270d-4e1a-b777-8635819734c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:54.221116 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca32fc-270d-4e1a-b777-8635819734c0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:54.221889 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca32fc-270d-4e1a-b777-8635819734c0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:54.223252 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca32fc-270d-4e1a-b777-8635819734c0 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:54.231552 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 471/931] 10.222.0.39 () {60 vars in 1144 bytes} [Mon May 23 15:36:53 2022] POST /identity/v3/endpoints => generated 347 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:36:54.236389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-29ca32fc-270d-4e1a-b777-8635819734c0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:36:54.236389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:54.236389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:36:54.236389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:36:54.236389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:36:54.236389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:36:54.236389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:36:54.236389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:36:54.236389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:36:54.236389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:54.236389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:36:54.236389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:54.236389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:54.236389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:54.236389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:54.236389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:54.236389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:54.237473 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:54.237473 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:54.237473 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:54.237473 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:54.237473 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:54.237473 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:54.237473 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:36:54.237473 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:36:54.237473 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:36:54.237473 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:36:54.237473 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:54.237473 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:54.237473 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:54.237473 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:54.237473 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:54.237473 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:54.244753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:54.244753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:54.244753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:54.244753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:54.244753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:54.244753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:54.244753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:54.244753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:54.244753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:54.244753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:54.244753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:36:54.244753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:36:54.244753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:36:54.244753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:54.244753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 461/932] 10.222.0.39 () {56 vars in 1126 bytes} [Mon May 23 15:36:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:54.245638 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0127d-ab4f-43af-814b-4b3bd84f727a None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:54.253916 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca32fc-270d-4e1a-b777-8635819734c0 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:54.398490 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca32fc-270d-4e1a-b777-8635819734c0 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:54.404667 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0127d-ab4f-43af-814b-4b3bd84f727a None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:54.443119 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed47aac-eb72-441f-a5ce-5b30295ff5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:54.444382 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed47aac-eb72-441f-a5ce-5b30295ff5c0 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:54.444879 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed47aac-eb72-441f-a5ce-5b30295ff5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:54.445411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed47aac-eb72-441f-a5ce-5b30295ff5c0 None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:54.446248 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13416a8b-1dcd-4006-8ab6-6c8f12ef192f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:54.446577 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed47aac-eb72-441f-a5ce-5b30295ff5c0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:54.447755 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13416a8b-1dcd-4006-8ab6-6c8f12ef192f None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:54.448037 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed47aac-eb72-441f-a5ce-5b30295ff5c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:54.448204 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13416a8b-1dcd-4006-8ab6-6c8f12ef192f None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:54.448590 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13416a8b-1dcd-4006-8ab6-6c8f12ef192f None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:54.449476 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13416a8b-1dcd-4006-8ab6-6c8f12ef192f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:54.449882 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13416a8b-1dcd-4006-8ab6-6c8f12ef192f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:54.450274 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed47aac-eb72-441f-a5ce-5b30295ff5c0 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:54.451454 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13416a8b-1dcd-4006-8ab6-6c8f12ef192f None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:54.461279 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 462/933] 10.222.0.39 () {56 vars in 1122 bytes} [Mon May 23 15:36:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:54.465216 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed47aac-eb72-441f-a5ce-5b30295ff5c0 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:54.466095 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 472/934] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:54.471864 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13416a8b-1dcd-4006-8ab6-6c8f12ef192f None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:54.477418 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:54.511672 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:54.607228 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13416a8b-1dcd-4006-8ab6-6c8f12ef192f None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:54.615621 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed47aac-eb72-441f-a5ce-5b30295ff5c0 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:54.643966 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4f168-1c2f-4509-ad97-c8929215a411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:54.644781 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4f168-1c2f-4509-ad97-c8929215a411 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:54.645066 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4f168-1c2f-4509-ad97-c8929215a411 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:54.645343 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4f168-1c2f-4509-ad97-c8929215a411 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:54.653011 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02fd14-8c98-41e7-96a8-8581f40d6c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:54.653647 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02fd14-8c98-41e7-96a8-8581f40d6c86 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:54.653927 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02fd14-8c98-41e7-96a8-8581f40d6c86 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:54.654097 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4f168-1c2f-4509-ad97-c8929215a411 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:54.654196 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02fd14-8c98-41e7-96a8-8581f40d6c86 None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:54.654895 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a02fd14-8c98-41e7-96a8-8581f40d6c86 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:54.655196 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a02fd14-8c98-41e7-96a8-8581f40d6c86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:54.655524 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4f168-1c2f-4509-ad97-c8929215a411 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:54.656581 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a02fd14-8c98-41e7-96a8-8581f40d6c86 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:54.666078 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 463/935] 10.222.0.39 () {56 vars in 1122 bytes} [Mon May 23 15:36:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:36:54.666078 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f233b27-e218-4b6b-a1ff-d7b3fd782b4e None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:54.666078 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f233b27-e218-4b6b-a1ff-d7b3fd782b4e None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:54.666078 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f233b27-e218-4b6b-a1ff-d7b3fd782b4e None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:54.666078 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 464/936] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:54.668876 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f233b27-e218-4b6b-a1ff-d7b3fd782b4e None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:54.677740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-eeb4f168-1c2f-4509-ad97-c8929215a411 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:36:54.677740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:54.677740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:54.677740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:54.677740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:54.677740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:54.677740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:54.677740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:54.677740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:54.677740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:54.677740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:54.677740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:54.677740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:36:54.677740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:36:54.677740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:36:54.677740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:36:54.678931 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:54.678931 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:54.678931 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:36:54.678931 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:54.678931 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:36:54.678931 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:54.678931 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:54.678931 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:54.678931 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:54.678931 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:54.678931 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:54.678931 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:54.678931 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:54.678931 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:54.678931 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:54.678931 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:54.678931 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:54.678931 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:54.680843 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:54.680843 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:54.680843 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:36:54.680843 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:36:54.680843 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:36:54.680843 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:36:54.680843 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:36:54.680843 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:36:54.680843 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:36:54.680843 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:54.683686 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 473/937] 10.222.0.39 () {56 vars in 1117 bytes} [Mon May 23 15:36:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:54.684890 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb78711-a8f7-421b-91a9-00a0c124b12a None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:54.685185 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb78711-a8f7-421b-91a9-00a0c124b12a None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:54.685467 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb78711-a8f7-421b-91a9-00a0c124b12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:54.704016 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-4cb78711-a8f7-421b-91a9-00a0c124b12a None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:54.705346 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-4cb78711-a8f7-421b-91a9-00a0c124b12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:54.754054 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:54.777904 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 474/938] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:36:54.778740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb78711-a8f7-421b-91a9-00a0c124b12a None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:54.793965 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f233b27-e218-4b6b-a1ff-d7b3fd782b4e None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:54.796149 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:54.839483 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e1002-5b4b-40d9-9d43-eb0b3d232da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:54.840171 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e1002-5b4b-40d9-9d43-eb0b3d232da3 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:54.840456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e1002-5b4b-40d9-9d43-eb0b3d232da3 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:54.840739 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e1002-5b4b-40d9-9d43-eb0b3d232da3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:54.841528 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e1002-5b4b-40d9-9d43-eb0b3d232da3 None admin] RBAC: Adding query filter params (interface=public, service_id=6182ef4ecd65460093710afd7e92a0ab, region_id=RegionOne) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:54.841848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e1002-5b4b-40d9-9d43-eb0b3d232da3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:54.843324 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e1002-5b4b-40d9-9d43-eb0b3d232da3 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:54.853328 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 465/939] 10.222.0.39 () {56 vars in 1251 bytes} [Mon May 23 15:36:54 2022] GET /identity/v3/endpoints?service_id=6182ef4ecd65460093710afd7e92a0ab&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:36:54.853328 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e1002-5b4b-40d9-9d43-eb0b3d232da3 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:54.892179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb78711-a8f7-421b-91a9-00a0c124b12a None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:54.929313 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b253b-6c8e-4489-9d05-dfa7c3b4f8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:54.929991 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b253b-6c8e-4489-9d05-dfa7c3b4f8eb None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:54.930273 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b253b-6c8e-4489-9d05-dfa7c3b4f8eb None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:54.930581 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b253b-6c8e-4489-9d05-dfa7c3b4f8eb None admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:54.931700 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b253b-6c8e-4489-9d05-dfa7c3b4f8eb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:54.932021 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b253b-6c8e-4489-9d05-dfa7c3b4f8eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:54.933582 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b253b-6c8e-4489-9d05-dfa7c3b4f8eb None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:54.952959 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 475/940] 10.222.0.39 () {56 vars in 1149 bytes} [Mon May 23 15:36:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:54.953784 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b253b-6c8e-4489-9d05-dfa7c3b4f8eb None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:54.961572 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e1002-5b4b-40d9-9d43-eb0b3d232da3 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:54.998084 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae54b6-bd8c-49ca-8a61-c89e0f1f735b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:54.998745 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae54b6-bd8c-49ca-8a61-c89e0f1f735b None admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:54.999030 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae54b6-bd8c-49ca-8a61-c89e0f1f735b None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:54.999307 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae54b6-bd8c-49ca-8a61-c89e0f1f735b None admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:55.000044 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae54b6-bd8c-49ca-8a61-c89e0f1f735b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:55.001494 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae54b6-bd8c-49ca-8a61-c89e0f1f735b None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:55.002853 dv-cinder-842119-2-smb devstack@keystone.service[87192]: WARNING keystone.server.flask.common [None req-c8ae54b6-bd8c-49ca-8a61-c89e0f1f735b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 23 15:36:55.006227 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:55.030602 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:55.060702 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b253b-6c8e-4489-9d05-dfa7c3b4f8eb None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:55.068612 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.sql.core [None req-c8ae54b6-bd8c-49ca-8a61-c89e0f1f735b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 23 15:36:55.068612 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 23 15:36:55.068612 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [parameters: {'id': '7c9522c560fa42b2a27caad4878a17cb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 23 15:36:55.068612 dv-cinder-842119-2-smb devstack@keystone.service[87192]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87192) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 23 15:36:55.076726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-c8ae54b6-bd8c-49ca-8a61-c89e0f1f735b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7c9522c560fa42b2a27caad4878a17cb.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7c9522c560fa42b2a27caad4878a17cb. May 23 15:36:55.076726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:55.076726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 15:36:55.076726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 15:36:55.076726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 15:36:55.076726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 15:36:55.076726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 15:36:55.076726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application result = self._query(query) May 23 15:36:55.076726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 15:36:55.076726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application conn.query(q) May 23 15:36:55.076726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 15:36:55.076726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 15:36:55.076726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 15:36:55.077728 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application result.read() May 23 15:36:55.077728 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 15:36:55.077728 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 15:36:55.077728 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 15:36:55.077728 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 15:36:55.077728 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 15:36:55.077728 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 15:36:55.077728 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 15:36:55.077728 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 15:36:55.077728 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 23 15:36:55.077728 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:55.077728 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 23 15:36:55.077728 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:55.077728 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:55.077728 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 23 15:36:55.077728 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 23 15:36:55.077728 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 23 15:36:55.077728 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return project_ref.to_dict() May 23 15:36:55.078875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 15:36:55.078875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application next(self.gen) May 23 15:36:55.078875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 23 15:36:55.078875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application yield resource May 23 15:36:55.078875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 15:36:55.078875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application next(self.gen) May 23 15:36:55.078875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 23 15:36:55.078875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self.session.rollback() May 23 15:36:55.078875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 23 15:36:55.078875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self.force_reraise() May 23 15:36:55.078875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 23 15:36:55.078875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise self.value May 23 15:36:55.078875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 23 15:36:55.078875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 23 15:36:55.078875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 23 15:36:55.078875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application session.commit() May 23 15:36:55.078875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 23 15:36:55.079994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 23 15:36:55.079994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 23 15:36:55.079994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self._prepare_impl() May 23 15:36:55.079994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 23 15:36:55.079994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self.session.flush() May 23 15:36:55.079994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 23 15:36:55.079994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self._flush(objects) May 23 15:36:55.079994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 23 15:36:55.079994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 23 15:36:55.079994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 23 15:36:55.079994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application compat.raise_( May 23 15:36:55.079994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 15:36:55.079994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception May 23 15:36:55.079994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 23 15:36:55.079994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application flush_context.execute() May 23 15:36:55.079994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 23 15:36:55.079994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rec.execute(self) May 23 15:36:55.081131 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 23 15:36:55.081131 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 23 15:36:55.081131 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 23 15:36:55.081131 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application _emit_insert_statements( May 23 15:36:55.081131 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 23 15:36:55.081131 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application c = connection._execute_20( May 23 15:36:55.081131 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 23 15:36:55.081131 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 23 15:36:55.081131 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 23 15:36:55.081131 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 23 15:36:55.081131 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 23 15:36:55.081131 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ret = self._execute_context( May 23 15:36:55.081131 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 23 15:36:55.081131 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 23 15:36:55.081131 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 23 15:36:55.082101 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 23 15:36:55.082101 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 15:36:55.082101 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception May 23 15:36:55.082101 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 15:36:55.082101 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 15:36:55.082101 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 15:36:55.082101 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 15:36:55.082101 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 15:36:55.082101 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application result = self._query(query) May 23 15:36:55.082101 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 15:36:55.082101 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application conn.query(q) May 23 15:36:55.082101 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 15:36:55.082101 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 15:36:55.082101 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 15:36:55.082101 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application result.read() May 23 15:36:55.082101 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 15:36:55.082101 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 15:36:55.083190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 15:36:55.083190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 15:36:55.083190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 15:36:55.083190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 15:36:55.083190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 15:36:55.083190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 15:36:55.083190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 23 15:36:55.083190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 23 15:36:55.083190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [parameters: {'id': '7c9522c560fa42b2a27caad4878a17cb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 23 15:36:55.083190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 23 15:36:55.083190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:55.083190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:36:55.083190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:55.083190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:55.083190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 23 15:36:55.084465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 23 15:36:55.084465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 23 15:36:55.084465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 23 15:36:55.084465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 23 15:36:55.084465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:55.084465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:36:55.084465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:55.084465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:55.084465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:55.084465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:55.084465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:55.084465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:55.084465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:55.084465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:55.084465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:55.084465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:55.084465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:55.085716 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:55.085716 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 23 15:36:55.085716 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 23 15:36:55.085716 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:55.085716 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:55.085716 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 23 15:36:55.085716 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.Conflict( May 23 15:36:55.085716 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7c9522c560fa42b2a27caad4878a17cb. May 23 15:36:55.085716 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:55.085716 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 466/941] 10.222.0.39 () {60 vars in 1140 bytes} [Mon May 23 15:36:54 2022] POST /identity/v3/projects => generated 262 bytes in 234 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:55.085716 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae54b6-bd8c-49ca-8a61-c89e0f1f735b None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:55.107458 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f7e7d-254d-4daa-90f8-c3d7a5ed6d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:55.108426 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f7e7d-254d-4daa-90f8-c3d7a5ed6d85 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:55.108872 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f7e7d-254d-4daa-90f8-c3d7a5ed6d85 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:55.109150 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f7e7d-254d-4daa-90f8-c3d7a5ed6d85 None admin] PATH_INFO: `/v3/services` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:55.109913 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f7e7d-254d-4daa-90f8-c3d7a5ed6d85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:55.111466 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f7e7d-254d-4daa-90f8-c3d7a5ed6d85 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:55.133054 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 476/942] 10.222.0.39 () {56 vars in 1087 bytes} [Mon May 23 15:36:54 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:36:55.133054 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f7e7d-254d-4daa-90f8-c3d7a5ed6d85 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:55.234739 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae54b6-bd8c-49ca-8a61-c89e0f1f735b None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:55.269405 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f7e7d-254d-4daa-90f8-c3d7a5ed6d85 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:55.283447 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145460ad-0f90-435d-aaa4-6d9b35ec8e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:55.284673 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145460ad-0f90-435d-aaa4-6d9b35ec8e54 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:55.285034 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145460ad-0f90-435d-aaa4-6d9b35ec8e54 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:55.285385 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145460ad-0f90-435d-aaa4-6d9b35ec8e54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:55.301396 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145460ad-0f90-435d-aaa4-6d9b35ec8e54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:55.303681 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145460ad-0f90-435d-aaa4-6d9b35ec8e54 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:55.310470 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262342c9-fc71-478b-8efd-188abf301b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:55.311431 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262342c9-fc71-478b-8efd-188abf301b58 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:55.311804 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262342c9-fc71-478b-8efd-188abf301b58 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:55.312307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262342c9-fc71-478b-8efd-188abf301b58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:55.316718 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:55.322738 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262342c9-fc71-478b-8efd-188abf301b58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:55.324410 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262342c9-fc71-478b-8efd-188abf301b58 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:55.325318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-145460ad-0f90-435d-aaa4-6d9b35ec8e54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:55.325318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:55.325318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:55.325318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:55.325318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:55.325318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:55.325318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:55.325318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:55.325318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:55.325318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:55.325318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:55.325318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:55.325318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:55.325318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:55.325318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:55.326314 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:55.326314 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:55.326314 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:55.326314 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:55.326314 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:55.326314 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:55.326314 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:55.326314 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:55.326314 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:55.326314 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:55.326314 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:55.326314 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:55.326314 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:55.326314 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:55.326314 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:55.326314 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:55.326314 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:55.327267 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:55.327267 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:55.327267 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:55.327267 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:55.331758 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 467/943] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:55.333276 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145460ad-0f90-435d-aaa4-6d9b35ec8e54 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:55.347910 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-262342c9-fc71-478b-8efd-188abf301b58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:55.347910 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:55.347910 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:55.347910 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:55.347910 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:55.347910 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:55.347910 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:55.347910 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:55.347910 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:55.347910 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:55.347910 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:55.347910 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:55.347910 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:36:55.347910 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:36:55.347910 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:36:55.348854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:36:55.348854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:55.348854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:55.348854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:55.348854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:55.348854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:55.348854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:55.348854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:55.348854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:55.348854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:55.348854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:55.348854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:55.348854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:55.348854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:55.348854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:55.348854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:55.348854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:55.352400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:36:55.352400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:36:55.352400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:36:55.352400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:36:55.352400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:36:55.352400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:36:55.352400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:55.352400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:55.352400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 477/944] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:36:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:55.355212 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262342c9-fc71-478b-8efd-188abf301b58 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:55.412052 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:55.478336 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145460ad-0f90-435d-aaa4-6d9b35ec8e54 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:55.488496 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262342c9-fc71-478b-8efd-188abf301b58 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:55.520766 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde84ea-909c-4a5b-9229-75eb1d64c706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:55.521762 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde84ea-909c-4a5b-9229-75eb1d64c706 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:55.522392 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde84ea-909c-4a5b-9229-75eb1d64c706 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:55.522861 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde84ea-909c-4a5b-9229-75eb1d64c706 None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:55.523806 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde84ea-909c-4a5b-9229-75eb1d64c706 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:55.524326 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde84ea-909c-4a5b-9229-75eb1d64c706 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:55.526623 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde84ea-909c-4a5b-9229-75eb1d64c706 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:55.529261 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982409c-ff90-42cb-92e7-323c5ea560cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:55.530600 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982409c-ff90-42cb-92e7-323c5ea560cf None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:55.530896 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982409c-ff90-42cb-92e7-323c5ea560cf None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:55.531222 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982409c-ff90-42cb-92e7-323c5ea560cf None admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:55.532088 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982409c-ff90-42cb-92e7-323c5ea560cf None admin] RBAC: Adding query filter params (name=service) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:55.532399 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982409c-ff90-42cb-92e7-323c5ea560cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:55.533824 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982409c-ff90-42cb-92e7-323c5ea560cf None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:55.546312 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 468/945] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:36:55.555345 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde84ea-909c-4a5b-9229-75eb1d64c706 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:55.559719 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 478/946] 10.222.0.39 () {56 vars in 1112 bytes} [Mon May 23 15:36:55 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:36:55.669320 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde84ea-909c-4a5b-9229-75eb1d64c706 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:55.671044 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:55.713774 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccf185-d580-4d3a-bb1f-c8345898572c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:55.714580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccf185-d580-4d3a-bb1f-c8345898572c None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:55.714859 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccf185-d580-4d3a-bb1f-c8345898572c None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:55.715130 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccf185-d580-4d3a-bb1f-c8345898572c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:55.723113 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ccf185-d580-4d3a-bb1f-c8345898572c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:55.724623 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ccf185-d580-4d3a-bb1f-c8345898572c None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:55.740141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-b1ccf185-d580-4d3a-bb1f-c8345898572c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:55.740141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:55.740141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:55.740141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:55.740141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:55.740141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:55.740141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:55.740141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:55.740141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:55.740141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:55.740141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:55.740141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:55.740141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:36:55.740141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:36:55.740141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:36:55.741114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:36:55.741114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:55.741114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:55.741114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:55.741114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:55.741114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:55.741114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:55.741114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:55.741114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:55.741114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:55.741114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:55.741114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:55.741114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:55.741114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:55.741114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:55.741114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:55.741114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:55.742230 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:36:55.742230 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:36:55.742230 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:36:55.742230 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:36:55.742230 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:36:55.742230 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:36:55.742230 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:36:55.742230 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:55.742230 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 469/947] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:36:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:55.747977 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982409c-ff90-42cb-92e7-323c5ea560cf None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:55.809968 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:55.857461 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982409c-ff90-42cb-92e7-323c5ea560cf None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:55.894967 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f52ef-720b-4fcd-89f2-81672939fa48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:55.895918 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f52ef-720b-4fcd-89f2-81672939fa48 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:55.896356 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f52ef-720b-4fcd-89f2-81672939fa48 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:55.896803 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f52ef-720b-4fcd-89f2-81672939fa48 None admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:55.897817 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f52ef-720b-4fcd-89f2-81672939fa48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:55.898292 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f52ef-720b-4fcd-89f2-81672939fa48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:55.900030 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f52ef-720b-4fcd-89f2-81672939fa48 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:55.913463 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 479/948] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:36:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:55.919578 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccf185-d580-4d3a-bb1f-c8345898572c None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:56.026973 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccf185-d580-4d3a-bb1f-c8345898572c None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:56.063352 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676143e-d062-4b72-9e1d-057fdad03a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:56.064250 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676143e-d062-4b72-9e1d-057fdad03a8a None admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:56.064518 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676143e-d062-4b72-9e1d-057fdad03a8a None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:56.064803 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676143e-d062-4b72-9e1d-057fdad03a8a None admin] PATH_INFO: `/v3/projects/8addb03b903842609168ee2fafc8ec6b/users/048fc48dd55a43f7b342533a9484c3ad/roles/c5b2044766b04373a9900a04296f71c3` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:56.069327 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676143e-d062-4b72-9e1d-057fdad03a8a None admin] RBAC: Authorizing `identity:create_grant(project_id=8addb03b903842609168ee2fafc8ec6b, user_id=048fc48dd55a43f7b342533a9484c3ad, role_id=c5b2044766b04373a9900a04296f71c3)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:56.076541 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676143e-d062-4b72-9e1d-057fdad03a8a None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:56.155306 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 470/949] 10.222.0.39 () {58 vars in 1439 bytes} [Mon May 23 15:36:55 2022] PUT /identity/v3/projects/8addb03b903842609168ee2fafc8ec6b/users/048fc48dd55a43f7b342533a9484c3ad/roles/c5b2044766b04373a9900a04296f71c3 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:36:56.610528 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982be40-b984-4508-a85c-c60a7026ab5b None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:56.611564 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982be40-b984-4508-a85c-c60a7026ab5b None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:56.612139 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982be40-b984-4508-a85c-c60a7026ab5b None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:56.613970 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 480/950] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:56.619228 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5a55f-420e-44e8-a4ba-f24dc6f43e45 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:56.619649 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5a55f-420e-44e8-a4ba-f24dc6f43e45 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:56.619837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5a55f-420e-44e8-a4ba-f24dc6f43e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:56.637323 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-fba5a55f-420e-44e8-a4ba-f24dc6f43e45 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:56.638817 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-fba5a55f-420e-44e8-a4ba-f24dc6f43e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:56.656752 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:56.708939 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 471/951] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:36:56.732570 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982be40-b984-4508-a85c-c60a7026ab5b None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:56.839109 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982be40-b984-4508-a85c-c60a7026ab5b None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:56.856226 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:56.874992 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a25833-1907-44f5-94d4-09ab55cca127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:56.875790 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a25833-1907-44f5-94d4-09ab55cca127 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:56.876079 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a25833-1907-44f5-94d4-09ab55cca127 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:56.876353 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a25833-1907-44f5-94d4-09ab55cca127 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:56.877022 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a25833-1907-44f5-94d4-09ab55cca127 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:56.878454 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a25833-1907-44f5-94d4-09ab55cca127 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:56.892121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-46a25833-1907-44f5-94d4-09ab55cca127 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 23 15:36:56.892121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:56.892121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:36:56.892121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:36:56.892121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:36:56.892121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:36:56.892121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:36:56.892121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:36:56.892121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 15:36:56.892121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:56.892121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:36:56.892121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:56.892121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:56.892121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:56.892121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:56.892121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:56.892121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:56.893255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:56.893255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:56.893255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:56.893255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:56.893255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:56.893255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:56.893255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:36:56.893255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:36:56.893255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:36:56.893255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:36:56.893255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:56.893255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:56.893255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:56.893255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:56.893255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:56.893255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:56.894347 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:56.894347 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:56.894347 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:56.894347 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:56.894347 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:56.894347 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:56.894347 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:56.894347 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:56.894347 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:56.894347 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:56.894347 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:36:56.894347 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:36:56.894347 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 15:36:56.894347 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:56.894347 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 481/952] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:36:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:56.899565 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5a55f-420e-44e8-a4ba-f24dc6f43e45 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:57.004577 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5a55f-420e-44e8-a4ba-f24dc6f43e45 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:57.041085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16309e25-c48a-486f-9b09-d460299fac6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:57.041901 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16309e25-c48a-486f-9b09-d460299fac6f None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:57.042182 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16309e25-c48a-486f-9b09-d460299fac6f None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:57.042457 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16309e25-c48a-486f-9b09-d460299fac6f None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:57.043163 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16309e25-c48a-486f-9b09-d460299fac6f None admin] RBAC: Adding query filter params (name=compute) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:57.043514 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16309e25-c48a-486f-9b09-d460299fac6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:57.045011 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16309e25-c48a-486f-9b09-d460299fac6f None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:57.051437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 472/953] 10.222.0.39 () {56 vars in 1112 bytes} [Mon May 23 15:36:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:57.057622 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a25833-1907-44f5-94d4-09ab55cca127 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:57.164530 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a25833-1907-44f5-94d4-09ab55cca127 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:57.204683 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603af460-524f-4292-ae7c-58bc39c67d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:57.205638 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603af460-524f-4292-ae7c-58bc39c67d1a None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:57.206103 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603af460-524f-4292-ae7c-58bc39c67d1a None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:57.206556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603af460-524f-4292-ae7c-58bc39c67d1a None admin] PATH_INFO: `/v3/services` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:57.207471 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603af460-524f-4292-ae7c-58bc39c67d1a None admin] RBAC: Adding query filter params (type=compute) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:57.208003 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603af460-524f-4292-ae7c-58bc39c67d1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:57.209557 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603af460-524f-4292-ae7c-58bc39c67d1a None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:57.215028 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 482/954] 10.222.0.39 () {56 vars in 1112 bytes} [Mon May 23 15:36:57 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:57.469024 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecec67-9083-4bb9-a5c8-0b7dfaa6116d None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:57.469370 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecec67-9083-4bb9-a5c8-0b7dfaa6116d None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:57.469547 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecec67-9083-4bb9-a5c8-0b7dfaa6116d None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:57.471029 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 473/955] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:57.476507 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc5d5d-88f2-490e-8517-7338bdd0ac5d None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:57.477047 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc5d5d-88f2-490e-8517-7338bdd0ac5d None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:57.477565 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc5d5d-88f2-490e-8517-7338bdd0ac5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:57.496956 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-5edc5d5d-88f2-490e-8517-7338bdd0ac5d None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:57.498474 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-5edc5d5d-88f2-490e-8517-7338bdd0ac5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:57.543652 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:57.571267 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 483/956] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:36:57.594331 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ecec67-9083-4bb9-a5c8-0b7dfaa6116d None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:57.613985 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:57.704986 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ecec67-9083-4bb9-a5c8-0b7dfaa6116d None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:57.741395 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266ff43-9de2-4fe3-b8cd-da7279203b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:57.742112 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266ff43-9de2-4fe3-b8cd-da7279203b79 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:57.742382 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266ff43-9de2-4fe3-b8cd-da7279203b79 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:57.742658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266ff43-9de2-4fe3-b8cd-da7279203b79 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:57.743312 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266ff43-9de2-4fe3-b8cd-da7279203b79 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:57.745250 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266ff43-9de2-4fe3-b8cd-da7279203b79 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:57.757286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-6266ff43-9de2-4fe3-b8cd-da7279203b79 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:36:57.757286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:57.757286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:36:57.757286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:36:57.757286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:36:57.757286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:36:57.757286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:36:57.757286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:36:57.757286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:36:57.757286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:57.757286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:36:57.757286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:57.757286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:57.757286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:57.757286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:57.757286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:57.757286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:57.758350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:57.758350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:57.758350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:57.758350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:57.758350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:57.758350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:57.758350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:36:57.758350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:36:57.758350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:36:57.758350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:36:57.758350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:57.758350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:57.758350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:57.758350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:57.758350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:57.758350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:57.759275 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:57.759275 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:57.759275 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:57.759275 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:57.759275 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:57.759275 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:57.759275 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:57.759275 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:57.759275 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:57.759275 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:57.759275 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:36:57.759275 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:36:57.759275 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:36:57.759275 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:57.759275 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 474/957] 10.222.0.39 () {56 vars in 1126 bytes} [Mon May 23 15:36:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:57.764768 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc5d5d-88f2-490e-8517-7338bdd0ac5d None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:57.872391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc5d5d-88f2-490e-8517-7338bdd0ac5d None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:57.911533 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3df2cb-a985-4ea2-9d34-44674bd07c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:57.912229 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3df2cb-a985-4ea2-9d34-44674bd07c4b None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:57.912512 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3df2cb-a985-4ea2-9d34-44674bd07c4b None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:57.912786 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3df2cb-a985-4ea2-9d34-44674bd07c4b None admin] PATH_INFO: `/v3/services` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:57.913496 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3df2cb-a985-4ea2-9d34-44674bd07c4b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:57.913804 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3df2cb-a985-4ea2-9d34-44674bd07c4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:57.915172 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3df2cb-a985-4ea2-9d34-44674bd07c4b None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:57.921236 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 484/958] 10.222.0.39 () {56 vars in 1122 bytes} [Mon May 23 15:36:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:57.926731 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266ff43-9de2-4fe3-b8cd-da7279203b79 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:58.019069 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:58.039494 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266ff43-9de2-4fe3-b8cd-da7279203b79 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:58.075908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b98b8-6994-41fc-a53b-7b31a24a17fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:58.076580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b98b8-6994-41fc-a53b-7b31a24a17fc None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:58.076863 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b98b8-6994-41fc-a53b-7b31a24a17fc None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:58.077139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b98b8-6994-41fc-a53b-7b31a24a17fc None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:58.077328 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e112797-6c89-4c52-85ba-e03ec2a52582 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:58.077571 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e112797-6c89-4c52-85ba-e03ec2a52582 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:58.077850 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e112797-6c89-4c52-85ba-e03ec2a52582 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:58.078031 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b98b8-6994-41fc-a53b-7b31a24a17fc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:58.078179 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b98b8-6994-41fc-a53b-7b31a24a17fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:58.079518 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b98b8-6994-41fc-a53b-7b31a24a17fc None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:58.080585 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 485/959] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:36:58.084626 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f961e9-2906-4443-aa40-9ec913094e3c None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:58.084909 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f961e9-2906-4443-aa40-9ec913094e3c None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:58.085219 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 475/960] 10.222.0.39 () {56 vars in 1122 bytes} [Mon May 23 15:36:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:58.085384 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f961e9-2906-4443-aa40-9ec913094e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:58.092363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b98b8-6994-41fc-a53b-7b31a24a17fc None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:58.109836 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-27f961e9-2906-4443-aa40-9ec913094e3c None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:58.111015 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-27f961e9-2906-4443-aa40-9ec913094e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:58.171999 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:58.183872 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 486/961] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:36:58.212772 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f961e9-2906-4443-aa40-9ec913094e3c None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:58.219157 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b98b8-6994-41fc-a53b-7b31a24a17fc None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:58.266877 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10670a84-6a1c-47b2-ac85-e55d92fe5985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:58.267558 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10670a84-6a1c-47b2-ac85-e55d92fe5985 None admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:58.268144 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10670a84-6a1c-47b2-ac85-e55d92fe5985 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:58.268427 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10670a84-6a1c-47b2-ac85-e55d92fe5985 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:58.269746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10670a84-6a1c-47b2-ac85-e55d92fe5985 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:58.271657 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10670a84-6a1c-47b2-ac85-e55d92fe5985 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:58.329417 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f961e9-2906-4443-aa40-9ec913094e3c None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:58.351305 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:58.364234 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 476/962] 10.222.0.39 () {60 vars in 1144 bytes} [Mon May 23 15:36:58 2022] POST /identity/v3/endpoints => generated 349 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:36:58.379264 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5bbab-eb77-407f-8430-659e2afe9c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:58.380301 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5bbab-eb77-407f-8430-659e2afe9c29 None admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:58.380766 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5bbab-eb77-407f-8430-659e2afe9c29 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:58.381252 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5bbab-eb77-407f-8430-659e2afe9c29 None admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:58.382223 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5bbab-eb77-407f-8430-659e2afe9c29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:58.384546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5bbab-eb77-407f-8430-659e2afe9c29 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:58.386149 dv-cinder-842119-2-smb devstack@keystone.service[87191]: WARNING keystone.server.flask.common [None req-84e5bbab-eb77-407f-8430-659e2afe9c29 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 23 15:36:58.440785 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.sql.core [None req-84e5bbab-eb77-407f-8430-659e2afe9c29 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 23 15:36:58.440785 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 23 15:36:58.440785 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [parameters: {'user_id': '9338c4d477a74a41b7aeef37c636300b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 23 15:36:58.440785 dv-cinder-842119-2-smb devstack@keystone.service[87191]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87191) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 23 15:36:58.458980 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-84e5bbab-eb77-407f-8430-659e2afe9c29 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 23 15:36:58.458980 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:58.458980 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 15:36:58.458980 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 15:36:58.458980 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 15:36:58.458980 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 15:36:58.458980 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 15:36:58.458980 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application result = self._query(query) May 23 15:36:58.458980 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 15:36:58.458980 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application conn.query(q) May 23 15:36:58.458980 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 15:36:58.458980 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 15:36:58.458980 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 15:36:58.458980 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application result.read() May 23 15:36:58.458980 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 15:36:58.460162 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 15:36:58.460162 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 15:36:58.460162 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 15:36:58.460162 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 15:36:58.460162 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 15:36:58.460162 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 15:36:58.460162 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 15:36:58.460162 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 23 15:36:58.460162 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:58.460162 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 23 15:36:58.460162 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:58.460162 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:58.460162 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 23 15:36:58.460162 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 23 15:36:58.460162 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 23 15:36:58.460162 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 23 15:36:58.460162 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 15:36:58.460162 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application next(self.gen) May 23 15:36:58.461154 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 23 15:36:58.461154 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application yield resource May 23 15:36:58.461154 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 15:36:58.461154 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application next(self.gen) May 23 15:36:58.461154 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 23 15:36:58.461154 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application self.session.rollback() May 23 15:36:58.461154 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 23 15:36:58.461154 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application self.force_reraise() May 23 15:36:58.461154 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 23 15:36:58.461154 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise self.value May 23 15:36:58.461154 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 23 15:36:58.461154 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 23 15:36:58.461154 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 23 15:36:58.461154 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application session.commit() May 23 15:36:58.461154 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 23 15:36:58.461154 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 23 15:36:58.461154 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 23 15:36:58.462038 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application self._prepare_impl() May 23 15:36:58.462038 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 23 15:36:58.462038 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application self.session.flush() May 23 15:36:58.462038 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 23 15:36:58.462038 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application self._flush(objects) May 23 15:36:58.462038 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 23 15:36:58.462038 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 23 15:36:58.462038 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 23 15:36:58.462038 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application compat.raise_( May 23 15:36:58.462038 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 15:36:58.462038 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception May 23 15:36:58.462038 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 23 15:36:58.462038 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application flush_context.execute() May 23 15:36:58.462038 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 23 15:36:58.462038 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rec.execute(self) May 23 15:36:58.462038 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 23 15:36:58.462038 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 23 15:36:58.463235 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 23 15:36:58.463235 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application _emit_insert_statements( May 23 15:36:58.463235 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 23 15:36:58.463235 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application result = connection._execute_20( May 23 15:36:58.463235 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 23 15:36:58.463235 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 23 15:36:58.463235 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 23 15:36:58.463235 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 23 15:36:58.463235 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 23 15:36:58.463235 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ret = self._execute_context( May 23 15:36:58.463235 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 23 15:36:58.463235 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 23 15:36:58.463235 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 23 15:36:58.463235 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 23 15:36:58.463235 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 15:36:58.463235 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception May 23 15:36:58.464310 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 15:36:58.464310 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 15:36:58.464310 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 15:36:58.464310 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 15:36:58.464310 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 15:36:58.464310 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application result = self._query(query) May 23 15:36:58.464310 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 15:36:58.464310 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application conn.query(q) May 23 15:36:58.464310 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 15:36:58.464310 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 15:36:58.464310 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 15:36:58.464310 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application result.read() May 23 15:36:58.464310 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 15:36:58.464310 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 15:36:58.464310 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 15:36:58.464310 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 15:36:58.465278 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 15:36:58.465278 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 15:36:58.465278 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 15:36:58.465278 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 15:36:58.465278 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 23 15:36:58.465278 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 23 15:36:58.465278 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [parameters: {'user_id': '9338c4d477a74a41b7aeef37c636300b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 23 15:36:58.465278 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 23 15:36:58.465278 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:58.465278 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:36:58.465278 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:58.465278 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:58.465278 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:58.465278 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:58.465278 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:58.466158 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:58.466158 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:58.466158 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:58.466158 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:58.466158 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:58.466158 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:58.466158 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:58.466158 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 23 15:36:58.466158 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 23 15:36:58.466158 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:58.466158 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:58.466158 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:36:58.466158 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:58.466158 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:36:58.466158 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:58.466158 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 23 15:36:58.466158 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 23 15:36:58.467231 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 23 15:36:58.467231 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 23 15:36:58.467231 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 23 15:36:58.467231 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 23 15:36:58.467231 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 23 15:36:58.467231 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:58.469573 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 487/963] 10.222.0.39 () {60 vars in 1131 bytes} [Mon May 23 15:36:58 2022] POST /identity/v3/users => generated 160 bytes in 258 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 23 15:36:58.475587 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10670a84-6a1c-47b2-ac85-e55d92fe5985 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:58.518592 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0629559-43c6-4a85-9797-c9460851dc96 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:58.518889 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0629559-43c6-4a85-9797-c9460851dc96 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:58.519166 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0629559-43c6-4a85-9797-c9460851dc96 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:58.528210 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 488/964] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:36:58.530081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba120883-20df-4590-959a-82d31f863f05 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:58.530370 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba120883-20df-4590-959a-82d31f863f05 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:58.530647 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba120883-20df-4590-959a-82d31f863f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:58.552092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-ba120883-20df-4590-959a-82d31f863f05 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:58.553881 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-ba120883-20df-4590-959a-82d31f863f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:58.585945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:58.601042 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10670a84-6a1c-47b2-ac85-e55d92fe5985 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:58.640877 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738ff56-904b-4664-9665-957ba0816f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:58.641680 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738ff56-904b-4664-9665-957ba0816f3f None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:58.642893 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738ff56-904b-4664-9665-957ba0816f3f None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:58.642893 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738ff56-904b-4664-9665-957ba0816f3f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:58.648571 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 489/965] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:36:58.650828 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738ff56-904b-4664-9665-957ba0816f3f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:58.655642 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738ff56-904b-4664-9665-957ba0816f3f None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:58.672503 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba120883-20df-4590-959a-82d31f863f05 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:58.675789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-5738ff56-904b-4664-9665-957ba0816f3f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 15:36:58.675789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:58.675789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:58.675789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:58.675789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:58.675789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:58.675789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:58.675789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:58.675789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:58.675789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:58.675789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:58.675789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:58.675789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:36:58.675789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:36:58.675789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:36:58.675789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:36:58.676746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:58.676746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:58.676746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:36:58.676746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:58.676746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:36:58.676746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:58.676746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:58.676746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:58.676746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:58.676746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:58.676746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:58.676746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:58.676746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:58.676746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:58.676746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:58.676746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:58.676746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:58.676746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:58.678295 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:58.678295 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:58.678295 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:36:58.678295 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:36:58.678295 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:36:58.678295 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:36:58.678295 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:36:58.678295 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:36:58.678295 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 15:36:58.678295 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:58.678295 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 477/966] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:36:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:58.685036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738ff56-904b-4664-9665-957ba0816f3f None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:58.760312 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:58.799396 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba120883-20df-4590-959a-82d31f863f05 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:58.814356 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738ff56-904b-4664-9665-957ba0816f3f None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:58.844068 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf29ad7-1e15-46d6-99cf-9f22692c5ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:58.845586 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf29ad7-1e15-46d6-99cf-9f22692c5ea1 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:58.845871 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf29ad7-1e15-46d6-99cf-9f22692c5ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:58.846142 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf29ad7-1e15-46d6-99cf-9f22692c5ea1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:58.858790 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13da537-ad76-46c8-981f-28f4b84c1d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:58.859459 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13da537-ad76-46c8-981f-28f4b84c1d6e None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:58.859786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13da537-ad76-46c8-981f-28f4b84c1d6e None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:58.860061 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13da537-ad76-46c8-981f-28f4b84c1d6e None admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:58.860882 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13da537-ad76-46c8-981f-28f4b84c1d6e None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:58.861430 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13da537-ad76-46c8-981f-28f4b84c1d6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:58.862045 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf29ad7-1e15-46d6-99cf-9f22692c5ea1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:36:58.862872 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13da537-ad76-46c8-981f-28f4b84c1d6e None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:58.871096 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-1cf29ad7-1e15-46d6-99cf-9f22692c5ea1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:36:58.871096 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:58.871096 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:58.871096 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:58.871096 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:58.871096 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:58.871096 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:58.871096 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:58.871096 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:58.871096 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:58.871096 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:58.871096 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:58.871096 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:36:58.871096 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:36:58.871096 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:36:58.871096 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:36:58.872408 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:36:58.872408 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:36:58.872408 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:36:58.872408 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:36:58.872408 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:58.872408 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:58.872408 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:58.872408 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:58.872408 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:58.872408 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:58.872408 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:58.872408 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:36:58.872408 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:58.872408 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:58.872408 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:58.872408 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:58.873257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:58.873257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:58.873257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:58.873257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:58.873257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:36:58.873257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:36:58.873257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:36:58.873257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:36:58.873257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:36:58.873257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:36:58.873257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:36:58.873257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:36:58.881505 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 490/967] 10.222.0.39 () {56 vars in 1120 bytes} [Mon May 23 15:36:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:36:58.884040 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf29ad7-1e15-46d6-99cf-9f22692c5ea1 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:58.904831 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 478/968] 10.222.0.39 () {56 vars in 1101 bytes} [Mon May 23 15:36:58 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:58.905403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:59.009520 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf29ad7-1e15-46d6-99cf-9f22692c5ea1 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:59.047271 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71afc05-a9ce-4bb3-a9da-8706b9ec9d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:59.048001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71afc05-a9ce-4bb3-a9da-8706b9ec9d91 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:59.048290 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71afc05-a9ce-4bb3-a9da-8706b9ec9d91 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:59.048568 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71afc05-a9ce-4bb3-a9da-8706b9ec9d91 None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:59.049343 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71afc05-a9ce-4bb3-a9da-8706b9ec9d91 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:59.049710 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71afc05-a9ce-4bb3-a9da-8706b9ec9d91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:59.051219 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71afc05-a9ce-4bb3-a9da-8706b9ec9d91 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:59.061811 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 491/969] 10.222.0.39 () {56 vars in 1115 bytes} [Mon May 23 15:36:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:59.067702 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13da537-ad76-46c8-981f-28f4b84c1d6e None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:59.178388 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13da537-ad76-46c8-981f-28f4b84c1d6e None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:59.198036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:59.224599 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f8713-1c02-4656-bd21-535e77956fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:59.224896 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f8713-1c02-4656-bd21-535e77956fb1 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:59.225178 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f8713-1c02-4656-bd21-535e77956fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:59.225448 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f8713-1c02-4656-bd21-535e77956fb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:59.239801 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f8713-1c02-4656-bd21-535e77956fb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:59.241263 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f8713-1c02-4656-bd21-535e77956fb1 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:59.261730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-dd0f8713-1c02-4656-bd21-535e77956fb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:59.261730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:59.261730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:59.261730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:59.261730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:59.261730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:59.261730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:59.261730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:59.261730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:59.261730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:59.261730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:59.261730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:59.261730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:36:59.261730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:36:59.261730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:36:59.262683 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:36:59.262683 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:59.262683 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:59.262683 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:59.262683 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:59.262683 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:59.262683 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:59.262683 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:59.262683 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:59.262683 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:59.262683 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:59.262683 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:59.262683 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:59.262683 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:59.262683 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:59.262683 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:59.262683 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:59.263854 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:36:59.263854 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:36:59.263854 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:36:59.263854 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:59.263854 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 479/970] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:36:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:36:59.270121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71afc05-a9ce-4bb3-a9da-8706b9ec9d91 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:59.355561 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:59.378470 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71afc05-a9ce-4bb3-a9da-8706b9ec9d91 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:59.414378 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d9aaa-ce5a-4d80-9c6d-5ceae5acb7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:59.415037 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d9aaa-ce5a-4d80-9c6d-5ceae5acb7ea None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:59.416033 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d9aaa-ce5a-4d80-9c6d-5ceae5acb7ea None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:59.416325 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d9aaa-ce5a-4d80-9c6d-5ceae5acb7ea None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:59.417045 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d9aaa-ce5a-4d80-9c6d-5ceae5acb7ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:59.417355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d9aaa-ce5a-4d80-9c6d-5ceae5acb7ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:59.418772 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d9aaa-ce5a-4d80-9c6d-5ceae5acb7ea None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:59.435925 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 492/971] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:36:59.437406 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f8713-1c02-4656-bd21-535e77956fb1 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:59.531523 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db869b71-5b37-4264-b59a-6f66c55f76b6 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:59.531909 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db869b71-5b37-4264-b59a-6f66c55f76b6 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:59.532137 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db869b71-5b37-4264-b59a-6f66c55f76b6 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:59.533670 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 493/972] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:36:59.538372 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340b56b-c77c-41d6-8560-ce4be295e5c5 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:59.538781 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340b56b-c77c-41d6-8560-ce4be295e5c5 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:59.539161 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340b56b-c77c-41d6-8560-ce4be295e5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:59.539640 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f8713-1c02-4656-bd21-535e77956fb1 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:59.557244 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-9340b56b-c77c-41d6-8560-ce4be295e5c5 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:59.558590 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-9340b56b-c77c-41d6-8560-ce4be295e5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:59.579948 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1eacef-4b82-4ed8-852d-459356621989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:59.580914 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1eacef-4b82-4ed8-852d-459356621989 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:59.581295 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1eacef-4b82-4ed8-852d-459356621989 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:59.581697 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1eacef-4b82-4ed8-852d-459356621989 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:59.590722 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1eacef-4b82-4ed8-852d-459356621989 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:59.592262 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1eacef-4b82-4ed8-852d-459356621989 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:59.609726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-cd1eacef-4b82-4ed8-852d-459356621989 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:36:59.609726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:36:59.609726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:36:59.609726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:36:59.609726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:36:59.609726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:36:59.609726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:36:59.609726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:36:59.609726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:36:59.609726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:36:59.609726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:36:59.609726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:36:59.609726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:36:59.609726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:36:59.609726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:36:59.609726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:36:59.610710 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:36:59.610710 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:36:59.610710 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:36:59.610710 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:59.610710 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:36:59.610710 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:36:59.610710 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:36:59.610710 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:36:59.610710 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:36:59.610710 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:36:59.610710 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:36:59.610710 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:36:59.610710 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:36:59.610710 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:36:59.610710 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:36:59.610710 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:36:59.610710 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:36:59.610710 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:36:59.611789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:36:59.611789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:36:59.611789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:36:59.611789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:36:59.611789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:36:59.611789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:36:59.611789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:36:59.611789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:36:59.611789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:36:59.611789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:36:59.611789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 480/973] 10.222.0.39 () {56 vars in 1117 bytes} [Mon May 23 15:36:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:36:59.616862 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1eacef-4b82-4ed8-852d-459356621989 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:59.637228 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 494/974] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:36:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:36:59.648258 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:59.660193 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340b56b-c77c-41d6-8560-ce4be295e5c5 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:59.728129 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:59.730680 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1eacef-4b82-4ed8-852d-459356621989 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:59.766552 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340b56b-c77c-41d6-8560-ce4be295e5c5 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:59.771532 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbdae77-4e79-4577-9eac-da5c7a68585f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:59.772300 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbdae77-4e79-4577-9eac-da5c7a68585f None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:59.772517 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbdae77-4e79-4577-9eac-da5c7a68585f None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:59.772789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbdae77-4e79-4577-9eac-da5c7a68585f None admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:59.773618 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbdae77-4e79-4577-9eac-da5c7a68585f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:36:59.773923 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbdae77-4e79-4577-9eac-da5c7a68585f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:59.776306 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbdae77-4e79-4577-9eac-da5c7a68585f None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:59.794761 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 481/975] 10.222.0.39 () {56 vars in 1149 bytes} [Mon May 23 15:36:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:36:59.800026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbdae77-4e79-4577-9eac-da5c7a68585f None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:59.803230 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ef83b-8ff3-4d12-aeb2-33fa67a78f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:59.803932 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ef83b-8ff3-4d12-aeb2-33fa67a78f1c None admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:59.804221 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ef83b-8ff3-4d12-aeb2-33fa67a78f1c None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:59.804503 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ef83b-8ff3-4d12-aeb2-33fa67a78f1c None admin] PATH_INFO: `/v3/services` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:59.805232 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ef83b-8ff3-4d12-aeb2-33fa67a78f1c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:59.807400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ef83b-8ff3-4d12-aeb2-33fa67a78f1c None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:59.883716 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 495/976] 10.222.0.39 () {60 vars in 1141 bytes} [Mon May 23 15:36:59 2022] POST /identity/v3/services => generated 242 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:36:59.902442 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:59.915775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbdae77-4e79-4577-9eac-da5c7a68585f None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:59.960539 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d4c23-ad96-4837-814d-56bd96cdac84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:59.961193 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d4c23-ad96-4837-814d-56bd96cdac84 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:59.961473 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d4c23-ad96-4837-814d-56bd96cdac84 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:59.961745 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d4c23-ad96-4837-814d-56bd96cdac84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:00.036267 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353d4c23-ad96-4837-814d-56bd96cdac84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:00.037773 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353d4c23-ad96-4837-814d-56bd96cdac84 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:00.124690 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:00.145919 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 482/977] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:36:59 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 15:37:00.147968 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ef83b-8ff3-4d12-aeb2-33fa67a78f1c None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:00.263233 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ef83b-8ff3-4d12-aeb2-33fa67a78f1c None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:00.290788 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:00.299092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f9b1c-49a3-4008-b76e-0418808064e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:00.299968 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f9b1c-49a3-4008-b76e-0418808064e3 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:00.300304 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f9b1c-49a3-4008-b76e-0418808064e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:00.300531 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f9b1c-49a3-4008-b76e-0418808064e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:00.311164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f9b1c-49a3-4008-b76e-0418808064e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:00.312656 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f9b1c-49a3-4008-b76e-0418808064e3 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:00.330390 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-227f9b1c-49a3-4008-b76e-0418808064e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:37:00.330390 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:00.330390 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:37:00.330390 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:37:00.330390 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:37:00.330390 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:37:00.330390 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:37:00.330390 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:37:00.330390 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:37:00.330390 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:37:00.330390 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:37:00.330390 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:37:00.330390 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:37:00.330390 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:37:00.330390 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:37:00.331321 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:37:00.331321 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:37:00.331321 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:37:00.331321 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:37:00.331321 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:37:00.331321 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:37:00.331321 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:37:00.331321 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:37:00.331321 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:37:00.331321 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:37:00.331321 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:37:00.331321 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:37:00.331321 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:37:00.331321 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:37:00.331321 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:37:00.331321 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:37:00.331321 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:37:00.332244 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:37:00.332244 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:37:00.332244 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:37:00.332244 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:00.332969 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 496/978] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:37:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:37:00.338094 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d4c23-ad96-4837-814d-56bd96cdac84 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:00.440017 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d4c23-ad96-4837-814d-56bd96cdac84 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:00.474317 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3568d9-29a7-49d7-9678-b9c13ced812f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:00.474976 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3568d9-29a7-49d7-9678-b9c13ced812f None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:00.475258 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3568d9-29a7-49d7-9678-b9c13ced812f None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:00.475532 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3568d9-29a7-49d7-9678-b9c13ced812f None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:00.476277 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3568d9-29a7-49d7-9678-b9c13ced812f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:00.476583 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3568d9-29a7-49d7-9678-b9c13ced812f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:00.478530 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3568d9-29a7-49d7-9678-b9c13ced812f None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:00.495230 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 483/979] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:00.496667 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f9b1c-49a3-4008-b76e-0418808064e3 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:00.610825 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f9b1c-49a3-4008-b76e-0418808064e3 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:00.646369 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88e11d-a35a-461d-ba5a-11e8b3f2125c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:00.647312 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88e11d-a35a-461d-ba5a-11e8b3f2125c None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:00.647730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88e11d-a35a-461d-ba5a-11e8b3f2125c None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:00.648108 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88e11d-a35a-461d-ba5a-11e8b3f2125c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:00.655971 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb88e11d-a35a-461d-ba5a-11e8b3f2125c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:00.657431 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb88e11d-a35a-461d-ba5a-11e8b3f2125c None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:00.672793 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-eb88e11d-a35a-461d-ba5a-11e8b3f2125c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:37:00.672793 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:00.672793 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:37:00.672793 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:37:00.672793 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:37:00.672793 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:37:00.672793 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:37:00.672793 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:37:00.672793 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:37:00.672793 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:37:00.672793 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:37:00.672793 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:37:00.672793 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:37:00.672793 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:37:00.672793 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:37:00.673701 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:37:00.673701 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:37:00.673701 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:37:00.673701 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:37:00.673701 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:37:00.673701 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:37:00.673701 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:37:00.673701 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:37:00.673701 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:37:00.673701 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:37:00.673701 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:37:00.673701 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:37:00.673701 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:37:00.673701 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:37:00.673701 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:37:00.673701 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:37:00.673701 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:37:00.674630 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:37:00.674630 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:37:00.674630 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:37:00.674630 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:37:00.674630 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:37:00.674630 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:37:00.674630 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:37:00.674630 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:00.675816 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 497/980] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:37:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:37:00.679829 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3568d9-29a7-49d7-9678-b9c13ced812f None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:00.698946 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedac14-f795-4159-8b63-826234825567 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:00.699142 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedac14-f795-4159-8b63-826234825567 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:00.699419 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedac14-f795-4159-8b63-826234825567 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:00.703679 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 498/981] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:37:00.705938 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98694bf7-a7ab-4d0d-85f0-8b2737142d45 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:00.706290 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98694bf7-a7ab-4d0d-85f0-8b2737142d45 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:00.706635 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98694bf7-a7ab-4d0d-85f0-8b2737142d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:00.724598 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-98694bf7-a7ab-4d0d-85f0-8b2737142d45 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:00.725778 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-98694bf7-a7ab-4d0d-85f0-8b2737142d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:00.732581 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:00.764909 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:00.788196 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3568d9-29a7-49d7-9678-b9c13ced812f None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:00.798225 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 499/982] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:37:00 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:37:00.820510 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98694bf7-a7ab-4d0d-85f0-8b2737142d45 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:00.823297 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec761846-6011-4729-9ba3-4a564b6116c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:00.823990 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec761846-6011-4729-9ba3-4a564b6116c7 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:00.824272 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec761846-6011-4729-9ba3-4a564b6116c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:00.824546 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec761846-6011-4729-9ba3-4a564b6116c7 None admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:00.825359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec761846-6011-4729-9ba3-4a564b6116c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:00.825665 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec761846-6011-4729-9ba3-4a564b6116c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:00.827100 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec761846-6011-4729-9ba3-4a564b6116c7 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:00.845430 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 484/983] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:37:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:37:00.846244 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec761846-6011-4729-9ba3-4a564b6116c7 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:00.923889 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98694bf7-a7ab-4d0d-85f0-8b2737142d45 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:00.951225 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec761846-6011-4729-9ba3-4a564b6116c7 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:00.954324 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:00.959712 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b266cfa-a631-44dd-a6cc-9715f3d39b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:00.960514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b266cfa-a631-44dd-a6cc-9715f3d39b88 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:00.960799 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b266cfa-a631-44dd-a6cc-9715f3d39b88 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:00.961070 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b266cfa-a631-44dd-a6cc-9715f3d39b88 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:00.961723 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b266cfa-a631-44dd-a6cc-9715f3d39b88 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:00.963486 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b266cfa-a631-44dd-a6cc-9715f3d39b88 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:00.976525 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-3b266cfa-a631-44dd-a6cc-9715f3d39b88 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:37:00.976525 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:00.976525 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:37:00.976525 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:37:00.976525 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:37:00.976525 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:37:00.976525 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:37:00.976525 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:37:00.976525 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:37:00.976525 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:00.976525 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:37:00.976525 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:00.976525 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:00.976525 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:37:00.976525 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:37:00.976525 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:37:00.976525 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:37:00.977514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:37:00.977514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:37:00.977514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:37:00.977514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:37:00.977514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:37:00.977514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:37:00.977514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:37:00.977514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:37:00.977514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:37:00.977514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:37:00.977514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:37:00.977514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:37:00.977514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:37:00.977514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:37:00.977514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:37:00.977514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:37:00.978963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:37:00.978963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:37:00.978963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:37:00.978963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:37:00.978963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:37:00.978963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:37:00.978963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:37:00.978963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:37:00.978963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:37:00.978963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:37:00.978963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:37:00.978963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:37:00.978963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:37:00.978963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:00.978963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 500/984] 10.222.0.39 () {56 vars in 1126 bytes} [Mon May 23 15:37:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:37:00.984735 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b266cfa-a631-44dd-a6cc-9715f3d39b88 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:00.990047 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e459ef-7ea8-4d01-ba49-b6fd6c7a27f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:00.990705 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e459ef-7ea8-4d01-ba49-b6fd6c7a27f5 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:00.990991 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e459ef-7ea8-4d01-ba49-b6fd6c7a27f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:00.991268 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e459ef-7ea8-4d01-ba49-b6fd6c7a27f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:00.992134 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e459ef-7ea8-4d01-ba49-b6fd6c7a27f5 None admin] RBAC: Adding query filter params (role.id=c5b2044766b04373a9900a04296f71c3, scope.project.id=8addb03b903842609168ee2fafc8ec6b, user.id=048fc48dd55a43f7b342533a9484c3ad) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:00.992452 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e459ef-7ea8-4d01-ba49-b6fd6c7a27f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:00.994014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e459ef-7ea8-4d01-ba49-b6fd6c7a27f5 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:01.011648 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 485/985] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:37:00 2022] GET /identity/v3/role_assignments?user.id=048fc48dd55a43f7b342533a9484c3ad&scope.project.id=8addb03b903842609168ee2fafc8ec6b&role.id=c5b2044766b04373a9900a04296f71c3 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:01.035504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:01.111213 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b266cfa-a631-44dd-a6cc-9715f3d39b88 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:01.148428 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ecb6d-1313-47c4-957c-d96cbd7eb391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:01.149105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ecb6d-1313-47c4-957c-d96cbd7eb391 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:01.149887 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ecb6d-1313-47c4-957c-d96cbd7eb391 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:01.150184 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ecb6d-1313-47c4-957c-d96cbd7eb391 None admin] PATH_INFO: `/v3/services` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:01.151101 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ecb6d-1313-47c4-957c-d96cbd7eb391 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:01.151414 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ecb6d-1313-47c4-957c-d96cbd7eb391 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:01.152831 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ecb6d-1313-47c4-957c-d96cbd7eb391 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:01.158373 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 501/986] 10.222.0.39 () {56 vars in 1122 bytes} [Mon May 23 15:37:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:37:01.164449 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e459ef-7ea8-4d01-ba49-b6fd6c7a27f5 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:01.281654 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e459ef-7ea8-4d01-ba49-b6fd6c7a27f5 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:01.317088 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443bc1c0-ddd5-41b5-a682-9cf71dc0b9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:01.317755 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bc1c0-ddd5-41b5-a682-9cf71dc0b9b6 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:01.318039 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bc1c0-ddd5-41b5-a682-9cf71dc0b9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:01.318315 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bc1c0-ddd5-41b5-a682-9cf71dc0b9b6 None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:01.319015 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443bc1c0-ddd5-41b5-a682-9cf71dc0b9b6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:01.319322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443bc1c0-ddd5-41b5-a682-9cf71dc0b9b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:01.320715 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443bc1c0-ddd5-41b5-a682-9cf71dc0b9b6 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:01.330747 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 486/987] 10.222.0.39 () {56 vars in 1122 bytes} [Mon May 23 15:37:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:01.332332 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ecb6d-1313-47c4-957c-d96cbd7eb391 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:01.434527 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:01.438741 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ecb6d-1313-47c4-957c-d96cbd7eb391 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:01.473543 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eeb7d1-fd5b-490f-83c1-0562f0c1f028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:01.474125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eeb7d1-fd5b-490f-83c1-0562f0c1f028 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:01.474409 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eeb7d1-fd5b-490f-83c1-0562f0c1f028 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:01.474686 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eeb7d1-fd5b-490f-83c1-0562f0c1f028 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:01.475489 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eeb7d1-fd5b-490f-83c1-0562f0c1f028 None admin] RBAC: Adding query filter params (interface=admin, service_id=6182ef4ecd65460093710afd7e92a0ab, region_id=RegionOne) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:01.475834 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eeb7d1-fd5b-490f-83c1-0562f0c1f028 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:01.477217 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eeb7d1-fd5b-490f-83c1-0562f0c1f028 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:01.487945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 502/988] 10.222.0.39 () {56 vars in 1249 bytes} [Mon May 23 15:37:01 2022] GET /identity/v3/endpoints?service_id=6182ef4ecd65460093710afd7e92a0ab&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:01.489199 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443bc1c0-ddd5-41b5-a682-9cf71dc0b9b6 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:01.521956 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:01.591866 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443bc1c0-ddd5-41b5-a682-9cf71dc0b9b6 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:01.627985 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6386f-5552-45b5-b2a6-374b15d153e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:01.628650 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6386f-5552-45b5-b2a6-374b15d153e9 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:01.628934 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6386f-5552-45b5-b2a6-374b15d153e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:01.629210 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6386f-5552-45b5-b2a6-374b15d153e9 None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:01.629891 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6386f-5552-45b5-b2a6-374b15d153e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:01.631262 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6386f-5552-45b5-b2a6-374b15d153e9 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:01.643887 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 487/989] 10.222.0.39 () {56 vars in 1087 bytes} [Mon May 23 15:37:01 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:37:02.135855 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7177aad-dbd1-4965-96db-01c634d7a056 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:02.136367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7177aad-dbd1-4965-96db-01c634d7a056 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:02.136445 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7177aad-dbd1-4965-96db-01c634d7a056 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:02.137894 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 503/990] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:37:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:02.143445 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bcf7d-7acd-4964-be42-189aa01cac7a None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:02.143980 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bcf7d-7acd-4964-be42-189aa01cac7a None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:02.144086 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bcf7d-7acd-4964-be42-189aa01cac7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:02.162002 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-999bcf7d-7acd-4964-be42-189aa01cac7a None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:02.163188 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-999bcf7d-7acd-4964-be42-189aa01cac7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:02.241254 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 488/991] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:37:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:37:02.265776 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7177aad-dbd1-4965-96db-01c634d7a056 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:02.370727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7177aad-dbd1-4965-96db-01c634d7a056 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:02.406033 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a75cc-a097-4c9b-9b6b-1b82440ff378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:02.406749 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a75cc-a097-4c9b-9b6b-1b82440ff378 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:02.407035 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a75cc-a097-4c9b-9b6b-1b82440ff378 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:02.407313 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a75cc-a097-4c9b-9b6b-1b82440ff378 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:02.408004 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a75cc-a097-4c9b-9b6b-1b82440ff378 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:02.409378 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a75cc-a097-4c9b-9b6b-1b82440ff378 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:02.421688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-209a75cc-a097-4c9b-9b6b-1b82440ff378 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 23 15:37:02.421688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:02.421688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:37:02.421688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:37:02.421688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:37:02.421688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:37:02.421688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:37:02.421688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:37:02.421688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 15:37:02.421688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:02.421688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:37:02.421688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:02.421688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:02.421688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:37:02.421688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:37:02.421688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:37:02.421688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:37:02.422694 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:37:02.422694 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:37:02.422694 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:37:02.422694 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:37:02.422694 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:37:02.422694 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:37:02.422694 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:37:02.422694 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:37:02.422694 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:37:02.422694 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:37:02.422694 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:37:02.422694 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:37:02.422694 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:37:02.422694 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:37:02.422694 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:37:02.422694 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:37:02.428544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:37:02.428544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:37:02.428544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:37:02.428544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:37:02.428544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:37:02.428544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:37:02.428544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:37:02.428544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:37:02.428544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:37:02.428544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:37:02.428544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:37:02.428544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:37:02.428544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 15:37:02.428544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:02.428544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 504/992] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:37:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:37:02.431701 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999bcf7d-7acd-4964-be42-189aa01cac7a None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:02.458563 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:02.532128 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999bcf7d-7acd-4964-be42-189aa01cac7a None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:02.566506 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728fcc6-a78a-43d0-899b-9c7f36a49a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:02.567172 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728fcc6-a78a-43d0-899b-9c7f36a49a46 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:02.567453 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728fcc6-a78a-43d0-899b-9c7f36a49a46 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:02.567761 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728fcc6-a78a-43d0-899b-9c7f36a49a46 None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:02.568461 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728fcc6-a78a-43d0-899b-9c7f36a49a46 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:02.568767 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728fcc6-a78a-43d0-899b-9c7f36a49a46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:02.570142 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728fcc6-a78a-43d0-899b-9c7f36a49a46 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:02.579623 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 489/993] 10.222.0.39 () {56 vars in 1112 bytes} [Mon May 23 15:37:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:02.580864 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a75cc-a097-4c9b-9b6b-1b82440ff378 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:02.610816 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:02.697921 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a75cc-a097-4c9b-9b6b-1b82440ff378 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:02.731886 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dcec3-1741-4aab-9a7c-2fc1bc389a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:02.732547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dcec3-1741-4aab-9a7c-2fc1bc389a00 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:02.732828 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dcec3-1741-4aab-9a7c-2fc1bc389a00 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:02.733104 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dcec3-1741-4aab-9a7c-2fc1bc389a00 None admin] PATH_INFO: `/v3/services` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:02.733809 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212dcec3-1741-4aab-9a7c-2fc1bc389a00 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:02.734113 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212dcec3-1741-4aab-9a7c-2fc1bc389a00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:02.735501 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212dcec3-1741-4aab-9a7c-2fc1bc389a00 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:02.742224 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 505/994] 10.222.0.39 () {56 vars in 1112 bytes} [Mon May 23 15:37:02 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:02.747730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728fcc6-a78a-43d0-899b-9c7f36a49a46 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:02.841466 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:02.851025 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728fcc6-a78a-43d0-899b-9c7f36a49a46 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:02.886650 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75995a4d-e354-4870-a92b-bb3d28e16c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:02.887306 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75995a4d-e354-4870-a92b-bb3d28e16c68 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:02.887589 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75995a4d-e354-4870-a92b-bb3d28e16c68 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:02.888003 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75995a4d-e354-4870-a92b-bb3d28e16c68 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:02.888791 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75995a4d-e354-4870-a92b-bb3d28e16c68 None admin] RBAC: Adding query filter params (interface=public, service_id=00f7de88407d467794cb0a9324a6f55f, region_id=RegionOne) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:02.889101 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75995a4d-e354-4870-a92b-bb3d28e16c68 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:02.890491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75995a4d-e354-4870-a92b-bb3d28e16c68 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:02.899756 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 490/995] 10.222.0.39 () {56 vars in 1251 bytes} [Mon May 23 15:37:02 2022] GET /identity/v3/endpoints?service_id=00f7de88407d467794cb0a9324a6f55f&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:37:02.901890 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dcec3-1741-4aab-9a7c-2fc1bc389a00 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:02.996293 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:03.005844 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dcec3-1741-4aab-9a7c-2fc1bc389a00 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:03.038141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ea6b3-f66d-48b4-8128-b6e7a1dcb8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:03.038916 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ea6b3-f66d-48b4-8128-b6e7a1dcb8a8 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:03.039205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ea6b3-f66d-48b4-8128-b6e7a1dcb8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:03.039480 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ea6b3-f66d-48b4-8128-b6e7a1dcb8a8 None admin] PATH_INFO: `/v3/services` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:03.041045 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ea6b3-f66d-48b4-8128-b6e7a1dcb8a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:03.042461 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ea6b3-f66d-48b4-8128-b6e7a1dcb8a8 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:03.056284 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 506/996] 10.222.0.39 () {56 vars in 1087 bytes} [Mon May 23 15:37:02 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:37:03.251123 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5083813-9c6e-4040-ad51-a19d49648db8 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:03.251640 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5083813-9c6e-4040-ad51-a19d49648db8 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:03.251640 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5083813-9c6e-4040-ad51-a19d49648db8 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:03.253144 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 491/997] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:03.258399 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd1b9b-7eef-49b3-b54a-5032d8d7b92d None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:03.259399 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd1b9b-7eef-49b3-b54a-5032d8d7b92d None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:03.259652 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd1b9b-7eef-49b3-b54a-5032d8d7b92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:03.276749 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-b6bd1b9b-7eef-49b3-b54a-5032d8d7b92d None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:03.277952 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-b6bd1b9b-7eef-49b3-b54a-5032d8d7b92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:03.347640 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 507/998] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:37:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:37:03.369146 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5083813-9c6e-4040-ad51-a19d49648db8 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:03.473535 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5083813-9c6e-4040-ad51-a19d49648db8 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:03.508443 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4cbfe-790b-4d36-86b2-1d869308e04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:03.509198 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4cbfe-790b-4d36-86b2-1d869308e04a None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:03.509477 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4cbfe-790b-4d36-86b2-1d869308e04a None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:03.509781 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4cbfe-790b-4d36-86b2-1d869308e04a None admin] PATH_INFO: `/v3/services/image` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:03.510398 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4cbfe-790b-4d36-86b2-1d869308e04a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:03.511793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4cbfe-790b-4d36-86b2-1d869308e04a None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:03.523363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-fac4cbfe-790b-4d36-86b2-1d869308e04a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 23 15:37:03.523363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:03.523363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:37:03.523363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:37:03.523363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:37:03.523363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:37:03.523363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:37:03.523363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:37:03.523363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 15:37:03.523363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:37:03.523363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:37:03.523363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:37:03.523363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:03.523363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:37:03.523363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:37:03.523363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:37:03.523363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:37:03.524983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:37:03.524983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:37:03.524983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:37:03.524983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:37:03.524983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:37:03.524983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:37:03.524983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:37:03.524983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:37:03.524983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:37:03.524983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:37:03.524983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:37:03.524983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:37:03.524983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:37:03.524983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:37:03.524983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:37:03.524983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:37:03.530775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:37:03.530775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:37:03.530775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:37:03.530775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:37:03.530775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:37:03.530775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:37:03.530775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:37:03.530775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:37:03.530775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:37:03.530775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:37:03.530775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:37:03.530775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:37:03.530775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 15:37:03.530775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:37:03.530775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 492/999] 10.222.0.39 () {56 vars in 1105 bytes} [Mon May 23 15:37:03 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:37:03.533239 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd1b9b-7eef-49b3-b54a-5032d8d7b92d None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:03.620723 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:03.637427 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd1b9b-7eef-49b3-b54a-5032d8d7b92d None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:03.673063 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe045f-6d86-4e02-9b3a-d7864f0c7915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:03.673761 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe045f-6d86-4e02-9b3a-d7864f0c7915 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:03.674049 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe045f-6d86-4e02-9b3a-d7864f0c7915 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:03.674331 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe045f-6d86-4e02-9b3a-d7864f0c7915 None admin] PATH_INFO: `/v3/services` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:03.675065 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe045f-6d86-4e02-9b3a-d7864f0c7915 None admin] RBAC: Adding query filter params (name=image) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:03.675381 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe045f-6d86-4e02-9b3a-d7864f0c7915 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:03.676883 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe045f-6d86-4e02-9b3a-d7864f0c7915 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:03.687576 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 508/1000] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:37:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:03.688883 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4cbfe-790b-4d36-86b2-1d869308e04a None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:03.710232 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:03.792390 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4cbfe-790b-4d36-86b2-1d869308e04a None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:03.825470 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a47c1-5d60-4e82-acd2-f016ca9c9aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:03.826134 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a47c1-5d60-4e82-acd2-f016ca9c9aeb None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:03.826419 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a47c1-5d60-4e82-acd2-f016ca9c9aeb None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:03.826699 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a47c1-5d60-4e82-acd2-f016ca9c9aeb None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:03.827407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a47c1-5d60-4e82-acd2-f016ca9c9aeb None admin] RBAC: Adding query filter params (type=image) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:03.827748 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a47c1-5d60-4e82-acd2-f016ca9c9aeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:03.829130 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a47c1-5d60-4e82-acd2-f016ca9c9aeb None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:03.839687 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 493/1001] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:37:03 2022] GET /identity/v3/services?type=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:03.869391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2c85c-1d72-487d-842d-795881ea99dc None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:03.869674 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2c85c-1d72-487d-842d-795881ea99dc None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:03.869989 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2c85c-1d72-487d-842d-795881ea99dc None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:03.871443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 509/1002] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:03.877425 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d35f47-9194-4724-937d-77287de20ed4 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:03.877733 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d35f47-9194-4724-937d-77287de20ed4 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:03.877993 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d35f47-9194-4724-937d-77287de20ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:03.895945 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-03d35f47-9194-4724-937d-77287de20ed4 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:03.897171 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-03d35f47-9194-4724-937d-77287de20ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:03.969446 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 494/1003] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:37:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:37:03.993618 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2c85c-1d72-487d-842d-795881ea99dc None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:04.101581 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2c85c-1d72-487d-842d-795881ea99dc None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:04.139063 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c457d4-6c06-40d7-97ef-f3cb8462a7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:04.139891 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c457d4-6c06-40d7-97ef-f3cb8462a7b9 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:04.140180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c457d4-6c06-40d7-97ef-f3cb8462a7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:04.140521 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c457d4-6c06-40d7-97ef-f3cb8462a7b9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:04.141114 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c457d4-6c06-40d7-97ef-f3cb8462a7b9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:04.142541 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c457d4-6c06-40d7-97ef-f3cb8462a7b9 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:04.155443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-51c457d4-6c06-40d7-97ef-f3cb8462a7b9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:37:04.155443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:04.155443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:37:04.155443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:37:04.155443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:37:04.155443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:37:04.155443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:37:04.155443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:37:04.155443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:37:04.155443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:04.155443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:37:04.155443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:04.155443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:04.155443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:37:04.155443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:37:04.155443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:37:04.155443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:37:04.156688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:37:04.156688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:37:04.156688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:37:04.156688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:37:04.156688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:37:04.156688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:37:04.156688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:37:04.156688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:37:04.156688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:37:04.156688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:37:04.156688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:37:04.156688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:37:04.156688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:37:04.156688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:37:04.156688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:37:04.156688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:37:04.157580 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:37:04.157580 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:37:04.157580 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:37:04.157580 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:37:04.157580 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:37:04.157580 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:37:04.157580 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:37:04.157580 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:37:04.157580 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:37:04.157580 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:37:04.157580 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:37:04.157580 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:37:04.157580 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:37:04.157580 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:04.157580 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 510/1004] 10.222.0.39 () {56 vars in 1126 bytes} [Mon May 23 15:37:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:37:04.164726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d35f47-9194-4724-937d-77287de20ed4 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:04.179702 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:04.275701 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d35f47-9194-4724-937d-77287de20ed4 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:04.310650 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b16ca-9424-42ff-9bd5-3143fe73c6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:04.311313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b16ca-9424-42ff-9bd5-3143fe73c6b2 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:04.311593 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b16ca-9424-42ff-9bd5-3143fe73c6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:04.311890 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b16ca-9424-42ff-9bd5-3143fe73c6b2 None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:04.312591 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b16ca-9424-42ff-9bd5-3143fe73c6b2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:04.312894 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b16ca-9424-42ff-9bd5-3143fe73c6b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:04.314278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b16ca-9424-42ff-9bd5-3143fe73c6b2 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:04.323780 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 495/1005] 10.222.0.39 () {56 vars in 1122 bytes} [Mon May 23 15:37:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:04.324962 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c457d4-6c06-40d7-97ef-f3cb8462a7b9 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:04.341340 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:04.428030 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c457d4-6c06-40d7-97ef-f3cb8462a7b9 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:04.462943 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0347dd2a-2e37-4d25-b033-3b767f76d375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:04.463625 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347dd2a-2e37-4d25-b033-3b767f76d375 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:04.463916 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347dd2a-2e37-4d25-b033-3b767f76d375 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:04.464194 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347dd2a-2e37-4d25-b033-3b767f76d375 None admin] PATH_INFO: `/v3/services` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:04.464897 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0347dd2a-2e37-4d25-b033-3b767f76d375 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:04.465209 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0347dd2a-2e37-4d25-b033-3b767f76d375 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:04.466573 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0347dd2a-2e37-4d25-b033-3b767f76d375 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:04.476008 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 511/1006] 10.222.0.39 () {56 vars in 1122 bytes} [Mon May 23 15:37:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:37:04.477098 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b16ca-9424-42ff-9bd5-3143fe73c6b2 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:04.556512 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:04.580160 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b16ca-9424-42ff-9bd5-3143fe73c6b2 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:04.615121 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b4128-2b84-4690-a56d-8137add12e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:04.615819 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b4128-2b84-4690-a56d-8137add12e85 None admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:04.616106 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b4128-2b84-4690-a56d-8137add12e85 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:04.616381 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b4128-2b84-4690-a56d-8137add12e85 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:04.617118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b4128-2b84-4690-a56d-8137add12e85 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:04.619085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b4128-2b84-4690-a56d-8137add12e85 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:04.674815 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 496/1007] 10.222.0.39 () {60 vars in 1144 bytes} [Mon May 23 15:37:04 2022] POST /identity/v3/endpoints => generated 325 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:37:05.282365 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7ecb7-3923-4232-aa71-1eefc52220f0 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:05.282679 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7ecb7-3923-4232-aa71-1eefc52220f0 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:05.282929 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7ecb7-3923-4232-aa71-1eefc52220f0 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:05.284482 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 512/1008] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:05.289574 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8b8de-6b8f-4d3b-a120-97e3efc2c352 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:05.290152 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8b8de-6b8f-4d3b-a120-97e3efc2c352 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:05.290152 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8b8de-6b8f-4d3b-a120-97e3efc2c352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:05.306882 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-0ac8b8de-6b8f-4d3b-a120-97e3efc2c352 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:05.308070 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-0ac8b8de-6b8f-4d3b-a120-97e3efc2c352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:05.382672 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 497/1009] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:37:05 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:37:05.406392 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7ecb7-3923-4232-aa71-1eefc52220f0 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:05.484689 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:05.508509 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7ecb7-3923-4232-aa71-1eefc52220f0 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:05.543568 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d326073-c72c-4f1e-970d-1695643121b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:05.544384 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d326073-c72c-4f1e-970d-1695643121b7 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:05.544663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d326073-c72c-4f1e-970d-1695643121b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:05.544937 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d326073-c72c-4f1e-970d-1695643121b7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:05.545582 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d326073-c72c-4f1e-970d-1695643121b7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:05.546943 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d326073-c72c-4f1e-970d-1695643121b7 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:05.558457 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-1d326073-c72c-4f1e-970d-1695643121b7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 23 15:37:05.558457 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:05.558457 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:37:05.558457 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:37:05.558457 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:37:05.558457 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:37:05.558457 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:37:05.558457 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:37:05.558457 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 15:37:05.558457 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:05.558457 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:37:05.558457 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:05.558457 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:05.558457 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:37:05.558457 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:37:05.558457 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:37:05.558457 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:37:05.559438 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:37:05.559438 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:37:05.559438 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:37:05.559438 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:37:05.559438 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:37:05.559438 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:37:05.559438 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:37:05.559438 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:37:05.559438 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:37:05.559438 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:37:05.559438 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:37:05.559438 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:37:05.559438 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:37:05.559438 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:37:05.559438 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:37:05.559438 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:37:05.560324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:37:05.560324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:37:05.560324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:37:05.560324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:37:05.560324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:37:05.560324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:37:05.560324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:37:05.560324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:37:05.560324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:37:05.560324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:37:05.560324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:37:05.560324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:37:05.560324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 15:37:05.560324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:05.563973 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 513/1010] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:37:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:37:05.565516 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8b8de-6b8f-4d3b-a120-97e3efc2c352 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:05.626893 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:05.668313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8b8de-6b8f-4d3b-a120-97e3efc2c352 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:05.701949 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244b0bf-f29f-45a0-b88f-4a37934173c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:05.702645 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244b0bf-f29f-45a0-b88f-4a37934173c9 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:05.702926 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244b0bf-f29f-45a0-b88f-4a37934173c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:05.703196 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244b0bf-f29f-45a0-b88f-4a37934173c9 None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:05.703928 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244b0bf-f29f-45a0-b88f-4a37934173c9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:05.704233 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244b0bf-f29f-45a0-b88f-4a37934173c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:05.705600 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244b0bf-f29f-45a0-b88f-4a37934173c9 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:05.715788 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 498/1011] 10.222.0.39 () {56 vars in 1112 bytes} [Mon May 23 15:37:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:05.717318 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d326073-c72c-4f1e-970d-1695643121b7 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:05.819142 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d326073-c72c-4f1e-970d-1695643121b7 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:05.852934 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118d752-ae47-4aae-a4d0-6571699aa97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:05.853593 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118d752-ae47-4aae-a4d0-6571699aa97f None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:05.853875 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118d752-ae47-4aae-a4d0-6571699aa97f None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:05.854149 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118d752-ae47-4aae-a4d0-6571699aa97f None admin] PATH_INFO: `/v3/services` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:05.854850 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2118d752-ae47-4aae-a4d0-6571699aa97f None admin] RBAC: Adding query filter params (type=compute) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:05.855157 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2118d752-ae47-4aae-a4d0-6571699aa97f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:05.856826 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2118d752-ae47-4aae-a4d0-6571699aa97f None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:05.866688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 514/1012] 10.222.0.39 () {56 vars in 1112 bytes} [Mon May 23 15:37:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:05.869143 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244b0bf-f29f-45a0-b88f-4a37934173c9 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:05.975159 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244b0bf-f29f-45a0-b88f-4a37934173c9 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:06.001330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:06.011030 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae2384-3a70-4519-ba0c-ed5abaaf4ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:06.025194 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae2384-3a70-4519-ba0c-ed5abaaf4ea1 None admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:06.025194 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae2384-3a70-4519-ba0c-ed5abaaf4ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:06.025194 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae2384-3a70-4519-ba0c-ed5abaaf4ea1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:06.025194 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae2384-3a70-4519-ba0c-ed5abaaf4ea1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:06.025194 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae2384-3a70-4519-ba0c-ed5abaaf4ea1 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:06.066601 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fc012-5283-42ef-a379-1e5f20789d8b None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:06.066889 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fc012-5283-42ef-a379-1e5f20789d8b None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:06.067172 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fc012-5283-42ef-a379-1e5f20789d8b None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:06.068603 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 515/1013] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:37:06.073718 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3f390-1f0d-4502-b082-9ea37a1eaea2 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:06.073947 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3f390-1f0d-4502-b082-9ea37a1eaea2 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:06.074239 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3f390-1f0d-4502-b082-9ea37a1eaea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:06.080147 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:06.091523 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-d8f3f390-1f0d-4502-b082-9ea37a1eaea2 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:06.092793 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-d8f3f390-1f0d-4502-b082-9ea37a1eaea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:06.098182 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 499/1014] 10.222.0.39 () {60 vars in 1144 bytes} [Mon May 23 15:37:05 2022] POST /identity/v3/endpoints => generated 334 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:37:06.177100 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 516/1015] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:37:06 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:37:06.200688 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae2384-3a70-4519-ba0c-ed5abaaf4ea1 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:06.317038 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae2384-3a70-4519-ba0c-ed5abaaf4ea1 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:06.353796 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f5d40-f274-41bc-84f7-2d052f889e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:06.354388 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f5d40-f274-41bc-84f7-2d052f889e2c None admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:06.354676 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f5d40-f274-41bc-84f7-2d052f889e2c None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:06.354950 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f5d40-f274-41bc-84f7-2d052f889e2c None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:06.355714 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f5d40-f274-41bc-84f7-2d052f889e2c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:06.357348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f5d40-f274-41bc-84f7-2d052f889e2c None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:06.457618 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 500/1016] 10.222.0.39 () {60 vars in 1141 bytes} [Mon May 23 15:37:06 2022] POST /identity/v3/services => generated 242 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:37:06.930715 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481cdef-25f3-4489-adf9-9a1c43e5b54a None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:06.931269 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481cdef-25f3-4489-adf9-9a1c43e5b54a None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:06.931492 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481cdef-25f3-4489-adf9-9a1c43e5b54a None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:06.932947 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 517/1017] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:06.938177 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a6dc2-9b71-4411-883f-01ef0d06a784 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:06.938479 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a6dc2-9b71-4411-883f-01ef0d06a784 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:06.938767 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a6dc2-9b71-4411-883f-01ef0d06a784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:06.956473 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-827a6dc2-9b71-4411-883f-01ef0d06a784 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:06.957659 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-827a6dc2-9b71-4411-883f-01ef0d06a784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:06.995330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:07.034233 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 501/1018] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:37:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:37:07.059127 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481cdef-25f3-4489-adf9-9a1c43e5b54a None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:07.160797 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481cdef-25f3-4489-adf9-9a1c43e5b54a None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:07.190196 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:07.201487 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a4224-dcc3-4119-8d07-8540ba4b2429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:07.202289 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a4224-dcc3-4119-8d07-8540ba4b2429 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:07.202567 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a4224-dcc3-4119-8d07-8540ba4b2429 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:07.202844 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a4224-dcc3-4119-8d07-8540ba4b2429 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:07.204164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a4224-dcc3-4119-8d07-8540ba4b2429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:07.205593 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a4224-dcc3-4119-8d07-8540ba4b2429 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:07.212448 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 518/1019] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:37:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:07.214824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a6dc2-9b71-4411-883f-01ef0d06a784 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:07.319421 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a6dc2-9b71-4411-883f-01ef0d06a784 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:07.354043 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562e156-6037-4b35-9acc-19673c880bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:07.354699 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562e156-6037-4b35-9acc-19673c880bb6 None admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:07.354979 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562e156-6037-4b35-9acc-19673c880bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:07.355251 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562e156-6037-4b35-9acc-19673c880bb6 None admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:07.355981 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562e156-6037-4b35-9acc-19673c880bb6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:07.357673 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562e156-6037-4b35-9acc-19673c880bb6 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:07.470667 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 502/1020] 10.222.0.39 () {60 vars in 1141 bytes} [Mon May 23 15:37:07 2022] POST /identity/v3/projects => generated 311 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:37:08.406518 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8727a8c-3e51-423b-ac9d-4757479bb85e None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:08.407038 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8727a8c-3e51-423b-ac9d-4757479bb85e None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:08.407038 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8727a8c-3e51-423b-ac9d-4757479bb85e None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:08.408709 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 519/1021] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:08.413776 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fc452-3b7f-4abe-974f-e5c8969c5262 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:08.414184 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fc452-3b7f-4abe-974f-e5c8969c5262 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:08.414338 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fc452-3b7f-4abe-974f-e5c8969c5262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:08.432049 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-fb5fc452-3b7f-4abe-974f-e5c8969c5262 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:08.433239 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-fb5fc452-3b7f-4abe-974f-e5c8969c5262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:08.448613 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:08.505405 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 503/1022] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:37:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:37:08.531333 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8727a8c-3e51-423b-ac9d-4757479bb85e None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:08.647685 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8727a8c-3e51-423b-ac9d-4757479bb85e None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:08.684712 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcfc7c-3495-41ac-b583-099602fd889d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:08.685800 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcfc7c-3495-41ac-b583-099602fd889d None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:08.686228 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcfc7c-3495-41ac-b583-099602fd889d None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:08.686671 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcfc7c-3495-41ac-b583-099602fd889d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:08.699723 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddcfc7c-3495-41ac-b583-099602fd889d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:37:08.708290 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-dddcfc7c-3495-41ac-b583-099602fd889d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:37:08.708290 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:08.708290 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:37:08.708290 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:37:08.708290 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:37:08.708290 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:37:08.708290 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:37:08.708290 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:37:08.708290 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:37:08.708290 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:37:08.708290 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:37:08.708290 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:37:08.708290 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:37:08.708290 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:37:08.708290 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:37:08.708290 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:37:08.709307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:37:08.709307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:37:08.709307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:37:08.709307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:37:08.709307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:37:08.709307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:37:08.709307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:37:08.709307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:37:08.709307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:37:08.709307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:37:08.709307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:37:08.709307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:37:08.709307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:37:08.709307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:37:08.709307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:37:08.709307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:37:08.710139 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:37:08.710139 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:37:08.710139 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:37:08.710139 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:37:08.710139 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:37:08.710139 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:37:08.710139 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:37:08.710139 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:37:08.710139 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:37:08.710139 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:37:08.710139 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:37:08.710139 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:08.713553 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15ea33-6c5e-4226-b874-23483156c0c5 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:08.713845 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15ea33-6c5e-4226-b874-23483156c0c5 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:08.714124 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15ea33-6c5e-4226-b874-23483156c0c5 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:08.715535 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 520/1023] 10.222.0.39 () {56 vars in 1120 bytes} [Mon May 23 15:37:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:37:08.715857 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 504/1024] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:37:08.716434 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcfc7c-3495-41ac-b583-099602fd889d None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:08.720719 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef7cf8-ef75-4c8e-b386-e9174a836e3e None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:08.721011 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef7cf8-ef75-4c8e-b386-e9174a836e3e None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:08.721290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef7cf8-ef75-4c8e-b386-e9174a836e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:08.738111 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-55ef7cf8-ef75-4c8e-b386-e9174a836e3e None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:08.739302 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-55ef7cf8-ef75-4c8e-b386-e9174a836e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:08.778837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:08.814951 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 505/1025] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:37:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:37:08.823624 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcfc7c-3495-41ac-b583-099602fd889d None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:08.838670 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef7cf8-ef75-4c8e-b386-e9174a836e3e None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:08.861183 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ceb000-ab41-4fce-b5bd-092b506cdf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:08.861846 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceb000-ab41-4fce-b5bd-092b506cdf02 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:08.862250 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceb000-ab41-4fce-b5bd-092b506cdf02 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:08.862525 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceb000-ab41-4fce-b5bd-092b506cdf02 None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:08.863387 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ceb000-ab41-4fce-b5bd-092b506cdf02 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:08.863720 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ceb000-ab41-4fce-b5bd-092b506cdf02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:08.865195 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ceb000-ab41-4fce-b5bd-092b506cdf02 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:08.878004 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 521/1026] 10.222.0.39 () {56 vars in 1115 bytes} [Mon May 23 15:37:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:08.878985 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ceb000-ab41-4fce-b5bd-092b506cdf02 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:08.920305 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:08.939439 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef7cf8-ef75-4c8e-b386-e9174a836e3e None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:08.974566 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdb887-e33d-4ad1-9dc7-1166f7e211df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:08.975351 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdb887-e33d-4ad1-9dc7-1166f7e211df None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:08.975655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdb887-e33d-4ad1-9dc7-1166f7e211df None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:08.975936 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdb887-e33d-4ad1-9dc7-1166f7e211df None admin] PATH_INFO: `/v3/services/image` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:08.976578 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbdb887-e33d-4ad1-9dc7-1166f7e211df None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:08.978594 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbdb887-e33d-4ad1-9dc7-1166f7e211df None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:08.985514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ceb000-ab41-4fce-b5bd-092b506cdf02 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:08.990389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-abbdb887-e33d-4ad1-9dc7-1166f7e211df None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 23 15:37:08.990389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:08.990389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:37:08.990389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:37:08.990389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:37:08.990389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:37:08.990389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:37:08.990389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:37:08.990389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 15:37:08.990389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:37:08.990389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:37:08.990389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:37:08.990389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:08.990389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:37:08.990389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:37:08.990389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:37:08.990389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:37:08.991467 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:37:08.991467 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:37:08.991467 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:37:08.991467 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:37:08.991467 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:37:08.991467 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:37:08.991467 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:37:08.991467 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:37:08.991467 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:37:08.991467 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:37:08.991467 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:37:08.991467 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:37:08.991467 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:37:08.991467 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:37:08.991467 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:37:08.991467 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:37:08.996524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:37:08.996524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:37:08.996524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:37:08.996524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:37:08.996524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:37:08.996524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:37:08.996524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:37:08.996524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:37:08.996524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:37:08.996524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:37:08.996524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:37:08.996524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:37:08.996524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 15:37:08.996524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:37:08.996524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 506/1027] 10.222.0.39 () {56 vars in 1105 bytes} [Mon May 23 15:37:08 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:37:08.998307 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdb887-e33d-4ad1-9dc7-1166f7e211df None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:09.011425 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:09.026052 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed53cc-09b7-4f42-aca7-75b3a4431f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:09.026844 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed53cc-09b7-4f42-aca7-75b3a4431f4d None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:09.027131 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed53cc-09b7-4f42-aca7-75b3a4431f4d None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:09.027402 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed53cc-09b7-4f42-aca7-75b3a4431f4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:09.037932 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed53cc-09b7-4f42-aca7-75b3a4431f4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:09.039307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed53cc-09b7-4f42-aca7-75b3a4431f4d None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:09.058688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-55ed53cc-09b7-4f42-aca7-75b3a4431f4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:37:09.058688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:09.058688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:37:09.058688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:37:09.058688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:37:09.058688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:37:09.058688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:37:09.058688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:37:09.058688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:37:09.058688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:37:09.058688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:37:09.058688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:37:09.058688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:37:09.058688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:37:09.058688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:37:09.059669 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:37:09.059669 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:37:09.059669 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:37:09.059669 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:37:09.059669 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:37:09.059669 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:37:09.059669 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:37:09.059669 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:37:09.059669 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:37:09.059669 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:37:09.059669 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:37:09.059669 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:37:09.059669 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:37:09.059669 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:37:09.059669 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:37:09.059669 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:37:09.059669 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:37:09.060566 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:37:09.060566 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:37:09.060566 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:37:09.060566 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:09.062223 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 522/1028] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:37:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:37:09.068440 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed53cc-09b7-4f42-aca7-75b3a4431f4d None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:09.107881 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdb887-e33d-4ad1-9dc7-1166f7e211df None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:09.145463 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0bc63-c583-482e-8a6f-5504a2f4a2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:09.146124 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0bc63-c583-482e-8a6f-5504a2f4a2e5 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:09.146404 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0bc63-c583-482e-8a6f-5504a2f4a2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:09.146675 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0bc63-c583-482e-8a6f-5504a2f4a2e5 None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:09.147380 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0bc63-c583-482e-8a6f-5504a2f4a2e5 None admin] RBAC: Adding query filter params (name=image) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:09.147715 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0bc63-c583-482e-8a6f-5504a2f4a2e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:09.149226 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0bc63-c583-482e-8a6f-5504a2f4a2e5 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:09.156512 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 507/1029] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:37:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:09.161903 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0bc63-c583-482e-8a6f-5504a2f4a2e5 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:09.174626 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:09.181142 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed53cc-09b7-4f42-aca7-75b3a4431f4d None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:09.221977 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b391976-6707-4ec3-8cc0-88048e408b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:09.222647 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b391976-6707-4ec3-8cc0-88048e408b84 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:09.222937 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b391976-6707-4ec3-8cc0-88048e408b84 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:09.223209 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b391976-6707-4ec3-8cc0-88048e408b84 None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:09.223984 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b391976-6707-4ec3-8cc0-88048e408b84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:09.224298 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b391976-6707-4ec3-8cc0-88048e408b84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:09.225731 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b391976-6707-4ec3-8cc0-88048e408b84 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:09.238852 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 523/1030] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:37:09.245655 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b391976-6707-4ec3-8cc0-88048e408b84 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:09.275443 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0bc63-c583-482e-8a6f-5504a2f4a2e5 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:09.284258 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:09.312767 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0e210-0b3c-489f-b2fb-3c50fdaeab24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:09.313436 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0e210-0b3c-489f-b2fb-3c50fdaeab24 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:09.313722 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0e210-0b3c-489f-b2fb-3c50fdaeab24 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:09.314003 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0e210-0b3c-489f-b2fb-3c50fdaeab24 None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:09.314817 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0e210-0b3c-489f-b2fb-3c50fdaeab24 None admin] RBAC: Adding query filter params (type=image) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:09.315126 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0e210-0b3c-489f-b2fb-3c50fdaeab24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:09.316536 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0e210-0b3c-489f-b2fb-3c50fdaeab24 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:09.321482 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 508/1031] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:37:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:37:09.327085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0e210-0b3c-489f-b2fb-3c50fdaeab24 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:09.362404 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b391976-6707-4ec3-8cc0-88048e408b84 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:09.402315 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01c1af-a0a7-47a5-9582-dc6fcfef6183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:09.403056 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01c1af-a0a7-47a5-9582-dc6fcfef6183 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:09.403347 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01c1af-a0a7-47a5-9582-dc6fcfef6183 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:09.404251 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01c1af-a0a7-47a5-9582-dc6fcfef6183 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:09.404720 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:09.411269 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c01c1af-a0a7-47a5-9582-dc6fcfef6183 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:09.412767 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c01c1af-a0a7-47a5-9582-dc6fcfef6183 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:09.431220 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-1c01c1af-a0a7-47a5-9582-dc6fcfef6183 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 15:37:09.431220 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:09.431220 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:37:09.431220 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:37:09.431220 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:37:09.431220 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:37:09.431220 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:37:09.431220 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:37:09.431220 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:37:09.431220 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:37:09.431220 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:37:09.431220 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:37:09.431220 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:37:09.431220 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:37:09.431220 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:37:09.431220 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:37:09.432249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:37:09.432249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:37:09.432249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:37:09.432249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:37:09.432249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:37:09.432249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:37:09.432249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:37:09.432249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:37:09.432249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:37:09.432249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:37:09.432249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:37:09.432249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:37:09.432249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:37:09.432249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:37:09.432249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:37:09.432249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:37:09.432249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:37:09.432249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:37:09.438223 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:37:09.438223 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:37:09.438223 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:37:09.438223 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:37:09.438223 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:37:09.438223 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:37:09.438223 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:37:09.438223 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:37:09.438223 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 15:37:09.438223 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:09.438223 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 524/1032] 10.222.0.39 () {56 vars in 1093 bytes} [Mon May 23 15:37:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:37:09.438866 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0e210-0b3c-489f-b2fb-3c50fdaeab24 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:09.439473 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01c1af-a0a7-47a5-9582-dc6fcfef6183 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:09.472886 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6f4a4-7154-4dc8-82cb-96139679ea04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:09.473845 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6f4a4-7154-4dc8-82cb-96139679ea04 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:09.474294 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6f4a4-7154-4dc8-82cb-96139679ea04 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:09.474573 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6f4a4-7154-4dc8-82cb-96139679ea04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:09.475370 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6f4a4-7154-4dc8-82cb-96139679ea04 None admin] RBAC: Adding query filter params (interface=public, service_id=9733a3f7be7d4dbfb04219f694c289eb, region_id=RegionOne) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:09.476750 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6f4a4-7154-4dc8-82cb-96139679ea04 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:09.479203 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6f4a4-7154-4dc8-82cb-96139679ea04 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:09.489097 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 509/1033] 10.222.0.39 () {56 vars in 1251 bytes} [Mon May 23 15:37:09 2022] GET /identity/v3/endpoints?service_id=9733a3f7be7d4dbfb04219f694c289eb&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:37:09.490128 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6f4a4-7154-4dc8-82cb-96139679ea04 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:09.548930 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:09.560722 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01c1af-a0a7-47a5-9582-dc6fcfef6183 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:09.600259 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6f4a4-7154-4dc8-82cb-96139679ea04 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:09.600452 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa7668-9cc3-4c6e-9579-07577466fe0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:09.600913 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa7668-9cc3-4c6e-9579-07577466fe0b None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:09.601202 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa7668-9cc3-4c6e-9579-07577466fe0b None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:09.601482 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa7668-9cc3-4c6e-9579-07577466fe0b None admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:09.603136 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa7668-9cc3-4c6e-9579-07577466fe0b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:09.603457 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa7668-9cc3-4c6e-9579-07577466fe0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:09.605014 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa7668-9cc3-4c6e-9579-07577466fe0b None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:09.624613 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 525/1034] 10.222.0.39 () {56 vars in 1133 bytes} [Mon May 23 15:37:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:09.630115 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa7668-9cc3-4c6e-9579-07577466fe0b None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:09.637117 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3aebe-773d-4dab-b16a-9f561a5d2499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:09.637785 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3aebe-773d-4dab-b16a-9f561a5d2499 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:09.638065 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3aebe-773d-4dab-b16a-9f561a5d2499 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:09.638334 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3aebe-773d-4dab-b16a-9f561a5d2499 None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:09.639009 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3aebe-773d-4dab-b16a-9f561a5d2499 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:09.640407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3aebe-773d-4dab-b16a-9f561a5d2499 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:09.642294 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:09.648347 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 510/1035] 10.222.0.39 () {56 vars in 1087 bytes} [Mon May 23 15:37:09 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:37:09.745847 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8f23d-0896-4fd0-bae5-b7605e73ddce None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:09.746183 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8f23d-0896-4fd0-bae5-b7605e73ddce None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:09.746420 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8f23d-0896-4fd0-bae5-b7605e73ddce None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:09.747879 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 511/1036] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:37:09.748999 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa7668-9cc3-4c6e-9579-07577466fe0b None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:09.753605 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444941b-a0b8-4211-8d43-4130388049c0 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:09.753885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444941b-a0b8-4211-8d43-4130388049c0 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:09.754168 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444941b-a0b8-4211-8d43-4130388049c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:09.773246 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-4444941b-a0b8-4211-8d43-4130388049c0 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:09.775243 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-4444941b-a0b8-4211-8d43-4130388049c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:09.786990 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8736e6d-920d-48db-9f3f-8d472b96f846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:09.787966 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8736e6d-920d-48db-9f3f-8d472b96f846 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:09.788401 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8736e6d-920d-48db-9f3f-8d472b96f846 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:09.788855 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8736e6d-920d-48db-9f3f-8d472b96f846 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:09.813726 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:09.859111 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 512/1037] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:37:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:37:09.867042 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8736e6d-920d-48db-9f3f-8d472b96f846 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:09.869087 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8736e6d-920d-48db-9f3f-8d472b96f846 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:09.885024 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444941b-a0b8-4211-8d43-4130388049c0 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:09.982508 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 526/1038] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:37:09 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 15:37:09.983837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8736e6d-920d-48db-9f3f-8d472b96f846 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:09.988612 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444941b-a0b8-4211-8d43-4130388049c0 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:10.018443 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:10.025228 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abdbd87-023b-4f6c-a414-59d421bfded5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:10.026029 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdbd87-023b-4f6c-a414-59d421bfded5 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:10.026321 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdbd87-023b-4f6c-a414-59d421bfded5 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:10.026599 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdbd87-023b-4f6c-a414-59d421bfded5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:10.027813 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abdbd87-023b-4f6c-a414-59d421bfded5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:10.029257 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abdbd87-023b-4f6c-a414-59d421bfded5 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:10.035503 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 513/1039] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:37:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:37:10.036817 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abdbd87-023b-4f6c-a414-59d421bfded5 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:10.037448 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:10.090497 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8736e6d-920d-48db-9f3f-8d472b96f846 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:10.127423 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e3d52-d96e-4a50-954c-70c940b3d0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:10.128419 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e3d52-d96e-4a50-954c-70c940b3d0b1 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:10.128710 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e3d52-d96e-4a50-954c-70c940b3d0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:10.128991 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e3d52-d96e-4a50-954c-70c940b3d0b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:10.140962 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e3d52-d96e-4a50-954c-70c940b3d0b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:10.142412 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e3d52-d96e-4a50-954c-70c940b3d0b1 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:10.150184 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abdbd87-023b-4f6c-a414-59d421bfded5 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:10.160338 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-1e7e3d52-d96e-4a50-954c-70c940b3d0b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:37:10.160338 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:10.160338 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:37:10.160338 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:37:10.160338 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:37:10.160338 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:37:10.160338 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:37:10.160338 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:37:10.160338 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:37:10.160338 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:37:10.160338 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:37:10.160338 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:37:10.160338 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:37:10.160338 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:37:10.160338 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:37:10.161566 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:37:10.161566 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:37:10.161566 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:37:10.161566 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:37:10.161566 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:37:10.161566 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:37:10.161566 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:37:10.161566 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:37:10.161566 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:37:10.161566 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:37:10.161566 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:37:10.161566 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:37:10.161566 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:37:10.161566 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:37:10.161566 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:37:10.161566 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:37:10.161566 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:37:10.162626 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:37:10.162626 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:37:10.162626 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:37:10.162626 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:10.162626 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 527/1040] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:37:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:37:10.167700 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e3d52-d96e-4a50-954c-70c940b3d0b1 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:10.192843 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96e85e-6307-49fb-b0da-366a7572072e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:10.193528 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96e85e-6307-49fb-b0da-366a7572072e None admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:10.193813 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96e85e-6307-49fb-b0da-366a7572072e None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:10.194089 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96e85e-6307-49fb-b0da-366a7572072e None admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:10.194799 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96e85e-6307-49fb-b0da-366a7572072e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:10.197803 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96e85e-6307-49fb-b0da-366a7572072e None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:10.278744 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e3d52-d96e-4a50-954c-70c940b3d0b1 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:10.280289 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:10.307631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 514/1041] 10.222.0.39 () {60 vars in 1132 bytes} [Mon May 23 15:37:10 2022] POST /identity/v3/users => generated 285 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:37:10.313715 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cf410-02e8-4150-92b0-e55fab55c0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:10.314394 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cf410-02e8-4150-92b0-e55fab55c0ad None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:10.314682 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cf410-02e8-4150-92b0-e55fab55c0ad None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:10.314963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cf410-02e8-4150-92b0-e55fab55c0ad None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:10.315755 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9cf410-02e8-4150-92b0-e55fab55c0ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:10.316073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9cf410-02e8-4150-92b0-e55fab55c0ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:10.317509 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9cf410-02e8-4150-92b0-e55fab55c0ad None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:10.336826 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 528/1042] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:37:10.338616 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96e85e-6307-49fb-b0da-366a7572072e None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:10.403674 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:10.454095 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96e85e-6307-49fb-b0da-366a7572072e None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:10.501976 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6b532-826e-40e0-9e52-bbbb6884c6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:10.502769 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6b532-826e-40e0-9e52-bbbb6884c6e7 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:10.503048 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6b532-826e-40e0-9e52-bbbb6884c6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:10.503319 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6b532-826e-40e0-9e52-bbbb6884c6e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:10.510528 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6b532-826e-40e0-9e52-bbbb6884c6e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:10.511997 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6b532-826e-40e0-9e52-bbbb6884c6e7 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:10.526303 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-06b6b532-826e-40e0-9e52-bbbb6884c6e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:37:10.526303 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:10.526303 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:37:10.526303 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:37:10.526303 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:37:10.526303 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:37:10.526303 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:37:10.526303 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:37:10.526303 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:37:10.526303 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:37:10.526303 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:37:10.526303 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:37:10.526303 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:37:10.526303 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:37:10.526303 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:37:10.527208 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:37:10.527208 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:37:10.527208 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:37:10.527208 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:37:10.527208 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:37:10.527208 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:37:10.527208 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:37:10.527208 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:37:10.527208 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:37:10.527208 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:37:10.527208 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:37:10.527208 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:37:10.527208 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:37:10.527208 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:37:10.527208 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:37:10.527208 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:37:10.527208 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:37:10.528556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:37:10.528556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:37:10.528556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:37:10.528556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:37:10.528556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:37:10.528556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:37:10.528556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:37:10.528556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:37:10.528556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 515/1043] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:37:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:37:10.533700 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cf410-02e8-4150-92b0-e55fab55c0ad None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:10.640275 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cf410-02e8-4150-92b0-e55fab55c0ad None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:10.675004 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff37226-bf63-47fc-a9cb-c52f9139b18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:10.675592 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff37226-bf63-47fc-a9cb-c52f9139b18c None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:10.675901 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff37226-bf63-47fc-a9cb-c52f9139b18c None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:10.676181 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff37226-bf63-47fc-a9cb-c52f9139b18c None admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:10.677006 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff37226-bf63-47fc-a9cb-c52f9139b18c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:10.677324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff37226-bf63-47fc-a9cb-c52f9139b18c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:10.678741 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff37226-bf63-47fc-a9cb-c52f9139b18c None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:10.697586 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 529/1044] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:37:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:10.699009 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6b532-826e-40e0-9e52-bbbb6884c6e7 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:10.810304 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6b532-826e-40e0-9e52-bbbb6884c6e7 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:10.826026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:10.847156 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0fa9e8-f6d9-472e-b433-eb58e6559028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:10.847845 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fa9e8-f6d9-472e-b433-eb58e6559028 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:10.848157 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fa9e8-f6d9-472e-b433-eb58e6559028 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:10.848443 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fa9e8-f6d9-472e-b433-eb58e6559028 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:10.849283 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0fa9e8-f6d9-472e-b433-eb58e6559028 None admin] RBAC: Adding query filter params (role.id=c5b2044766b04373a9900a04296f71c3, scope.project.id=8addb03b903842609168ee2fafc8ec6b, user.id=76f7895b7b5748e7b4461f7fde1d558a) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:10.849602 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0fa9e8-f6d9-472e-b433-eb58e6559028 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:10.851046 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0fa9e8-f6d9-472e-b433-eb58e6559028 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:10.868548 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 516/1045] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:37:10 2022] GET /identity/v3/role_assignments?user.id=76f7895b7b5748e7b4461f7fde1d558a&scope.project.id=8addb03b903842609168ee2fafc8ec6b&role.id=c5b2044766b04373a9900a04296f71c3 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:11.866792 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e9f60-ea2d-4dce-aebc-b5086c901539 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:11.867316 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e9f60-ea2d-4dce-aebc-b5086c901539 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:11.867432 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e9f60-ea2d-4dce-aebc-b5086c901539 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:11.869306 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 530/1046] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:11.874281 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c858b-93cf-4b68-a0ce-241e81b1cc37 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:11.874690 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c858b-93cf-4b68-a0ce-241e81b1cc37 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:11.874860 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c858b-93cf-4b68-a0ce-241e81b1cc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:11.891652 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-b54c858b-93cf-4b68-a0ce-241e81b1cc37 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:11.892829 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-b54c858b-93cf-4b68-a0ce-241e81b1cc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:11.960904 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 517/1047] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:37:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:37:11.984077 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e9f60-ea2d-4dce-aebc-b5086c901539 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:12.009524 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:12.092861 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e9f60-ea2d-4dce-aebc-b5086c901539 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:12.134494 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec5612-9392-4e2d-81ec-eb5a1bdd418b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:12.134494 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec5612-9392-4e2d-81ec-eb5a1bdd418b None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:12.134494 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec5612-9392-4e2d-81ec-eb5a1bdd418b None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:12.134494 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec5612-9392-4e2d-81ec-eb5a1bdd418b None admin] PATH_INFO: `/v3/services/image` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:12.134886 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec5612-9392-4e2d-81ec-eb5a1bdd418b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:12.135377 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec5612-9392-4e2d-81ec-eb5a1bdd418b None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:12.147064 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-62ec5612-9392-4e2d-81ec-eb5a1bdd418b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 23 15:37:12.147064 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:12.147064 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:37:12.147064 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:37:12.147064 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:37:12.147064 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:37:12.147064 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:37:12.147064 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:37:12.147064 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 15:37:12.147064 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:12.147064 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:37:12.147064 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:12.147064 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:12.147064 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:37:12.147064 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:37:12.147064 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:37:12.147064 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:37:12.148286 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:37:12.148286 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:37:12.148286 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:37:12.148286 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:37:12.148286 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:37:12.148286 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:37:12.148286 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:37:12.148286 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:37:12.148286 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:37:12.148286 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:37:12.148286 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:37:12.148286 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:37:12.148286 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:37:12.148286 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:37:12.148286 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:37:12.148286 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:37:12.149198 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:37:12.149198 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:37:12.149198 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:37:12.149198 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:37:12.149198 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:37:12.149198 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:37:12.149198 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:37:12.149198 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:37:12.149198 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:37:12.149198 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:37:12.149198 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:37:12.149198 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:37:12.149198 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 15:37:12.149198 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:12.151958 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 531/1048] 10.222.0.39 () {56 vars in 1105 bytes} [Mon May 23 15:37:11 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:37:12.154281 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c858b-93cf-4b68-a0ce-241e81b1cc37 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:12.268018 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c858b-93cf-4b68-a0ce-241e81b1cc37 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:12.277715 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:12.303252 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae919d-b20c-4dc6-8c74-da5f4eeffc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:12.304003 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae919d-b20c-4dc6-8c74-da5f4eeffc06 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:12.304292 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae919d-b20c-4dc6-8c74-da5f4eeffc06 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:12.304572 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae919d-b20c-4dc6-8c74-da5f4eeffc06 None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:12.305910 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae919d-b20c-4dc6-8c74-da5f4eeffc06 None admin] RBAC: Adding query filter params (name=image) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:12.306388 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae919d-b20c-4dc6-8c74-da5f4eeffc06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:12.307785 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae919d-b20c-4dc6-8c74-da5f4eeffc06 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:12.317990 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 518/1049] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:37:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:12.319028 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec5612-9392-4e2d-81ec-eb5a1bdd418b None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:12.411823 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:12.429645 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec5612-9392-4e2d-81ec-eb5a1bdd418b None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:12.471529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb9c4a-f855-4927-b86a-00793656874b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:12.472562 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb9c4a-f855-4927-b86a-00793656874b None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:12.473053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb9c4a-f855-4927-b86a-00793656874b None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:12.473523 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb9c4a-f855-4927-b86a-00793656874b None admin] PATH_INFO: `/v3/services` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:12.474417 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb9c4a-f855-4927-b86a-00793656874b None admin] RBAC: Adding query filter params (type=image) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:12.474926 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb9c4a-f855-4927-b86a-00793656874b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:12.476526 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb9c4a-f855-4927-b86a-00793656874b None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:12.483206 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 532/1050] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:37:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:37:12.488543 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae919d-b20c-4dc6-8c74-da5f4eeffc06 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:12.592000 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae919d-b20c-4dc6-8c74-da5f4eeffc06 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:12.619580 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2f5da-154d-40ab-b113-a268e41f3e88 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:12.620140 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2f5da-154d-40ab-b113-a268e41f3e88 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:12.620436 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2f5da-154d-40ab-b113-a268e41f3e88 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:12.622292 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 533/1051] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:37:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:37:12.627161 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a7f42-0e00-4eab-b306-fad923e3706d None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:12.627460 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a7f42-0e00-4eab-b306-fad923e3706d None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:12.627771 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a7f42-0e00-4eab-b306-fad923e3706d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:12.628697 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023aebc8-8957-40e1-a313-3e05a4920ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:12.629465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023aebc8-8957-40e1-a313-3e05a4920ac4 None admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:12.629749 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023aebc8-8957-40e1-a313-3e05a4920ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:12.630024 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023aebc8-8957-40e1-a313-3e05a4920ac4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:12.630761 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023aebc8-8957-40e1-a313-3e05a4920ac4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:12.632158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023aebc8-8957-40e1-a313-3e05a4920ac4 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:12.645519 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-ca0a7f42-0e00-4eab-b306-fad923e3706d None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:12.646721 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-ca0a7f42-0e00-4eab-b306-fad923e3706d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:12.718688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 534/1052] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:37:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:37:12.720805 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 519/1053] 10.222.0.39 () {60 vars in 1144 bytes} [Mon May 23 15:37:12 2022] POST /identity/v3/endpoints => generated 327 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:37:12.746969 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a7f42-0e00-4eab-b306-fad923e3706d None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:12.837859 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:12.859671 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a7f42-0e00-4eab-b306-fad923e3706d None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:12.908365 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b9289-bc75-4707-934b-fa40c16dc315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:12.909181 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b9289-bc75-4707-934b-fa40c16dc315 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:12.909443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b9289-bc75-4707-934b-fa40c16dc315 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:12.909717 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b9289-bc75-4707-934b-fa40c16dc315 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:12.922718 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b9289-bc75-4707-934b-fa40c16dc315 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:37:12.930393 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-220b9289-bc75-4707-934b-fa40c16dc315 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:37:12.930393 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:12.930393 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:37:12.930393 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:37:12.930393 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:37:12.930393 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:37:12.930393 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:37:12.930393 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:37:12.930393 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:37:12.930393 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:37:12.930393 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:37:12.930393 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:37:12.930393 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:37:12.930393 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:37:12.930393 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:37:12.930393 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:37:12.931555 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:37:12.931555 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:37:12.931555 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:37:12.931555 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:37:12.931555 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:37:12.931555 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:37:12.931555 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:37:12.931555 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:37:12.931555 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:37:12.931555 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:37:12.931555 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:37:12.931555 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:37:12.931555 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:37:12.931555 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:37:12.931555 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:37:12.931555 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:37:12.932479 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:37:12.932479 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:37:12.932479 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:37:12.932479 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:37:12.932479 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:37:12.932479 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:37:12.932479 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:37:12.932479 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:37:12.932479 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:37:12.932479 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:37:12.932479 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:37:12.932479 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:12.932479 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 535/1054] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:37:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:37:12.937584 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023aebc8-8957-40e1-a313-3e05a4920ac4 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:12.970376 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:13.042997 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023aebc8-8957-40e1-a313-3e05a4920ac4 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:13.066420 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26764c6a-8a47-42f6-bc78-cf73f164e5b7 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:13.066773 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26764c6a-8a47-42f6-bc78-cf73f164e5b7 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:13.066987 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26764c6a-8a47-42f6-bc78-cf73f164e5b7 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:13.068619 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 536/1055] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:13.073514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d1517-4be2-437f-8b01-63a0d089c3d5 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:13.073809 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d1517-4be2-437f-8b01-63a0d089c3d5 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:13.074089 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d1517-4be2-437f-8b01-63a0d089c3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:13.086697 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc14e72-69df-4b1a-971f-d6ea0fb7773f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:13.087676 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc14e72-69df-4b1a-971f-d6ea0fb7773f None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:13.087966 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc14e72-69df-4b1a-971f-d6ea0fb7773f None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:13.088246 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc14e72-69df-4b1a-971f-d6ea0fb7773f None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:13.089002 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc14e72-69df-4b1a-971f-d6ea0fb7773f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:13.089313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc14e72-69df-4b1a-971f-d6ea0fb7773f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:13.090689 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc14e72-69df-4b1a-971f-d6ea0fb7773f None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:13.090805 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-d75d1517-4be2-437f-8b01-63a0d089c3d5 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:13.091977 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-d75d1517-4be2-437f-8b01-63a0d089c3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:13.101211 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 520/1056] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:37:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:13.107413 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc14e72-69df-4b1a-971f-d6ea0fb7773f None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:13.167861 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 537/1057] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:37:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:37:13.191089 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d1517-4be2-437f-8b01-63a0d089c3d5 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:13.212890 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:13.221335 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc14e72-69df-4b1a-971f-d6ea0fb7773f None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:13.263649 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f432f0e-2fd9-416f-b2be-1ba964b8e631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:13.264533 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f432f0e-2fd9-416f-b2be-1ba964b8e631 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:13.264818 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f432f0e-2fd9-416f-b2be-1ba964b8e631 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:13.265098 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f432f0e-2fd9-416f-b2be-1ba964b8e631 None admin] PATH_INFO: `/v3/users/fa63f1c2708646c385f6743084f6d2ba` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:13.269040 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:13.279239 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f432f0e-2fd9-416f-b2be-1ba964b8e631 None admin] RBAC: Authorizing `identity:get_user(user_id=fa63f1c2708646c385f6743084f6d2ba)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:13.282141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f432f0e-2fd9-416f-b2be-1ba964b8e631 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:13.287178 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 521/1058] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:37:13 2022] GET /identity/v3/users/fa63f1c2708646c385f6743084f6d2ba => generated 285 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:37:13.288043 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f432f0e-2fd9-416f-b2be-1ba964b8e631 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:13.309419 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d1517-4be2-437f-8b01-63a0d089c3d5 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:13.354196 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3517cf-d778-4cab-9b3e-7a84299a7d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:13.355300 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3517cf-d778-4cab-9b3e-7a84299a7d58 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:13.355585 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3517cf-d778-4cab-9b3e-7a84299a7d58 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:13.356145 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3517cf-d778-4cab-9b3e-7a84299a7d58 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:13.369618 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3517cf-d778-4cab-9b3e-7a84299a7d58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:37:13.377756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-ea3517cf-d778-4cab-9b3e-7a84299a7d58 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:37:13.377756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:13.377756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:37:13.377756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:37:13.377756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:37:13.377756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:37:13.377756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:37:13.377756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:37:13.377756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:37:13.377756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:37:13.377756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:37:13.377756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:37:13.377756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:37:13.377756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:37:13.377756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:37:13.377756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:37:13.378957 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:37:13.378957 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:37:13.378957 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:37:13.378957 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:37:13.378957 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:37:13.378957 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:37:13.378957 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:37:13.378957 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:37:13.378957 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:37:13.378957 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:37:13.378957 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:37:13.378957 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:37:13.378957 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:37:13.378957 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:37:13.378957 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:37:13.378957 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:37:13.380607 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:37:13.380607 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:37:13.380607 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:37:13.380607 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:37:13.380607 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:37:13.380607 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:37:13.380607 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:37:13.380607 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:37:13.380607 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:37:13.380607 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:37:13.380607 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:37:13.380607 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:13.380607 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 538/1059] 10.222.0.39 () {56 vars in 1120 bytes} [Mon May 23 15:37:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:37:13.386204 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3517cf-d778-4cab-9b3e-7a84299a7d58 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:13.403692 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f432f0e-2fd9-416f-b2be-1ba964b8e631 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:13.440271 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1ac6a-363d-4d36-b343-a283cb2e89cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:13.440920 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1ac6a-363d-4d36-b343-a283cb2e89cd None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:13.441206 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1ac6a-363d-4d36-b343-a283cb2e89cd None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:13.441483 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1ac6a-363d-4d36-b343-a283cb2e89cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:13.459940 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:13.497073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3517cf-d778-4cab-9b3e-7a84299a7d58 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:13.513123 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1ac6a-363d-4d36-b343-a283cb2e89cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:13.514704 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1ac6a-363d-4d36-b343-a283cb2e89cd None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:13.527352 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:13.537173 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c1aab-0f0c-4507-ae49-d4a1754ebac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:13.542216 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c1aab-0f0c-4507-ae49-d4a1754ebac0 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:13.542216 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c1aab-0f0c-4507-ae49-d4a1754ebac0 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:13.542216 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c1aab-0f0c-4507-ae49-d4a1754ebac0 None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:13.542216 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c1aab-0f0c-4507-ae49-d4a1754ebac0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:13.542216 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c1aab-0f0c-4507-ae49-d4a1754ebac0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:13.542216 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c1aab-0f0c-4507-ae49-d4a1754ebac0 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:13.550089 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 539/1060] 10.222.0.39 () {56 vars in 1115 bytes} [Mon May 23 15:37:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:37:13.556049 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c1aab-0f0c-4507-ae49-d4a1754ebac0 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:13.623679 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 522/1061] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:37:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:37:13.629420 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1ac6a-363d-4d36-b343-a283cb2e89cd None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:13.663266 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c1aab-0f0c-4507-ae49-d4a1754ebac0 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:13.680106 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:13.698978 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c65a3-25ad-4b5e-8f12-94e99416547c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:13.699792 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c65a3-25ad-4b5e-8f12-94e99416547c None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:13.700107 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c65a3-25ad-4b5e-8f12-94e99416547c None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:13.700402 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c65a3-25ad-4b5e-8f12-94e99416547c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:13.710546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c65a3-25ad-4b5e-8f12-94e99416547c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:13.712690 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c65a3-25ad-4b5e-8f12-94e99416547c None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:13.731272 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-285c65a3-25ad-4b5e-8f12-94e99416547c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:37:13.731272 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:13.731272 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:37:13.731272 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:37:13.731272 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:37:13.731272 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:37:13.731272 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:37:13.731272 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:37:13.731272 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:37:13.731272 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:37:13.731272 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:37:13.731272 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:37:13.731272 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:37:13.731272 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:37:13.731272 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:37:13.732249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:37:13.732249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:37:13.732249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:37:13.732249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:37:13.732249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:37:13.732249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:37:13.732249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:37:13.732249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:37:13.732249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:37:13.732249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:37:13.732249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:37:13.732249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:37:13.732249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:37:13.732249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:37:13.732249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:37:13.732249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:37:13.732249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:37:13.733189 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:37:13.733189 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:37:13.733189 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:37:13.733189 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:13.733189 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 540/1062] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:37:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:37:13.736080 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1ac6a-363d-4d36-b343-a283cb2e89cd None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:13.737940 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c65a3-25ad-4b5e-8f12-94e99416547c None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:13.774702 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf998d20-0e94-40da-a82e-21f7bd19d376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:13.775492 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf998d20-0e94-40da-a82e-21f7bd19d376 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:13.775811 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf998d20-0e94-40da-a82e-21f7bd19d376 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:13.776090 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf998d20-0e94-40da-a82e-21f7bd19d376 None admin] PATH_INFO: `/v3/projects/41d3294cf56b45438b9a74a9cb52bfeb` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:13.777316 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf998d20-0e94-40da-a82e-21f7bd19d376 None admin] RBAC: Authorizing `identity:get_project(project_id=41d3294cf56b45438b9a74a9cb52bfeb)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:13.778760 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf998d20-0e94-40da-a82e-21f7bd19d376 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:13.780661 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 523/1063] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:37:13 2022] GET /identity/v3/projects/41d3294cf56b45438b9a74a9cb52bfeb => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:37:13.783130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:13.786424 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf998d20-0e94-40da-a82e-21f7bd19d376 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:13.846461 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c65a3-25ad-4b5e-8f12-94e99416547c None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:13.886774 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e6282-2a20-4371-8c3d-f992a819e7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:13.887449 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e6282-2a20-4371-8c3d-f992a819e7cc None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:13.887800 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e6282-2a20-4371-8c3d-f992a819e7cc None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:13.888090 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e6282-2a20-4371-8c3d-f992a819e7cc None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:13.888817 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e6282-2a20-4371-8c3d-f992a819e7cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:13.889131 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e6282-2a20-4371-8c3d-f992a819e7cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:13.890513 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e6282-2a20-4371-8c3d-f992a819e7cc None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:13.891228 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf998d20-0e94-40da-a82e-21f7bd19d376 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:13.903358 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 541/1064] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:37:13.908648 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e6282-2a20-4371-8c3d-f992a819e7cc None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:13.916243 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:13.934596 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe8ae5-7edd-4bec-a300-16f892e60210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:13.942568 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe8ae5-7edd-4bec-a300-16f892e60210 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:13.942568 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe8ae5-7edd-4bec-a300-16f892e60210 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:13.942568 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe8ae5-7edd-4bec-a300-16f892e60210 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:13.942568 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe8ae5-7edd-4bec-a300-16f892e60210 None admin] RBAC: Adding query filter params (role.id=3ab888f5f68740bd8f9df4447f4f5a7a, scope.project.id=41d3294cf56b45438b9a74a9cb52bfeb, user.id=fa63f1c2708646c385f6743084f6d2ba) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:13.942568 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe8ae5-7edd-4bec-a300-16f892e60210 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:13.942568 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe8ae5-7edd-4bec-a300-16f892e60210 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:13.955702 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 524/1065] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:37:13 2022] GET /identity/v3/role_assignments?user.id=fa63f1c2708646c385f6743084f6d2ba&scope.project.id=41d3294cf56b45438b9a74a9cb52bfeb&role.id=3ab888f5f68740bd8f9df4447f4f5a7a => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:37:14.023448 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:14.027138 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e6282-2a20-4371-8c3d-f992a819e7cc None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:14.064146 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58df69f-615f-487e-a927-71cb5b65afa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:14.064956 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58df69f-615f-487e-a927-71cb5b65afa3 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:14.065241 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58df69f-615f-487e-a927-71cb5b65afa3 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:14.065516 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58df69f-615f-487e-a927-71cb5b65afa3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:14.074189 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58df69f-615f-487e-a927-71cb5b65afa3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:14.075682 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58df69f-615f-487e-a927-71cb5b65afa3 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:14.091196 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-b58df69f-615f-487e-a927-71cb5b65afa3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 15:37:14.091196 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:14.091196 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:37:14.091196 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:37:14.091196 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:37:14.091196 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:37:14.091196 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:37:14.091196 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:37:14.091196 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:37:14.091196 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:37:14.091196 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:37:14.091196 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:37:14.091196 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:37:14.091196 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:37:14.091196 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:37:14.091196 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:37:14.092481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:37:14.092481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:37:14.092481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:37:14.092481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:37:14.092481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:37:14.092481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:37:14.092481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:37:14.092481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:37:14.092481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:37:14.092481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:37:14.092481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:37:14.092481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:37:14.092481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:37:14.092481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:37:14.092481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:37:14.092481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:37:14.092481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:37:14.092481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:37:14.093443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:37:14.093443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:37:14.093443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:37:14.093443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:37:14.093443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:37:14.093443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:37:14.093443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:37:14.093443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:37:14.093443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 15:37:14.093443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:14.095939 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 542/1066] 10.222.0.39 () {56 vars in 1093 bytes} [Mon May 23 15:37:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:37:14.098410 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe8ae5-7edd-4bec-a300-16f892e60210 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:14.208515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe8ae5-7edd-4bec-a300-16f892e60210 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:14.245062 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba96386-cace-4e84-9e3f-adca30bc19c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:14.245726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba96386-cace-4e84-9e3f-adca30bc19c8 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:14.246006 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba96386-cace-4e84-9e3f-adca30bc19c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:14.246279 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba96386-cace-4e84-9e3f-adca30bc19c8 None admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:14.247101 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba96386-cace-4e84-9e3f-adca30bc19c8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:14.247406 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba96386-cace-4e84-9e3f-adca30bc19c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:14.248854 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba96386-cace-4e84-9e3f-adca30bc19c8 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:14.271187 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 525/1067] 10.222.0.39 () {56 vars in 1133 bytes} [Mon May 23 15:37:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:14.272802 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58df69f-615f-487e-a927-71cb5b65afa3 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:14.376972 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58df69f-615f-487e-a927-71cb5b65afa3 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:14.411463 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d9fb6-f101-45a8-885b-015c599236fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:14.412281 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d9fb6-f101-45a8-885b-015c599236fc None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:14.412564 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d9fb6-f101-45a8-885b-015c599236fc None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:14.412837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d9fb6-f101-45a8-885b-015c599236fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:14.423176 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d9fb6-f101-45a8-885b-015c599236fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:14.424662 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d9fb6-f101-45a8-885b-015c599236fc None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:14.442626 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-791d9fb6-f101-45a8-885b-015c599236fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:37:14.442626 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:14.442626 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:37:14.442626 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:37:14.442626 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:37:14.442626 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:37:14.442626 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:37:14.442626 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:37:14.442626 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:37:14.442626 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:37:14.442626 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:37:14.442626 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:37:14.442626 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:37:14.442626 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:37:14.442626 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:37:14.443576 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:37:14.443576 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:37:14.443576 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:37:14.443576 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:37:14.443576 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:37:14.443576 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:37:14.443576 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:37:14.443576 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:37:14.443576 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:37:14.443576 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:37:14.443576 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:37:14.443576 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:37:14.443576 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:37:14.443576 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:37:14.443576 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:37:14.443576 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:37:14.443576 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:37:14.444845 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:37:14.444845 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:37:14.444845 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:37:14.444845 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:14.447947 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 543/1068] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:37:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:37:14.449614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba96386-cace-4e84-9e3f-adca30bc19c8 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:14.490327 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:14.551465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba96386-cace-4e84-9e3f-adca30bc19c8 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:14.588116 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e8bf1-b2b4-4388-92d9-dfcb379b0f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:14.588788 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e8bf1-b2b4-4388-92d9-dfcb379b0f16 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:14.589073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e8bf1-b2b4-4388-92d9-dfcb379b0f16 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:14.589350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e8bf1-b2b4-4388-92d9-dfcb379b0f16 None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:14.590072 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e8bf1-b2b4-4388-92d9-dfcb379b0f16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:14.590381 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e8bf1-b2b4-4388-92d9-dfcb379b0f16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:14.593540 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e8bf1-b2b4-4388-92d9-dfcb379b0f16 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:14.606568 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 526/1069] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:14.612051 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d9fb6-f101-45a8-885b-015c599236fc None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:14.628522 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:14.728168 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d9fb6-f101-45a8-885b-015c599236fc None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:14.762988 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b1dd3-145f-4006-9b12-93ba1ba9b49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:14.763806 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b1dd3-145f-4006-9b12-93ba1ba9b49c None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:14.764092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b1dd3-145f-4006-9b12-93ba1ba9b49c None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:14.764367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b1dd3-145f-4006-9b12-93ba1ba9b49c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:14.771177 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b1dd3-145f-4006-9b12-93ba1ba9b49c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:14.772674 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b1dd3-145f-4006-9b12-93ba1ba9b49c None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:14.786228 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-749b1dd3-145f-4006-9b12-93ba1ba9b49c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:37:14.786228 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:14.786228 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:37:14.786228 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:37:14.786228 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:37:14.786228 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:37:14.786228 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:37:14.786228 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:37:14.786228 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:37:14.786228 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:37:14.786228 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:37:14.786228 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:37:14.786228 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:37:14.786228 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:37:14.786228 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:37:14.787174 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:37:14.787174 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:37:14.787174 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:37:14.787174 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:37:14.787174 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:37:14.787174 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:37:14.787174 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:37:14.787174 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:37:14.787174 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:37:14.787174 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:37:14.787174 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:37:14.787174 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:37:14.787174 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:37:14.787174 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:37:14.787174 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:37:14.787174 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:37:14.787174 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:37:14.788121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:37:14.788121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:37:14.788121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:37:14.788121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:37:14.788121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:37:14.788121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:37:14.788121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:37:14.788121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:14.792082 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 544/1070] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:37:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:37:14.794280 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e8bf1-b2b4-4388-92d9-dfcb379b0f16 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:14.893701 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:14.898026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e8bf1-b2b4-4388-92d9-dfcb379b0f16 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:14.931504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fff2f-c22a-468c-b96a-4dc6bb55cd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:14.932188 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fff2f-c22a-468c-b96a-4dc6bb55cd92 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:14.932471 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fff2f-c22a-468c-b96a-4dc6bb55cd92 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:14.932747 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fff2f-c22a-468c-b96a-4dc6bb55cd92 None admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:14.933590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6fff2f-c22a-468c-b96a-4dc6bb55cd92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:14.933902 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6fff2f-c22a-468c-b96a-4dc6bb55cd92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:14.935473 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6fff2f-c22a-468c-b96a-4dc6bb55cd92 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:14.948000 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 527/1071] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:37:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:14.953766 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b1dd3-145f-4006-9b12-93ba1ba9b49c None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:14.989032 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6bb30-ad75-43ad-b760-02dd82272cd6 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:14.989457 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6bb30-ad75-43ad-b760-02dd82272cd6 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:14.989598 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6bb30-ad75-43ad-b760-02dd82272cd6 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:14.991062 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 528/1072] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:37:14.996564 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558513f7-a203-4d30-a53f-b60876c7ebf9 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:14.996868 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558513f7-a203-4d30-a53f-b60876c7ebf9 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:14.997131 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558513f7-a203-4d30-a53f-b60876c7ebf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:15.014014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-558513f7-a203-4d30-a53f-b60876c7ebf9 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:15.015199 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-558513f7-a203-4d30-a53f-b60876c7ebf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:15.033956 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:15.066108 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b1dd3-145f-4006-9b12-93ba1ba9b49c None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:15.093192 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 529/1073] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:37:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:37:15.108238 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4aac8-3d43-4ad7-a985-0f3fc305a414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:15.109122 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4aac8-3d43-4ad7-a985-0f3fc305a414 None admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:15.109404 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4aac8-3d43-4ad7-a985-0f3fc305a414 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:15.109678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4aac8-3d43-4ad7-a985-0f3fc305a414 None admin] PATH_INFO: `/v3/projects/8addb03b903842609168ee2fafc8ec6b/users/76f7895b7b5748e7b4461f7fde1d558a/roles/c5b2044766b04373a9900a04296f71c3` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:15.111921 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4aac8-3d43-4ad7-a985-0f3fc305a414 None admin] RBAC: Authorizing `identity:create_grant(project_id=8addb03b903842609168ee2fafc8ec6b, user_id=76f7895b7b5748e7b4461f7fde1d558a, role_id=c5b2044766b04373a9900a04296f71c3)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:15.113360 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4aac8-3d43-4ad7-a985-0f3fc305a414 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:15.116891 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558513f7-a203-4d30-a53f-b60876c7ebf9 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:15.193731 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 545/1074] 10.222.0.39 () {58 vars in 1439 bytes} [Mon May 23 15:37:14 2022] PUT /identity/v3/projects/8addb03b903842609168ee2fafc8ec6b/users/76f7895b7b5748e7b4461f7fde1d558a/roles/c5b2044766b04373a9900a04296f71c3 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:37:15.220822 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:15.224826 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558513f7-a203-4d30-a53f-b60876c7ebf9 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:15.262366 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5847b-f0f9-4dbc-a2fe-dfddb6ad3ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:15.263054 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5847b-f0f9-4dbc-a2fe-dfddb6ad3ed7 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:15.263325 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5847b-f0f9-4dbc-a2fe-dfddb6ad3ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:15.263623 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5847b-f0f9-4dbc-a2fe-dfddb6ad3ed7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:15.340697 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5847b-f0f9-4dbc-a2fe-dfddb6ad3ed7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:15.342176 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5847b-f0f9-4dbc-a2fe-dfddb6ad3ed7 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:15.436528 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:15.454498 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 530/1075] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:37:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 15:37:15.456058 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4aac8-3d43-4ad7-a985-0f3fc305a414 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:15.560019 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4aac8-3d43-4ad7-a985-0f3fc305a414 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:15.588943 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:15.594403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b4a59-e464-42f7-9d2b-957885d76425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:15.595195 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b4a59-e464-42f7-9d2b-957885d76425 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:15.595477 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b4a59-e464-42f7-9d2b-957885d76425 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:15.595874 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b4a59-e464-42f7-9d2b-957885d76425 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:15.607406 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b4a59-e464-42f7-9d2b-957885d76425 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:15.608991 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b4a59-e464-42f7-9d2b-957885d76425 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:15.627003 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-b25b4a59-e464-42f7-9d2b-957885d76425 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:37:15.627003 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:15.627003 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:37:15.627003 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:37:15.627003 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:37:15.627003 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:37:15.627003 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:37:15.627003 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:37:15.627003 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:37:15.627003 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:37:15.627003 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:37:15.627003 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:37:15.627003 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:37:15.627003 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:37:15.627003 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:37:15.628147 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:37:15.628147 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:37:15.628147 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:37:15.628147 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:37:15.628147 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:37:15.628147 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:37:15.628147 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:37:15.628147 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:37:15.628147 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:37:15.628147 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:37:15.628147 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:37:15.628147 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:37:15.628147 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:37:15.628147 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:37:15.628147 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:37:15.628147 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:37:15.628147 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:37:15.629257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:37:15.629257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:37:15.629257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:37:15.629257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:15.631550 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 546/1076] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:37:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:37:15.638908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5847b-f0f9-4dbc-a2fe-dfddb6ad3ed7 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:15.744455 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5847b-f0f9-4dbc-a2fe-dfddb6ad3ed7 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:15.778613 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae716aef-77e2-42cd-bc3a-7637636f81b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:15.779282 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae716aef-77e2-42cd-bc3a-7637636f81b6 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:15.779567 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae716aef-77e2-42cd-bc3a-7637636f81b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:15.779872 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae716aef-77e2-42cd-bc3a-7637636f81b6 None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:15.780598 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae716aef-77e2-42cd-bc3a-7637636f81b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:15.780909 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae716aef-77e2-42cd-bc3a-7637636f81b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:15.782283 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae716aef-77e2-42cd-bc3a-7637636f81b6 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:15.799650 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 531/1077] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:37:16.157936 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed49ca-f3bd-4e4b-acc9-91ca9926082e None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:16.158462 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed49ca-f3bd-4e4b-acc9-91ca9926082e None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:16.158577 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed49ca-f3bd-4e4b-acc9-91ca9926082e None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:16.159918 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 547/1078] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:16.166095 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bb3f5-1582-4008-8d96-98fc3f79a15b None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:16.166529 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bb3f5-1582-4008-8d96-98fc3f79a15b None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:16.166719 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bb3f5-1582-4008-8d96-98fc3f79a15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:16.183788 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-8e9bb3f5-1582-4008-8d96-98fc3f79a15b None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:16.184965 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-8e9bb3f5-1582-4008-8d96-98fc3f79a15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:16.231636 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:16.254338 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 532/1079] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:37:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:37:16.276627 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed49ca-f3bd-4e4b-acc9-91ca9926082e None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:16.380915 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed49ca-f3bd-4e4b-acc9-91ca9926082e None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:16.415587 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f4b3f-b177-4fef-85ef-d06db94b1470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:16.416321 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f4b3f-b177-4fef-85ef-d06db94b1470 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:16.416603 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f4b3f-b177-4fef-85ef-d06db94b1470 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:16.416877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f4b3f-b177-4fef-85ef-d06db94b1470 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:16.426901 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f4b3f-b177-4fef-85ef-d06db94b1470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:37:16.434522 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-758f4b3f-b177-4fef-85ef-d06db94b1470 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:37:16.434522 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:16.434522 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:37:16.434522 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:37:16.434522 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:37:16.434522 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:37:16.434522 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:37:16.434522 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:37:16.434522 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:37:16.434522 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:37:16.434522 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:37:16.434522 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:37:16.434522 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:37:16.434522 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:37:16.434522 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:37:16.434522 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:37:16.435678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:37:16.435678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:37:16.435678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:37:16.435678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:37:16.435678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:37:16.435678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:37:16.435678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:37:16.435678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:37:16.435678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:37:16.435678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:37:16.435678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:37:16.435678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:37:16.435678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:37:16.435678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:37:16.435678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:37:16.435678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:37:16.436958 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:37:16.436958 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:37:16.436958 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:37:16.436958 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:37:16.436958 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:37:16.436958 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:37:16.436958 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:37:16.436958 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:37:16.436958 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:37:16.436958 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:37:16.436958 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:37:16.436958 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:16.436958 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 548/1080] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:37:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:37:16.441807 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9bb3f5-1582-4008-8d96-98fc3f79a15b None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:16.538797 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9bb3f5-1582-4008-8d96-98fc3f79a15b None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:16.572238 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583fbb23-f7fd-4ef7-b9bd-9d5c418694bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:16.572896 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fbb23-f7fd-4ef7-b9bd-9d5c418694bf None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:16.573176 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fbb23-f7fd-4ef7-b9bd-9d5c418694bf None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:16.573450 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fbb23-f7fd-4ef7-b9bd-9d5c418694bf None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:16.574192 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583fbb23-f7fd-4ef7-b9bd-9d5c418694bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:16.574499 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583fbb23-f7fd-4ef7-b9bd-9d5c418694bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:16.575894 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583fbb23-f7fd-4ef7-b9bd-9d5c418694bf None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:16.588551 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 533/1081] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:37:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:16.589856 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f4b3f-b177-4fef-85ef-d06db94b1470 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:16.635171 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:16.688516 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f4b3f-b177-4fef-85ef-d06db94b1470 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:16.721252 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf5186-1fb4-401c-87fb-8935133abd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:16.722119 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf5186-1fb4-401c-87fb-8935133abd7b None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:16.722407 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf5186-1fb4-401c-87fb-8935133abd7b None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:16.722684 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf5186-1fb4-401c-87fb-8935133abd7b None admin] PATH_INFO: `/v3/users/fa63f1c2708646c385f6743084f6d2ba` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:16.723893 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf5186-1fb4-401c-87fb-8935133abd7b None admin] RBAC: Authorizing `identity:get_user(user_id=fa63f1c2708646c385f6743084f6d2ba)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:16.725324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf5186-1fb4-401c-87fb-8935133abd7b None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:16.727883 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 549/1082] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:37:16 2022] GET /identity/v3/users/fa63f1c2708646c385f6743084f6d2ba => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:16.733739 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583fbb23-f7fd-4ef7-b9bd-9d5c418694bf None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:16.775957 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:16.832885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583fbb23-f7fd-4ef7-b9bd-9d5c418694bf None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:16.866108 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66614b-4462-4f3c-b38f-9817541b75c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:16.866972 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66614b-4462-4f3c-b38f-9817541b75c7 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:16.867413 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66614b-4462-4f3c-b38f-9817541b75c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:16.867803 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66614b-4462-4f3c-b38f-9817541b75c7 None admin] PATH_INFO: `/v3/projects/41d3294cf56b45438b9a74a9cb52bfeb` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:16.868985 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d66614b-4462-4f3c-b38f-9817541b75c7 None admin] RBAC: Authorizing `identity:get_project(project_id=41d3294cf56b45438b9a74a9cb52bfeb)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:16.870418 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d66614b-4462-4f3c-b38f-9817541b75c7 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:16.872151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 534/1083] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:37:16 2022] GET /identity/v3/projects/41d3294cf56b45438b9a74a9cb52bfeb => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:16.878034 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf5186-1fb4-401c-87fb-8935133abd7b None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:16.978054 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf5186-1fb4-401c-87fb-8935133abd7b None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:16.990810 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:17.011808 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da390e5-c110-420e-9bd4-2f8168d92278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:17.012694 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da390e5-c110-420e-9bd4-2f8168d92278 None admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:17.012976 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da390e5-c110-420e-9bd4-2f8168d92278 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:17.013250 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da390e5-c110-420e-9bd4-2f8168d92278 None admin] PATH_INFO: `/v3/projects/41d3294cf56b45438b9a74a9cb52bfeb/users/fa63f1c2708646c385f6743084f6d2ba/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:17.015199 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da390e5-c110-420e-9bd4-2f8168d92278 None admin] RBAC: Authorizing `identity:create_grant(project_id=41d3294cf56b45438b9a74a9cb52bfeb, user_id=fa63f1c2708646c385f6743084f6d2ba, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:17.016667 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da390e5-c110-420e-9bd4-2f8168d92278 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:17.089408 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 550/1084] 10.222.0.39 () {58 vars in 1439 bytes} [Mon May 23 15:37:16 2022] PUT /identity/v3/projects/41d3294cf56b45438b9a74a9cb52bfeb/users/fa63f1c2708646c385f6743084f6d2ba/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:37:17.405059 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc52dd4-f1cb-4e78-b36d-c905654c2353 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:17.405587 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc52dd4-f1cb-4e78-b36d-c905654c2353 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:17.405680 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc52dd4-f1cb-4e78-b36d-c905654c2353 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:17.406989 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 535/1085] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:17.412202 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19b6e6-bec2-41a6-9615-c619f9e708f2 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:17.412626 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19b6e6-bec2-41a6-9615-c619f9e708f2 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:17.412765 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19b6e6-bec2-41a6-9615-c619f9e708f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:17.430648 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-ed19b6e6-bec2-41a6-9615-c619f9e708f2 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:17.431854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-ed19b6e6-bec2-41a6-9615-c619f9e708f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:17.497828 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 551/1086] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:37:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:37:17.521990 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc52dd4-f1cb-4e78-b36d-c905654c2353 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:17.626532 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc52dd4-f1cb-4e78-b36d-c905654c2353 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:17.635223 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:17.659159 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc837a-3af5-4a0f-9c33-7c625260c9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:17.659924 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc837a-3af5-4a0f-9c33-7c625260c9ae None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:17.660208 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc837a-3af5-4a0f-9c33-7c625260c9ae None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:17.660479 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc837a-3af5-4a0f-9c33-7c625260c9ae None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:17.671584 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc837a-3af5-4a0f-9c33-7c625260c9ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:37:17.680837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-a4cc837a-3af5-4a0f-9c33-7c625260c9ae None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:37:17.680837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:17.680837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:37:17.680837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:37:17.680837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:37:17.680837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:37:17.680837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:37:17.680837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:37:17.680837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:37:17.680837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:37:17.680837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:37:17.680837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:37:17.680837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:37:17.680837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:37:17.680837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:37:17.680837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:37:17.681772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:37:17.681772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:37:17.681772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:37:17.681772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:37:17.681772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:37:17.681772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:37:17.681772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:37:17.681772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:37:17.681772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:37:17.681772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:37:17.681772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:37:17.681772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:37:17.681772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:37:17.681772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:37:17.681772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:37:17.681772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:37:17.682617 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:37:17.682617 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:37:17.682617 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:37:17.682617 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:37:17.682617 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:37:17.682617 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:37:17.682617 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:37:17.682617 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:37:17.682617 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:37:17.682617 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:37:17.682617 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:37:17.682617 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:37:17.683752 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 536/1087] 10.222.0.39 () {56 vars in 1120 bytes} [Mon May 23 15:37:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:37:17.687920 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19b6e6-bec2-41a6-9615-c619f9e708f2 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:17.784914 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19b6e6-bec2-41a6-9615-c619f9e708f2 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:17.786405 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:17.820159 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf319625-ed90-48b4-9b4f-ace223fd7ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:17.821085 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf319625-ed90-48b4-9b4f-ace223fd7ead None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:17.821372 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf319625-ed90-48b4-9b4f-ace223fd7ead None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:17.821653 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf319625-ed90-48b4-9b4f-ace223fd7ead None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:17.822400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf319625-ed90-48b4-9b4f-ace223fd7ead None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:17.822710 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf319625-ed90-48b4-9b4f-ace223fd7ead None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:17.824144 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf319625-ed90-48b4-9b4f-ace223fd7ead None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:17.832075 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 552/1088] 10.222.0.39 () {56 vars in 1115 bytes} [Mon May 23 15:37:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:17.838090 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc837a-3af5-4a0f-9c33-7c625260c9ae None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:17.939700 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc837a-3af5-4a0f-9c33-7c625260c9ae None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:17.972482 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f571cc-90c0-41b6-90da-3f0a08505f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:17.973263 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f571cc-90c0-41b6-90da-3f0a08505f45 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:17.973545 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f571cc-90c0-41b6-90da-3f0a08505f45 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:17.973820 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f571cc-90c0-41b6-90da-3f0a08505f45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:17.983956 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f571cc-90c0-41b6-90da-3f0a08505f45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:17.985402 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f571cc-90c0-41b6-90da-3f0a08505f45 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:18.003148 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-10f571cc-90c0-41b6-90da-3f0a08505f45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:37:18.003148 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:18.003148 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:37:18.003148 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:37:18.003148 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:37:18.003148 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:37:18.003148 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:37:18.003148 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:37:18.003148 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:37:18.003148 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:37:18.003148 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:37:18.003148 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:37:18.003148 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:37:18.003148 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:37:18.003148 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:37:18.004278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:37:18.004278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:37:18.004278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:37:18.004278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:37:18.004278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:37:18.004278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:37:18.004278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:37:18.004278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:37:18.004278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:37:18.004278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:37:18.004278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:37:18.004278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:37:18.004278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:37:18.004278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:37:18.004278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:37:18.004278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:37:18.004278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:37:18.005230 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:37:18.005230 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:37:18.005230 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:37:18.005230 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:37:18.008384 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 537/1089] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:37:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:37:18.010695 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf319625-ed90-48b4-9b4f-ace223fd7ead None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:18.108561 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf319625-ed90-48b4-9b4f-ace223fd7ead None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:18.142568 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d2106-3747-4663-a5a4-83c28a5eea81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:18.143232 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d2106-3747-4663-a5a4-83c28a5eea81 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:18.143517 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d2106-3747-4663-a5a4-83c28a5eea81 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:18.143833 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d2106-3747-4663-a5a4-83c28a5eea81 None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:18.144558 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d2106-3747-4663-a5a4-83c28a5eea81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:18.144869 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d2106-3747-4663-a5a4-83c28a5eea81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:18.146236 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d2106-3747-4663-a5a4-83c28a5eea81 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:18.157915 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 553/1090] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:18.163498 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f571cc-90c0-41b6-90da-3f0a08505f45 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:18.186069 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:18.272782 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f571cc-90c0-41b6-90da-3f0a08505f45 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:18.307606 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd6e25-aead-43f0-8f13-e732ba8c923e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:18.308407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd6e25-aead-43f0-8f13-e732ba8c923e None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:18.308686 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd6e25-aead-43f0-8f13-e732ba8c923e None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:18.308956 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd6e25-aead-43f0-8f13-e732ba8c923e None admin] PATH_INFO: `/v3/users/nova` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:18.316573 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd6e25-aead-43f0-8f13-e732ba8c923e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:18.318005 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd6e25-aead-43f0-8f13-e732ba8c923e None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:18.331837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-09bd6e25-aead-43f0-8f13-e732ba8c923e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 15:37:18.331837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:18.331837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:37:18.331837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:37:18.331837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:37:18.331837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:37:18.331837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:37:18.331837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:37:18.331837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:37:18.331837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:37:18.331837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:37:18.331837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:37:18.331837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:37:18.331837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:37:18.331837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:37:18.331837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:37:18.332962 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:37:18.332962 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:37:18.332962 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:37:18.332962 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:37:18.332962 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:37:18.332962 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:37:18.332962 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:37:18.332962 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:37:18.332962 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:37:18.332962 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:37:18.332962 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:37:18.332962 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:37:18.332962 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:37:18.332962 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:37:18.332962 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:37:18.332962 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:37:18.332962 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:37:18.332962 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:37:18.334221 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:37:18.334221 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:37:18.334221 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:37:18.334221 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:37:18.334221 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:37:18.334221 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:37:18.334221 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:37:18.334221 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:37:18.334221 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 15:37:18.334221 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:37:18.335790 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 538/1091] 10.222.0.39 () {56 vars in 1093 bytes} [Mon May 23 15:37:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:37:18.338945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d2106-3747-4663-a5a4-83c28a5eea81 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:18.364220 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:18.438115 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d2106-3747-4663-a5a4-83c28a5eea81 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:18.471356 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2fab9-c156-459d-8320-d4122dac387d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:18.471983 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2fab9-c156-459d-8320-d4122dac387d None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:18.472268 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2fab9-c156-459d-8320-d4122dac387d None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:18.472550 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2fab9-c156-459d-8320-d4122dac387d None admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:18.473380 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce2fab9-c156-459d-8320-d4122dac387d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:18.473691 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce2fab9-c156-459d-8320-d4122dac387d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:18.475105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce2fab9-c156-459d-8320-d4122dac387d None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:18.493143 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 554/1092] 10.222.0.39 () {56 vars in 1133 bytes} [Mon May 23 15:37:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:18.498820 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd6e25-aead-43f0-8f13-e732ba8c923e None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:18.581895 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:18.600616 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd6e25-aead-43f0-8f13-e732ba8c923e None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:18.635111 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152cb7c-54f5-4d5a-a13d-d36dd54eef67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:18.635793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152cb7c-54f5-4d5a-a13d-d36dd54eef67 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:18.636078 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152cb7c-54f5-4d5a-a13d-d36dd54eef67 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:18.636352 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152cb7c-54f5-4d5a-a13d-d36dd54eef67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:18.702910 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152cb7c-54f5-4d5a-a13d-d36dd54eef67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:18.704406 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152cb7c-54f5-4d5a-a13d-d36dd54eef67 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:18.783066 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:18.803581 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 539/1093] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:37:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 15:37:18.810071 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2fab9-c156-459d-8320-d4122dac387d None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:18.891414 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:18.909572 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2fab9-c156-459d-8320-d4122dac387d None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:18.943646 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2154df-6b02-4923-b736-86e969cb02cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:18.944440 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2154df-6b02-4923-b736-86e969cb02cc None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:18.944722 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2154df-6b02-4923-b736-86e969cb02cc None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:18.944997 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2154df-6b02-4923-b736-86e969cb02cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:18.954934 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2154df-6b02-4923-b736-86e969cb02cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:18.956396 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2154df-6b02-4923-b736-86e969cb02cc None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:18.974986 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-3f2154df-6b02-4923-b736-86e969cb02cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:37:18.974986 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:18.974986 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:37:18.974986 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:37:18.974986 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:37:18.974986 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:37:18.974986 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:37:18.974986 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:37:18.974986 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:37:18.974986 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:37:18.974986 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:37:18.974986 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:37:18.974986 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:37:18.974986 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:37:18.974986 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:37:18.976001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:37:18.976001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:37:18.976001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:37:18.976001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:37:18.976001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:37:18.976001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:37:18.976001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:37:18.976001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:37:18.976001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:37:18.976001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:37:18.976001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:37:18.976001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:37:18.976001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:37:18.976001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:37:18.976001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:37:18.976001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:37:18.976001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:37:18.977450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:37:18.977450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:37:18.977450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:37:18.977450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:18.977450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 555/1094] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:37:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:37:18.982797 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152cb7c-54f5-4d5a-a13d-d36dd54eef67 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:19.079471 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152cb7c-54f5-4d5a-a13d-d36dd54eef67 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:19.116061 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1b281-393d-4e7c-bcab-6ab40419457b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:19.116736 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1b281-393d-4e7c-bcab-6ab40419457b None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:19.117063 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1b281-393d-4e7c-bcab-6ab40419457b None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:19.117299 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1b281-393d-4e7c-bcab-6ab40419457b None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:19.118055 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1b281-393d-4e7c-bcab-6ab40419457b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:19.118355 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1b281-393d-4e7c-bcab-6ab40419457b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:19.119779 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1b281-393d-4e7c-bcab-6ab40419457b None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:19.132009 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 540/1095] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:19.138987 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2154df-6b02-4923-b736-86e969cb02cc None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:19.241891 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2154df-6b02-4923-b736-86e969cb02cc None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:19.277147 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143da003-694c-405a-ab0c-2b267e8be5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:19.277935 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143da003-694c-405a-ab0c-2b267e8be5e4 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:19.278224 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143da003-694c-405a-ab0c-2b267e8be5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:19.278501 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143da003-694c-405a-ab0c-2b267e8be5e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:19.280422 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:19.285133 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03087b5c-0e56-43f5-97be-931733919139 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:19.285418 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03087b5c-0e56-43f5-97be-931733919139 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:19.285694 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03087b5c-0e56-43f5-97be-931733919139 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:19.286072 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143da003-694c-405a-ab0c-2b267e8be5e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:19.287053 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 541/1096] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:37:19.287511 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143da003-694c-405a-ab0c-2b267e8be5e4 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:19.292697 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205a847-4252-4768-9c53-999956c83713 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:19.293034 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205a847-4252-4768-9c53-999956c83713 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:19.296524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205a847-4252-4768-9c53-999956c83713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:19.302298 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-143da003-694c-405a-ab0c-2b267e8be5e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:37:19.302298 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:19.302298 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:37:19.302298 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:37:19.302298 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:37:19.302298 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:37:19.302298 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:37:19.302298 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:37:19.302298 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:37:19.302298 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:37:19.302298 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:37:19.302298 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:37:19.302298 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:37:19.302298 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:37:19.302298 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:37:19.303351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:37:19.303351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:37:19.303351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:37:19.303351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:37:19.303351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:37:19.303351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:37:19.303351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:37:19.303351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:37:19.303351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:37:19.303351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:37:19.303351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:37:19.303351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:37:19.303351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:37:19.303351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:37:19.303351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:37:19.303351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:37:19.303351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:37:19.304371 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:37:19.304371 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:37:19.304371 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:37:19.304371 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:37:19.304371 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:37:19.304371 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:37:19.304371 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:37:19.304371 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:19.304371 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 556/1097] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:37:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:37:19.309886 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143da003-694c-405a-ab0c-2b267e8be5e4 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:19.311063 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-9205a847-4252-4768-9c53-999956c83713 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:19.312275 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-9205a847-4252-4768-9c53-999956c83713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:19.345125 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:19.377699 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 542/1098] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:37:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:37:19.401035 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205a847-4252-4768-9c53-999956c83713 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:19.410219 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143da003-694c-405a-ab0c-2b267e8be5e4 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:19.444486 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83acdf7-9b8c-43b6-b821-499da3786a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:19.445159 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83acdf7-9b8c-43b6-b821-499da3786a3b None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:19.445449 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83acdf7-9b8c-43b6-b821-499da3786a3b None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:19.445725 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83acdf7-9b8c-43b6-b821-499da3786a3b None admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:19.446502 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83acdf7-9b8c-43b6-b821-499da3786a3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:19.446813 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83acdf7-9b8c-43b6-b821-499da3786a3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:19.448266 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83acdf7-9b8c-43b6-b821-499da3786a3b None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:19.459488 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 557/1099] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:37:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:37:19.466177 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83acdf7-9b8c-43b6-b821-499da3786a3b None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:19.505160 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205a847-4252-4768-9c53-999956c83713 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:19.525508 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:19.539299 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c6046-76c8-4ec8-a372-20e01591474a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:19.541091 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c6046-76c8-4ec8-a372-20e01591474a None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:19.541091 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c6046-76c8-4ec8-a372-20e01591474a None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:19.541091 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c6046-76c8-4ec8-a372-20e01591474a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:19.551067 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c6046-76c8-4ec8-a372-20e01591474a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:37:19.560126 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-bd3c6046-76c8-4ec8-a372-20e01591474a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:37:19.560126 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:19.560126 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:37:19.560126 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:37:19.560126 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:37:19.560126 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:37:19.560126 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:37:19.560126 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:37:19.560126 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:37:19.560126 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:37:19.560126 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:37:19.560126 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:37:19.560126 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:37:19.560126 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:37:19.560126 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:37:19.560126 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:37:19.561167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:37:19.561167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:37:19.561167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:37:19.561167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:37:19.561167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:37:19.561167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:37:19.561167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:37:19.561167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:37:19.561167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:37:19.561167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:37:19.561167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:37:19.561167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:37:19.561167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:37:19.561167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:37:19.561167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:37:19.561167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:37:19.562074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:37:19.562074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:37:19.562074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:37:19.562074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:37:19.562074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:37:19.562074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:37:19.562074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:37:19.562074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:37:19.562074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:37:19.562074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:37:19.562074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:37:19.562074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:37:19.562074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 543/1100] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:37:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:37:19.567332 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c6046-76c8-4ec8-a372-20e01591474a None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:19.573599 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83acdf7-9b8c-43b6-b821-499da3786a3b None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:19.599189 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:19.607693 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de7d9b-57ba-436c-a658-faa2c0a8e6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:19.611040 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de7d9b-57ba-436c-a658-faa2c0a8e6bb None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:19.611040 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de7d9b-57ba-436c-a658-faa2c0a8e6bb None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:19.611040 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de7d9b-57ba-436c-a658-faa2c0a8e6bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:19.611040 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de7d9b-57ba-436c-a658-faa2c0a8e6bb None admin] RBAC: Adding query filter params (role.id=c5b2044766b04373a9900a04296f71c3, scope.project.id=8addb03b903842609168ee2fafc8ec6b, user.id=76f7895b7b5748e7b4461f7fde1d558a) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:19.611040 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de7d9b-57ba-436c-a658-faa2c0a8e6bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:19.611504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de7d9b-57ba-436c-a658-faa2c0a8e6bb None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:19.618106 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 558/1101] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:37:19 2022] GET /identity/v3/role_assignments?user.id=76f7895b7b5748e7b4461f7fde1d558a&scope.project.id=8addb03b903842609168ee2fafc8ec6b&role.id=c5b2044766b04373a9900a04296f71c3 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:37:19.674237 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c6046-76c8-4ec8-a372-20e01591474a None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:19.710979 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ceb7b-8ba8-4656-bf60-e054f47b32fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:19.711689 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ceb7b-8ba8-4656-bf60-e054f47b32fd None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:19.711973 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ceb7b-8ba8-4656-bf60-e054f47b32fd None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:19.712245 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ceb7b-8ba8-4656-bf60-e054f47b32fd None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:19.712999 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ceb7b-8ba8-4656-bf60-e054f47b32fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:19.713306 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ceb7b-8ba8-4656-bf60-e054f47b32fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:19.714701 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ceb7b-8ba8-4656-bf60-e054f47b32fd None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:19.723836 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 544/1102] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:37:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:37:19.730007 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de7d9b-57ba-436c-a658-faa2c0a8e6bb None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:19.834073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de7d9b-57ba-436c-a658-faa2c0a8e6bb None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:19.853017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:19.871723 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bb422-fa76-4806-ac56-616075c16f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:19.872601 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bb422-fa76-4806-ac56-616075c16f36 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:19.872881 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bb422-fa76-4806-ac56-616075c16f36 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:19.873156 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bb422-fa76-4806-ac56-616075c16f36 None admin] PATH_INFO: `/v3/users/fa63f1c2708646c385f6743084f6d2ba` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:19.874344 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7bb422-fa76-4806-ac56-616075c16f36 None admin] RBAC: Authorizing `identity:get_user(user_id=fa63f1c2708646c385f6743084f6d2ba)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:19.875810 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7bb422-fa76-4806-ac56-616075c16f36 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:19.877479 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 559/1103] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:37:19 2022] GET /identity/v3/users/fa63f1c2708646c385f6743084f6d2ba => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:37:19.883860 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ceb7b-8ba8-4656-bf60-e054f47b32fd None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:19.980996 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:19.989583 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ceb7b-8ba8-4656-bf60-e054f47b32fd None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:20.024318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69a19a-d348-479f-a0b8-430d44b405bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:20.024958 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69a19a-d348-479f-a0b8-430d44b405bf None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:20.025239 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69a19a-d348-479f-a0b8-430d44b405bf None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:20.025513 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69a19a-d348-479f-a0b8-430d44b405bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:20.092243 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69a19a-d348-479f-a0b8-430d44b405bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:20.093693 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69a19a-d348-479f-a0b8-430d44b405bf None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:20.184952 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:20.195965 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 545/1104] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:37:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:37:20.201080 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bb422-fa76-4806-ac56-616075c16f36 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:20.306495 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bb422-fa76-4806-ac56-616075c16f36 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:20.341297 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6a1d3-ae0a-4693-bff7-dd49034f3798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:20.342156 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6a1d3-ae0a-4693-bff7-dd49034f3798 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:20.342440 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6a1d3-ae0a-4693-bff7-dd49034f3798 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:20.342719 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6a1d3-ae0a-4693-bff7-dd49034f3798 None admin] PATH_INFO: `/v3/projects/41d3294cf56b45438b9a74a9cb52bfeb` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:20.344178 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6a1d3-ae0a-4693-bff7-dd49034f3798 None admin] RBAC: Authorizing `identity:get_project(project_id=41d3294cf56b45438b9a74a9cb52bfeb)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:20.345640 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6a1d3-ae0a-4693-bff7-dd49034f3798 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:20.347385 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 560/1105] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:37:20 2022] GET /identity/v3/projects/41d3294cf56b45438b9a74a9cb52bfeb => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:20.353653 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69a19a-d348-479f-a0b8-430d44b405bf None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:20.458128 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69a19a-d348-479f-a0b8-430d44b405bf None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:20.494643 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037e415-0907-41ee-90b8-f24a8ae67592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:20.495289 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037e415-0907-41ee-90b8-f24a8ae67592 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:20.495569 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037e415-0907-41ee-90b8-f24a8ae67592 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:20.495868 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037e415-0907-41ee-90b8-f24a8ae67592 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:20.496684 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037e415-0907-41ee-90b8-f24a8ae67592 None admin] RBAC: Adding query filter params (role.id=3ab888f5f68740bd8f9df4447f4f5a7a, scope.project.id=41d3294cf56b45438b9a74a9cb52bfeb, user.id=fa63f1c2708646c385f6743084f6d2ba) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:20.496989 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037e415-0907-41ee-90b8-f24a8ae67592 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:20.498415 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037e415-0907-41ee-90b8-f24a8ae67592 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:20.504326 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 546/1106] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:37:20 2022] GET /identity/v3/role_assignments?user.id=fa63f1c2708646c385f6743084f6d2ba&scope.project.id=41d3294cf56b45438b9a74a9cb52bfeb&role.id=3ab888f5f68740bd8f9df4447f4f5a7a => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:22.709245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fa642-3e70-448a-8ae8-8b046013e050 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:22.709843 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fa642-3e70-448a-8ae8-8b046013e050 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:22.710121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fa642-3e70-448a-8ae8-8b046013e050 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:22.712475 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 561/1107] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:37:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:22.717595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b442153-5365-478c-b3ce-ea6106ff0e4e None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:22.718035 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b442153-5365-478c-b3ce-ea6106ff0e4e None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:22.718135 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b442153-5365-478c-b3ce-ea6106ff0e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:22.735495 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-3b442153-5365-478c-b3ce-ea6106ff0e4e None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:22.736728 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-3b442153-5365-478c-b3ce-ea6106ff0e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:22.784816 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:22.800981 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 547/1108] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:37:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:37:22.826422 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4fa642-3e70-448a-8ae8-8b046013e050 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:22.883550 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:22.929056 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4fa642-3e70-448a-8ae8-8b046013e050 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:22.962400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19375f-a641-4d19-a724-b33c7d9f2d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:22.963129 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19375f-a641-4d19-a724-b33c7d9f2d3c None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:22.963416 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19375f-a641-4d19-a724-b33c7d9f2d3c None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:22.963731 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19375f-a641-4d19-a724-b33c7d9f2d3c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:22.964906 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19375f-a641-4d19-a724-b33c7d9f2d3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:22.966338 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19375f-a641-4d19-a724-b33c7d9f2d3c None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:22.967980 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 562/1109] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:37:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:22.973819 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b442153-5365-478c-b3ce-ea6106ff0e4e None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:23.071150 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b442153-5365-478c-b3ce-ea6106ff0e4e None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:23.104340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2f5b5-9798-4adf-ab35-8852163e453b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:23.104992 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2f5b5-9798-4adf-ab35-8852163e453b None admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:23.105527 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2f5b5-9798-4adf-ab35-8852163e453b None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:23.105799 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2f5b5-9798-4adf-ab35-8852163e453b None admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:23.106505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2f5b5-9798-4adf-ab35-8852163e453b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:23.107969 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2f5b5-9798-4adf-ab35-8852163e453b None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:23.181096 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 548/1110] 10.222.0.39 () {60 vars in 1132 bytes} [Mon May 23 15:37:22 2022] POST /identity/v3/users => generated 286 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:37:25.406497 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bce5c-2abe-4804-9857-2a3eee0d685c None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:25.407036 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bce5c-2abe-4804-9857-2a3eee0d685c None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:25.407036 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bce5c-2abe-4804-9857-2a3eee0d685c None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:25.408455 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 563/1111] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:25.413762 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9dac3-b8f9-4be1-bef1-9d15fd4ba42c None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:25.414136 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9dac3-b8f9-4be1-bef1-9d15fd4ba42c None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:25.414322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9dac3-b8f9-4be1-bef1-9d15fd4ba42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:25.431084 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-7ea9dac3-b8f9-4be1-bef1-9d15fd4ba42c None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:25.432299 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-7ea9dac3-b8f9-4be1-bef1-9d15fd4ba42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:25.466419 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:25.496702 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 549/1112] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:37:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:37:25.520390 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bce5c-2abe-4804-9857-2a3eee0d685c None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:25.619957 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bce5c-2abe-4804-9857-2a3eee0d685c None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:25.642428 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:25.653660 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717bfe9-c13b-468b-82dc-d3ea791a3ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:25.654495 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717bfe9-c13b-468b-82dc-d3ea791a3ab5 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:25.654776 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717bfe9-c13b-468b-82dc-d3ea791a3ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:25.655048 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717bfe9-c13b-468b-82dc-d3ea791a3ab5 None admin] PATH_INFO: `/v3/roles/a487e8d6e71d4a399b050274528d8db7` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:25.656572 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717bfe9-c13b-468b-82dc-d3ea791a3ab5 None admin] RBAC: Authorizing `identity:get_role(role_id=a487e8d6e71d4a399b050274528d8db7)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:25.657929 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717bfe9-c13b-468b-82dc-d3ea791a3ab5 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:25.659277 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 564/1113] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:37:25 2022] GET /identity/v3/roles/a487e8d6e71d4a399b050274528d8db7 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:25.665059 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9dac3-b8f9-4be1-bef1-9d15fd4ba42c None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:25.761447 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9dac3-b8f9-4be1-bef1-9d15fd4ba42c None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:25.793786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6f7e4-a08b-4c92-84cc-4ee40d251d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:25.794642 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6f7e4-a08b-4c92-84cc-4ee40d251d56 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:25.794921 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6f7e4-a08b-4c92-84cc-4ee40d251d56 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:25.795194 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6f7e4-a08b-4c92-84cc-4ee40d251d56 None admin] PATH_INFO: `/v3/users/d9dc5ae376b2439ba820166e5a73e5bf` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:25.809145 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6f7e4-a08b-4c92-84cc-4ee40d251d56 None admin] RBAC: Authorizing `identity:get_user(user_id=d9dc5ae376b2439ba820166e5a73e5bf)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:25.810581 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6f7e4-a08b-4c92-84cc-4ee40d251d56 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:25.812248 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 550/1114] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:37:25 2022] GET /identity/v3/users/d9dc5ae376b2439ba820166e5a73e5bf => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:25.817959 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717bfe9-c13b-468b-82dc-d3ea791a3ab5 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:25.917612 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717bfe9-c13b-468b-82dc-d3ea791a3ab5 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:25.951103 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9c605-e6dd-43c5-ae9a-5cb79694c96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:25.951780 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9c605-e6dd-43c5-ae9a-5cb79694c96f None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:25.952067 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9c605-e6dd-43c5-ae9a-5cb79694c96f None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:25.952346 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9c605-e6dd-43c5-ae9a-5cb79694c96f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:26.008231 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:26.025424 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9c605-e6dd-43c5-ae9a-5cb79694c96f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:26.025424 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9c605-e6dd-43c5-ae9a-5cb79694c96f None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:26.115118 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 565/1115] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:37:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:37:26.121839 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6f7e4-a08b-4c92-84cc-4ee40d251d56 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:26.152413 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:26.221766 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6f7e4-a08b-4c92-84cc-4ee40d251d56 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:26.255242 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31949b4-8436-4646-ab93-bbfdca75ccf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:26.256114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31949b4-8436-4646-ab93-bbfdca75ccf9 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:26.256396 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31949b4-8436-4646-ab93-bbfdca75ccf9 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:26.256669 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31949b4-8436-4646-ab93-bbfdca75ccf9 None admin] PATH_INFO: `/v3/projects/41d3294cf56b45438b9a74a9cb52bfeb` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:26.258256 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31949b4-8436-4646-ab93-bbfdca75ccf9 None admin] RBAC: Authorizing `identity:get_project(project_id=41d3294cf56b45438b9a74a9cb52bfeb)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:26.259714 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31949b4-8436-4646-ab93-bbfdca75ccf9 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:26.261401 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 551/1116] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:37:26 2022] GET /identity/v3/projects/41d3294cf56b45438b9a74a9cb52bfeb => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:26.267455 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9c605-e6dd-43c5-ae9a-5cb79694c96f None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:26.356451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:26.365573 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9c605-e6dd-43c5-ae9a-5cb79694c96f None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:26.398690 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e4768-2d83-4c5b-b415-6db5315b73dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:26.399400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e4768-2d83-4c5b-b415-6db5315b73dd None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:26.399710 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e4768-2d83-4c5b-b415-6db5315b73dd None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:26.399988 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e4768-2d83-4c5b-b415-6db5315b73dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:26.400798 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e4768-2d83-4c5b-b415-6db5315b73dd None admin] RBAC: Adding query filter params (role.id=a487e8d6e71d4a399b050274528d8db7, scope.project.id=41d3294cf56b45438b9a74a9cb52bfeb, user.id=d9dc5ae376b2439ba820166e5a73e5bf) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:26.401105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e4768-2d83-4c5b-b415-6db5315b73dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:26.402512 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e4768-2d83-4c5b-b415-6db5315b73dd None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:26.407765 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 566/1117] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:37:26 2022] GET /identity/v3/role_assignments?user.id=d9dc5ae376b2439ba820166e5a73e5bf&scope.project.id=41d3294cf56b45438b9a74a9cb52bfeb&role.id=a487e8d6e71d4a399b050274528d8db7 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:28.588707 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd162fa-b65d-44c5-a7ca-4a7d635c9380 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:28.589228 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd162fa-b65d-44c5-a7ca-4a7d635c9380 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:28.589320 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd162fa-b65d-44c5-a7ca-4a7d635c9380 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:28.590628 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 552/1118] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:28.595790 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbcf1d-8bb8-47d0-b428-05f1438824de None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:28.596181 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbcf1d-8bb8-47d0-b428-05f1438824de None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:28.596351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbcf1d-8bb8-47d0-b428-05f1438824de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:28.614260 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-cccbcf1d-8bb8-47d0-b428-05f1438824de None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:28.615425 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-cccbcf1d-8bb8-47d0-b428-05f1438824de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:28.683766 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 567/1119] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:37:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:37:28.706563 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd162fa-b65d-44c5-a7ca-4a7d635c9380 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:28.804852 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:28.809374 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd162fa-b65d-44c5-a7ca-4a7d635c9380 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:28.842744 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e18d8-6401-4a87-9f47-68d5480e6bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:28.843756 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e18d8-6401-4a87-9f47-68d5480e6bb8 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:28.844221 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e18d8-6401-4a87-9f47-68d5480e6bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:28.844824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e18d8-6401-4a87-9f47-68d5480e6bb8 None admin] PATH_INFO: `/v3/roles/a487e8d6e71d4a399b050274528d8db7` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:28.846286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e18d8-6401-4a87-9f47-68d5480e6bb8 None admin] RBAC: Authorizing `identity:get_role(role_id=a487e8d6e71d4a399b050274528d8db7)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:28.847696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e18d8-6401-4a87-9f47-68d5480e6bb8 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:28.849119 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 553/1120] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:37:28 2022] GET /identity/v3/roles/a487e8d6e71d4a399b050274528d8db7 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:28.855683 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbcf1d-8bb8-47d0-b428-05f1438824de None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:28.938773 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:28.954618 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbcf1d-8bb8-47d0-b428-05f1438824de None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:28.988446 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afe000-30fd-44f8-9312-4595f93b7b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:28.989314 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afe000-30fd-44f8-9312-4595f93b7b77 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:28.989598 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afe000-30fd-44f8-9312-4595f93b7b77 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:28.989874 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afe000-30fd-44f8-9312-4595f93b7b77 None admin] PATH_INFO: `/v3/users/d9dc5ae376b2439ba820166e5a73e5bf` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:28.991063 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35afe000-30fd-44f8-9312-4595f93b7b77 None admin] RBAC: Authorizing `identity:get_user(user_id=d9dc5ae376b2439ba820166e5a73e5bf)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:28.992774 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35afe000-30fd-44f8-9312-4595f93b7b77 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:28.994420 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 568/1121] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:37:28 2022] GET /identity/v3/users/d9dc5ae376b2439ba820166e5a73e5bf => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:29.000198 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e18d8-6401-4a87-9f47-68d5480e6bb8 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:29.097597 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e18d8-6401-4a87-9f47-68d5480e6bb8 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:29.129737 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61511107-be5b-4462-a1ad-4f1511acf544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:29.130579 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61511107-be5b-4462-a1ad-4f1511acf544 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:29.130862 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61511107-be5b-4462-a1ad-4f1511acf544 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:29.131134 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61511107-be5b-4462-a1ad-4f1511acf544 None admin] PATH_INFO: `/v3/projects/41d3294cf56b45438b9a74a9cb52bfeb` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:29.133121 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61511107-be5b-4462-a1ad-4f1511acf544 None admin] RBAC: Authorizing `identity:get_project(project_id=41d3294cf56b45438b9a74a9cb52bfeb)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:29.134558 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61511107-be5b-4462-a1ad-4f1511acf544 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:29.136264 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 554/1122] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:37:28 2022] GET /identity/v3/projects/41d3294cf56b45438b9a74a9cb52bfeb => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:29.142092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afe000-30fd-44f8-9312-4595f93b7b77 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:29.238881 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afe000-30fd-44f8-9312-4595f93b7b77 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:29.272491 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7366b96-b6df-4e62-ad7c-ceb972747842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:29.273535 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7366b96-b6df-4e62-ad7c-ceb972747842 None admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:29.273820 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7366b96-b6df-4e62-ad7c-ceb972747842 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:29.274095 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7366b96-b6df-4e62-ad7c-ceb972747842 None admin] PATH_INFO: `/v3/projects/41d3294cf56b45438b9a74a9cb52bfeb/users/d9dc5ae376b2439ba820166e5a73e5bf/roles/a487e8d6e71d4a399b050274528d8db7` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:29.276312 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7366b96-b6df-4e62-ad7c-ceb972747842 None admin] RBAC: Authorizing `identity:create_grant(project_id=41d3294cf56b45438b9a74a9cb52bfeb, user_id=d9dc5ae376b2439ba820166e5a73e5bf, role_id=a487e8d6e71d4a399b050274528d8db7)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:29.277740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7366b96-b6df-4e62-ad7c-ceb972747842 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:29.345941 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 569/1123] 10.222.0.39 () {58 vars in 1439 bytes} [Mon May 23 15:37:29 2022] PUT /identity/v3/projects/41d3294cf56b45438b9a74a9cb52bfeb/users/d9dc5ae376b2439ba820166e5a73e5bf/roles/a487e8d6e71d4a399b050274528d8db7 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:37:31.506889 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492ddd7-0aa6-4e16-9b96-210a2fef7788 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:31.507434 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492ddd7-0aa6-4e16-9b96-210a2fef7788 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:31.507434 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492ddd7-0aa6-4e16-9b96-210a2fef7788 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:31.508845 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 555/1124] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:31.514116 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd751b26-42b0-44b8-bef1-de8700f4adac None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:31.514484 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd751b26-42b0-44b8-bef1-de8700f4adac None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:31.514686 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd751b26-42b0-44b8-bef1-de8700f4adac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:31.532461 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-cd751b26-42b0-44b8-bef1-de8700f4adac None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:31.533641 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-cd751b26-42b0-44b8-bef1-de8700f4adac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:31.541884 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:31.600516 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 570/1125] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:37:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:37:31.625761 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492ddd7-0aa6-4e16-9b96-210a2fef7788 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:31.661559 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:31.725753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492ddd7-0aa6-4e16-9b96-210a2fef7788 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:31.759347 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451d2ef-641f-4f16-b4e3-2b9bb5ff13bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:31.760162 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451d2ef-641f-4f16-b4e3-2b9bb5ff13bd None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:31.760447 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451d2ef-641f-4f16-b4e3-2b9bb5ff13bd None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:31.760722 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451d2ef-641f-4f16-b4e3-2b9bb5ff13bd None admin] PATH_INFO: `/v3/roles/a487e8d6e71d4a399b050274528d8db7` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:31.762172 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451d2ef-641f-4f16-b4e3-2b9bb5ff13bd None admin] RBAC: Authorizing `identity:get_role(role_id=a487e8d6e71d4a399b050274528d8db7)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:31.763545 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451d2ef-641f-4f16-b4e3-2b9bb5ff13bd None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:31.764921 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 556/1126] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:37:31 2022] GET /identity/v3/roles/a487e8d6e71d4a399b050274528d8db7 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:31.770709 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd751b26-42b0-44b8-bef1-de8700f4adac None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:31.868622 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd751b26-42b0-44b8-bef1-de8700f4adac None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:31.901234 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36eeb64-08c0-4522-a62a-4c96718ef90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:31.902092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36eeb64-08c0-4522-a62a-4c96718ef90c None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:31.902374 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36eeb64-08c0-4522-a62a-4c96718ef90c None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:31.902651 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36eeb64-08c0-4522-a62a-4c96718ef90c None admin] PATH_INFO: `/v3/users/d9dc5ae376b2439ba820166e5a73e5bf` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:31.903852 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36eeb64-08c0-4522-a62a-4c96718ef90c None admin] RBAC: Authorizing `identity:get_user(user_id=d9dc5ae376b2439ba820166e5a73e5bf)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:31.905269 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36eeb64-08c0-4522-a62a-4c96718ef90c None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:31.906864 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 571/1127] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:37:31 2022] GET /identity/v3/users/d9dc5ae376b2439ba820166e5a73e5bf => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:31.912452 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451d2ef-641f-4f16-b4e3-2b9bb5ff13bd None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:32.008235 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451d2ef-641f-4f16-b4e3-2b9bb5ff13bd None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:32.009762 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:32.040817 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b114e36-c3b1-4455-a81b-70e19fff21c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:32.041452 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b114e36-c3b1-4455-a81b-70e19fff21c5 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:32.041737 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b114e36-c3b1-4455-a81b-70e19fff21c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:32.042014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b114e36-c3b1-4455-a81b-70e19fff21c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:32.108136 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b114e36-c3b1-4455-a81b-70e19fff21c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:32.109585 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b114e36-c3b1-4455-a81b-70e19fff21c5 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:32.204244 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 557/1128] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:37:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:37:32.210009 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36eeb64-08c0-4522-a62a-4c96718ef90c None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:32.222623 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:32.308101 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36eeb64-08c0-4522-a62a-4c96718ef90c None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:32.340677 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd27e8e-faba-4b92-bf36-1beaad29167b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:32.341512 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd27e8e-faba-4b92-bf36-1beaad29167b None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:32.341791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd27e8e-faba-4b92-bf36-1beaad29167b None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:32.342064 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd27e8e-faba-4b92-bf36-1beaad29167b None admin] PATH_INFO: `/v3/projects/41d3294cf56b45438b9a74a9cb52bfeb` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:32.343217 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd27e8e-faba-4b92-bf36-1beaad29167b None admin] RBAC: Authorizing `identity:get_project(project_id=41d3294cf56b45438b9a74a9cb52bfeb)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:32.344668 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd27e8e-faba-4b92-bf36-1beaad29167b None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:32.346340 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 572/1129] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:37:32 2022] GET /identity/v3/projects/41d3294cf56b45438b9a74a9cb52bfeb => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:32.353228 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b114e36-c3b1-4455-a81b-70e19fff21c5 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:32.355637 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:32.448308 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b114e36-c3b1-4455-a81b-70e19fff21c5 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:32.482005 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048d1e3-5801-4fb4-ba47-36486a413e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:32.482638 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048d1e3-5801-4fb4-ba47-36486a413e1c None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:32.482921 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048d1e3-5801-4fb4-ba47-36486a413e1c None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:32.483197 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048d1e3-5801-4fb4-ba47-36486a413e1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:32.484049 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6048d1e3-5801-4fb4-ba47-36486a413e1c None admin] RBAC: Adding query filter params (role.id=a487e8d6e71d4a399b050274528d8db7, scope.project.id=41d3294cf56b45438b9a74a9cb52bfeb, user.id=d9dc5ae376b2439ba820166e5a73e5bf) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:32.484361 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6048d1e3-5801-4fb4-ba47-36486a413e1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:32.485782 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6048d1e3-5801-4fb4-ba47-36486a413e1c None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:32.491806 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 558/1130] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:37:32 2022] GET /identity/v3/role_assignments?user.id=d9dc5ae376b2439ba820166e5a73e5bf&scope.project.id=41d3294cf56b45438b9a74a9cb52bfeb&role.id=a487e8d6e71d4a399b050274528d8db7 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:34.676989 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4b508-24df-42c1-82b8-7d5af46fca32 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:34.677513 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4b508-24df-42c1-82b8-7d5af46fca32 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:34.677634 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4b508-24df-42c1-82b8-7d5af46fca32 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:34.678977 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 573/1131] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:34.684654 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33615e-0da3-42a8-ab9a-9dc0b18740ac None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:34.685034 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33615e-0da3-42a8-ab9a-9dc0b18740ac None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:34.685206 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33615e-0da3-42a8-ab9a-9dc0b18740ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:34.701525 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-9d33615e-0da3-42a8-ab9a-9dc0b18740ac None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:34.702690 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-9d33615e-0da3-42a8-ab9a-9dc0b18740ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:34.759919 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:34.767031 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 559/1132] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:37:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:37:34.791758 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4b508-24df-42c1-82b8-7d5af46fca32 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:34.872722 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:34.893822 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4b508-24df-42c1-82b8-7d5af46fca32 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:34.927893 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b46b3d-ccfe-41d0-997b-7fccad36b737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:34.928612 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b46b3d-ccfe-41d0-997b-7fccad36b737 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:34.929278 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b46b3d-ccfe-41d0-997b-7fccad36b737 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:34.929278 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b46b3d-ccfe-41d0-997b-7fccad36b737 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:34.930460 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b46b3d-ccfe-41d0-997b-7fccad36b737 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:34.931909 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b46b3d-ccfe-41d0-997b-7fccad36b737 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:34.933505 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 574/1133] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:37:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:34.939193 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33615e-0da3-42a8-ab9a-9dc0b18740ac None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:35.035092 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33615e-0da3-42a8-ab9a-9dc0b18740ac None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:35.067759 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac0994-2e47-464b-996e-9b611a23156b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:35.068396 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac0994-2e47-464b-996e-9b611a23156b None admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:35.068678 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac0994-2e47-464b-996e-9b611a23156b None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:35.068951 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac0994-2e47-464b-996e-9b611a23156b None admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:35.069713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac0994-2e47-464b-996e-9b611a23156b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:35.071133 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac0994-2e47-464b-996e-9b611a23156b None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:35.181695 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 560/1134] 10.222.0.39 () {60 vars in 1141 bytes} [Mon May 23 15:37:34 2022] POST /identity/v3/projects => generated 311 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:37:37.467469 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c7118-db8f-4936-9f13-3c6746cfbee3 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:37.468032 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c7118-db8f-4936-9f13-3c6746cfbee3 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:37.468136 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c7118-db8f-4936-9f13-3c6746cfbee3 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:37.469477 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 575/1135] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:37.474732 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378dd969-ed03-4f8b-b5b4-f52b557045ba None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:37.475136 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378dd969-ed03-4f8b-b5b4-f52b557045ba None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:37.475291 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378dd969-ed03-4f8b-b5b4-f52b557045ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:37.492962 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-378dd969-ed03-4f8b-b5b4-f52b557045ba None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:37.494122 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-378dd969-ed03-4f8b-b5b4-f52b557045ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:37.536048 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:37.557804 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 561/1136] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:37:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:37:37.582985 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c7118-db8f-4936-9f13-3c6746cfbee3 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:37.685308 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c7118-db8f-4936-9f13-3c6746cfbee3 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:37.720185 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f94fe6-1dd1-4137-9428-98cf302dc17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:37.720903 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f94fe6-1dd1-4137-9428-98cf302dc17d None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:37.721188 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f94fe6-1dd1-4137-9428-98cf302dc17d None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:37.721467 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f94fe6-1dd1-4137-9428-98cf302dc17d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:37.722640 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f94fe6-1dd1-4137-9428-98cf302dc17d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:37.724116 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f94fe6-1dd1-4137-9428-98cf302dc17d None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:37.726689 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 576/1137] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:37:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:37.732580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378dd969-ed03-4f8b-b5b4-f52b557045ba None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:37.827794 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378dd969-ed03-4f8b-b5b4-f52b557045ba None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:37.863356 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85315d3e-1586-4b67-8c13-22a17192b3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:37.864066 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85315d3e-1586-4b67-8c13-22a17192b3db None admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:37.864346 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85315d3e-1586-4b67-8c13-22a17192b3db None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:37.864619 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85315d3e-1586-4b67-8c13-22a17192b3db None admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:37.865692 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85315d3e-1586-4b67-8c13-22a17192b3db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:37.867504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85315d3e-1586-4b67-8c13-22a17192b3db None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:37.951247 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 562/1138] 10.222.0.39 () {60 vars in 1132 bytes} [Mon May 23 15:37:37 2022] POST /identity/v3/users => generated 286 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:37:40.161068 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ad9d9-bf8e-4a94-877a-6fc894923600 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:40.161621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ad9d9-bf8e-4a94-877a-6fc894923600 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:40.161621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ad9d9-bf8e-4a94-877a-6fc894923600 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:40.162988 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 577/1139] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:40.169293 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94e2d5-6103-43d1-b752-e8aff293a3a7 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:40.169694 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94e2d5-6103-43d1-b752-e8aff293a3a7 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:40.172094 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94e2d5-6103-43d1-b752-e8aff293a3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:40.187182 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-bf94e2d5-6103-43d1-b752-e8aff293a3a7 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:40.188396 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-bf94e2d5-6103-43d1-b752-e8aff293a3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:40.214867 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:40.254300 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 563/1140] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:37:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:37:40.277734 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ad9d9-bf8e-4a94-877a-6fc894923600 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:40.293181 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:40.376751 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ad9d9-bf8e-4a94-877a-6fc894923600 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:40.409354 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89abbaf-0244-4943-9dec-99e3d3bff27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:40.410125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89abbaf-0244-4943-9dec-99e3d3bff27e None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:40.410405 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89abbaf-0244-4943-9dec-99e3d3bff27e None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:40.410678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89abbaf-0244-4943-9dec-99e3d3bff27e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:40.420531 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89abbaf-0244-4943-9dec-99e3d3bff27e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:37:40.427995 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-f89abbaf-0244-4943-9dec-99e3d3bff27e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:37:40.427995 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:40.427995 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:37:40.427995 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:37:40.427995 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:37:40.427995 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:37:40.427995 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:37:40.427995 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:37:40.427995 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:37:40.427995 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:37:40.427995 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:37:40.427995 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:37:40.427995 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:37:40.427995 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:37:40.427995 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:37:40.427995 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:37:40.429115 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:37:40.429115 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:37:40.429115 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:37:40.429115 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:37:40.429115 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:37:40.429115 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:37:40.429115 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:37:40.429115 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:37:40.429115 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:37:40.429115 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:37:40.429115 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:37:40.429115 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:37:40.429115 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:37:40.429115 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:37:40.429115 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:37:40.429115 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:37:40.430782 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:37:40.430782 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:37:40.430782 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:37:40.430782 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:37:40.430782 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:37:40.430782 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:37:40.430782 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:37:40.430782 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:37:40.430782 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:37:40.430782 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:37:40.430782 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:37:40.430782 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:40.430782 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 578/1141] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:37:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:37:40.435672 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94e2d5-6103-43d1-b752-e8aff293a3a7 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:40.531154 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94e2d5-6103-43d1-b752-e8aff293a3a7 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:40.564497 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209f079-c440-4ff7-b7e8-83e9aa1744a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:40.565147 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209f079-c440-4ff7-b7e8-83e9aa1744a6 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:40.565429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209f079-c440-4ff7-b7e8-83e9aa1744a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:40.565703 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209f079-c440-4ff7-b7e8-83e9aa1744a6 None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:40.566437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3209f079-c440-4ff7-b7e8-83e9aa1744a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:40.566742 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3209f079-c440-4ff7-b7e8-83e9aa1744a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:40.568144 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3209f079-c440-4ff7-b7e8-83e9aa1744a6 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:40.575961 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 564/1142] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:37:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:40.581691 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89abbaf-0244-4943-9dec-99e3d3bff27e None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:40.657455 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:40.683161 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89abbaf-0244-4943-9dec-99e3d3bff27e None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:40.716734 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c0b47-2e66-48b6-b66d-f384d0630043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:40.717597 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c0b47-2e66-48b6-b66d-f384d0630043 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:40.717881 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c0b47-2e66-48b6-b66d-f384d0630043 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:40.718159 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c0b47-2e66-48b6-b66d-f384d0630043 None admin] PATH_INFO: `/v3/users/a31921dd177d47b4abce5bba4e3389da` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:40.732249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c0b47-2e66-48b6-b66d-f384d0630043 None admin] RBAC: Authorizing `identity:get_user(user_id=a31921dd177d47b4abce5bba4e3389da)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:40.733682 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c0b47-2e66-48b6-b66d-f384d0630043 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:40.735313 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 579/1143] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:37:40 2022] GET /identity/v3/users/a31921dd177d47b4abce5bba4e3389da => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:40.741063 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209f079-c440-4ff7-b7e8-83e9aa1744a6 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:40.768415 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:40.838761 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209f079-c440-4ff7-b7e8-83e9aa1744a6 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:40.871204 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d47664-d165-4aeb-8db9-da16ebde4243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:40.871855 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d47664-d165-4aeb-8db9-da16ebde4243 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:40.872142 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d47664-d165-4aeb-8db9-da16ebde4243 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:40.872421 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d47664-d165-4aeb-8db9-da16ebde4243 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:40.936449 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d47664-d165-4aeb-8db9-da16ebde4243 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:40.937829 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d47664-d165-4aeb-8db9-da16ebde4243 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:40.963088 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:41.032898 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 565/1144] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:37:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:37:41.038765 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c0b47-2e66-48b6-b66d-f384d0630043 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:41.135571 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c0b47-2e66-48b6-b66d-f384d0630043 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:41.163558 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:41.168299 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae37b12-a092-473b-9be6-f9c6013df9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:41.169147 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae37b12-a092-473b-9be6-f9c6013df9cf None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:41.169428 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae37b12-a092-473b-9be6-f9c6013df9cf None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:41.169769 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae37b12-a092-473b-9be6-f9c6013df9cf None admin] PATH_INFO: `/v3/projects/befee23fb0c642d1930a562bfec0d7de` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:41.171585 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae37b12-a092-473b-9be6-f9c6013df9cf None admin] RBAC: Authorizing `identity:get_project(project_id=befee23fb0c642d1930a562bfec0d7de)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:41.173408 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae37b12-a092-473b-9be6-f9c6013df9cf None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:41.175247 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 580/1145] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:37:41 2022] GET /identity/v3/projects/befee23fb0c642d1930a562bfec0d7de => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:41.182025 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d47664-d165-4aeb-8db9-da16ebde4243 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:41.279462 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d47664-d165-4aeb-8db9-da16ebde4243 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:41.304243 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:41.313483 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ea3ee-1d69-46ba-ba24-485078a48183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:41.314475 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ea3ee-1d69-46ba-ba24-485078a48183 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:41.314475 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ea3ee-1d69-46ba-ba24-485078a48183 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:41.314656 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ea3ee-1d69-46ba-ba24-485078a48183 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:41.315453 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ea3ee-1d69-46ba-ba24-485078a48183 None admin] RBAC: Adding query filter params (role.id=3ab888f5f68740bd8f9df4447f4f5a7a, scope.project.id=befee23fb0c642d1930a562bfec0d7de, user.id=a31921dd177d47b4abce5bba4e3389da) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:41.315793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ea3ee-1d69-46ba-ba24-485078a48183 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:41.317218 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ea3ee-1d69-46ba-ba24-485078a48183 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:41.322504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 566/1146] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:37:41 2022] GET /identity/v3/role_assignments?user.id=a31921dd177d47b4abce5bba4e3389da&scope.project.id=befee23fb0c642d1930a562bfec0d7de&role.id=3ab888f5f68740bd8f9df4447f4f5a7a => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:43.477383 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe9f95-6980-4309-a48f-d4b2ca5793d9 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:43.478023 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe9f95-6980-4309-a48f-d4b2ca5793d9 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:43.478023 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe9f95-6980-4309-a48f-d4b2ca5793d9 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:43.479521 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 581/1147] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:37:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:43.484609 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3acd53-5b99-4b35-ac2a-aba2ff43fe58 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:43.485038 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3acd53-5b99-4b35-ac2a-aba2ff43fe58 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:43.485161 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3acd53-5b99-4b35-ac2a-aba2ff43fe58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:43.502378 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-8e3acd53-5b99-4b35-ac2a-aba2ff43fe58 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:43.503537 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-8e3acd53-5b99-4b35-ac2a-aba2ff43fe58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:43.568106 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 567/1148] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:37:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:37:43.590441 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe9f95-6980-4309-a48f-d4b2ca5793d9 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:43.689259 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe9f95-6980-4309-a48f-d4b2ca5793d9 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:43.722007 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd4131-73f9-40c6-b7cb-cc5dedf27001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:43.722778 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd4131-73f9-40c6-b7cb-cc5dedf27001 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:43.723061 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd4131-73f9-40c6-b7cb-cc5dedf27001 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:43.723332 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd4131-73f9-40c6-b7cb-cc5dedf27001 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:43.733942 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd4131-73f9-40c6-b7cb-cc5dedf27001 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:37:43.741696 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-94cd4131-73f9-40c6-b7cb-cc5dedf27001 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:37:43.741696 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:43.741696 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:37:43.741696 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:37:43.741696 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:37:43.741696 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:37:43.741696 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:37:43.741696 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:37:43.741696 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:37:43.741696 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:37:43.741696 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:37:43.741696 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:37:43.741696 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:37:43.741696 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:37:43.741696 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:37:43.741696 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:37:43.743754 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:37:43.743754 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:37:43.743754 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:37:43.743754 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:37:43.743754 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:37:43.743754 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:37:43.743754 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:37:43.743754 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:37:43.743754 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:37:43.743754 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:37:43.743754 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:37:43.743754 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:37:43.743754 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:37:43.743754 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:37:43.743754 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:37:43.743754 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:37:43.744837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:37:43.744837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:37:43.744837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:37:43.744837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:37:43.744837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:37:43.744837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:37:43.744837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:37:43.744837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:37:43.744837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:37:43.744837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:37:43.744837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:37:43.744837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:43.744837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 582/1149] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:37:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:37:43.750433 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3acd53-5b99-4b35-ac2a-aba2ff43fe58 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:43.849644 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3acd53-5b99-4b35-ac2a-aba2ff43fe58 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:43.869412 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:43.882393 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260be02-9802-4ce2-b3e7-18cb71599caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:43.883122 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260be02-9802-4ce2-b3e7-18cb71599caf None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:43.883348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260be02-9802-4ce2-b3e7-18cb71599caf None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:43.883640 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260be02-9802-4ce2-b3e7-18cb71599caf None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:43.888381 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260be02-9802-4ce2-b3e7-18cb71599caf None admin] RBAC: Adding query filter params (name=admin) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:43.888381 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260be02-9802-4ce2-b3e7-18cb71599caf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:43.888381 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260be02-9802-4ce2-b3e7-18cb71599caf None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:43.893707 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 568/1150] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:37:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:43.900152 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd4131-73f9-40c6-b7cb-cc5dedf27001 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:43.957592 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:43.997733 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd4131-73f9-40c6-b7cb-cc5dedf27001 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:44.029765 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3384c7c-11a4-4ff1-8082-abffc7339518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:44.030619 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3384c7c-11a4-4ff1-8082-abffc7339518 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:44.030899 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3384c7c-11a4-4ff1-8082-abffc7339518 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:44.031172 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3384c7c-11a4-4ff1-8082-abffc7339518 None admin] PATH_INFO: `/v3/users/a31921dd177d47b4abce5bba4e3389da` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:44.032364 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3384c7c-11a4-4ff1-8082-abffc7339518 None admin] RBAC: Authorizing `identity:get_user(user_id=a31921dd177d47b4abce5bba4e3389da)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:44.033795 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3384c7c-11a4-4ff1-8082-abffc7339518 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:44.035383 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 583/1151] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:37:43 2022] GET /identity/v3/users/a31921dd177d47b4abce5bba4e3389da => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:44.041608 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260be02-9802-4ce2-b3e7-18cb71599caf None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:44.139398 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260be02-9802-4ce2-b3e7-18cb71599caf None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:44.172297 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a276d-43c8-4679-88b0-df621efe5822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:44.173144 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a276d-43c8-4679-88b0-df621efe5822 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:44.173429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a276d-43c8-4679-88b0-df621efe5822 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:44.173703 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a276d-43c8-4679-88b0-df621efe5822 None admin] PATH_INFO: `/v3/projects/befee23fb0c642d1930a562bfec0d7de` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:44.174864 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a276d-43c8-4679-88b0-df621efe5822 None admin] RBAC: Authorizing `identity:get_project(project_id=befee23fb0c642d1930a562bfec0d7de)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:44.176318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a276d-43c8-4679-88b0-df621efe5822 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:44.177988 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 569/1152] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:37:44 2022] GET /identity/v3/projects/befee23fb0c642d1930a562bfec0d7de => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:44.183910 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3384c7c-11a4-4ff1-8082-abffc7339518 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:44.282867 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3384c7c-11a4-4ff1-8082-abffc7339518 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:44.307218 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:44.314578 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38424c-c486-42f3-9fa7-53038957b00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:44.315448 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38424c-c486-42f3-9fa7-53038957b00b None admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:44.320894 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38424c-c486-42f3-9fa7-53038957b00b None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:44.320894 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38424c-c486-42f3-9fa7-53038957b00b None admin] PATH_INFO: `/v3/projects/befee23fb0c642d1930a562bfec0d7de/users/a31921dd177d47b4abce5bba4e3389da/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:44.320894 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38424c-c486-42f3-9fa7-53038957b00b None admin] RBAC: Authorizing `identity:create_grant(project_id=befee23fb0c642d1930a562bfec0d7de, user_id=a31921dd177d47b4abce5bba4e3389da, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:44.320894 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38424c-c486-42f3-9fa7-53038957b00b None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:44.419769 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 584/1153] 10.222.0.39 () {58 vars in 1439 bytes} [Mon May 23 15:37:44 2022] PUT /identity/v3/projects/befee23fb0c642d1930a562bfec0d7de/users/a31921dd177d47b4abce5bba4e3389da/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:37:46.577098 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d70f9-3b55-4a66-b1f3-df380bb0d993 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:46.577615 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d70f9-3b55-4a66-b1f3-df380bb0d993 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:46.577727 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d70f9-3b55-4a66-b1f3-df380bb0d993 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:46.579011 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 570/1154] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:46.584282 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d21b0-7368-417f-8588-cf4bc08e01b7 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:46.584720 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d21b0-7368-417f-8588-cf4bc08e01b7 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:46.584843 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d21b0-7368-417f-8588-cf4bc08e01b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:46.602341 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-fa7d21b0-7368-417f-8588-cf4bc08e01b7 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:46.603516 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-fa7d21b0-7368-417f-8588-cf4bc08e01b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:46.669142 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 585/1155] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:37:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:37:46.692818 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d70f9-3b55-4a66-b1f3-df380bb0d993 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:46.743041 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:46.792290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d70f9-3b55-4a66-b1f3-df380bb0d993 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:46.825355 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b902e7-2ce7-43b2-aa3a-19f6fc7b5b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:46.826133 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b902e7-2ce7-43b2-aa3a-19f6fc7b5b25 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:46.826417 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b902e7-2ce7-43b2-aa3a-19f6fc7b5b25 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:46.826694 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b902e7-2ce7-43b2-aa3a-19f6fc7b5b25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:46.836484 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b902e7-2ce7-43b2-aa3a-19f6fc7b5b25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:37:46.844031 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-92b902e7-2ce7-43b2-aa3a-19f6fc7b5b25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:37:46.844031 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:46.844031 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:37:46.844031 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:37:46.844031 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:37:46.844031 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:37:46.844031 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:37:46.844031 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:37:46.844031 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:37:46.844031 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:37:46.844031 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:37:46.844031 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:37:46.844031 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:37:46.844031 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:37:46.844031 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:37:46.844031 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:37:46.845122 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:37:46.845122 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:37:46.845122 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:37:46.845122 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:37:46.845122 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:37:46.845122 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:37:46.845122 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:37:46.845122 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:37:46.845122 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:37:46.845122 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:37:46.845122 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:37:46.845122 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:37:46.845122 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:37:46.845122 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:37:46.845122 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:37:46.845122 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:37:46.846170 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:37:46.846170 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:37:46.846170 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:37:46.846170 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:37:46.846170 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:37:46.846170 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:37:46.846170 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:37:46.846170 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:37:46.846170 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:37:46.846170 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:37:46.846170 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:37:46.846170 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:37:46.846170 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 571/1156] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:37:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:37:46.851234 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d21b0-7368-417f-8588-cf4bc08e01b7 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:46.948037 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d21b0-7368-417f-8588-cf4bc08e01b7 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:46.964674 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:46.981144 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ce9c1-7420-4d38-bfba-5cc6d3441f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:46.981801 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ce9c1-7420-4d38-bfba-5cc6d3441f7b None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:46.982084 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ce9c1-7420-4d38-bfba-5cc6d3441f7b None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:46.982362 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ce9c1-7420-4d38-bfba-5cc6d3441f7b None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:46.983146 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ce9c1-7420-4d38-bfba-5cc6d3441f7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:46.983453 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ce9c1-7420-4d38-bfba-5cc6d3441f7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:46.984851 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ce9c1-7420-4d38-bfba-5cc6d3441f7b None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:46.993173 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 586/1157] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:37:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:46.998875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b902e7-2ce7-43b2-aa3a-19f6fc7b5b25 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:47.095298 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b902e7-2ce7-43b2-aa3a-19f6fc7b5b25 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:47.105239 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:47.127584 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a4a90-1796-432e-9628-91f4b028fd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:47.128456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a4a90-1796-432e-9628-91f4b028fd2a None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:47.128739 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a4a90-1796-432e-9628-91f4b028fd2a None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:47.129011 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a4a90-1796-432e-9628-91f4b028fd2a None admin] PATH_INFO: `/v3/users/a31921dd177d47b4abce5bba4e3389da` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:47.130170 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a4a90-1796-432e-9628-91f4b028fd2a None admin] RBAC: Authorizing `identity:get_user(user_id=a31921dd177d47b4abce5bba4e3389da)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:47.131645 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a4a90-1796-432e-9628-91f4b028fd2a None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:47.134230 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 572/1158] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:37:46 2022] GET /identity/v3/users/a31921dd177d47b4abce5bba4e3389da => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:47.139510 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ce9c1-7420-4d38-bfba-5cc6d3441f7b None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:47.237837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ce9c1-7420-4d38-bfba-5cc6d3441f7b None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:47.270222 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dded996-2214-47f3-a3a3-93bf787367ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:47.270855 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dded996-2214-47f3-a3a3-93bf787367ea None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:47.271135 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dded996-2214-47f3-a3a3-93bf787367ea None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:47.271406 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dded996-2214-47f3-a3a3-93bf787367ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:47.318343 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:47.336798 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dded996-2214-47f3-a3a3-93bf787367ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:47.338274 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dded996-2214-47f3-a3a3-93bf787367ea None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:47.436752 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 587/1159] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:37:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:37:47.442472 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a4a90-1796-432e-9628-91f4b028fd2a None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:47.538607 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a4a90-1796-432e-9628-91f4b028fd2a None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:47.571590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff20b4-7176-4ff7-9203-6307fc6a62d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:47.572454 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff20b4-7176-4ff7-9203-6307fc6a62d5 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:47.572730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff20b4-7176-4ff7-9203-6307fc6a62d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:47.572997 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff20b4-7176-4ff7-9203-6307fc6a62d5 None admin] PATH_INFO: `/v3/projects/befee23fb0c642d1930a562bfec0d7de` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:47.574150 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff20b4-7176-4ff7-9203-6307fc6a62d5 None admin] RBAC: Authorizing `identity:get_project(project_id=befee23fb0c642d1930a562bfec0d7de)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:47.575572 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff20b4-7176-4ff7-9203-6307fc6a62d5 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:47.577246 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 573/1160] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:37:47 2022] GET /identity/v3/projects/befee23fb0c642d1930a562bfec0d7de => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:47.583168 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dded996-2214-47f3-a3a3-93bf787367ea None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:47.661275 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:47.679996 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dded996-2214-47f3-a3a3-93bf787367ea None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:47.713291 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e865944-8e76-4d2a-b2cd-2602f1aafcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:47.713958 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e865944-8e76-4d2a-b2cd-2602f1aafcc3 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:47.719025 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e865944-8e76-4d2a-b2cd-2602f1aafcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:47.719326 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e865944-8e76-4d2a-b2cd-2602f1aafcc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:47.720197 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e865944-8e76-4d2a-b2cd-2602f1aafcc3 None admin] RBAC: Adding query filter params (role.id=3ab888f5f68740bd8f9df4447f4f5a7a, scope.project.id=befee23fb0c642d1930a562bfec0d7de, user.id=a31921dd177d47b4abce5bba4e3389da) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:47.720517 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e865944-8e76-4d2a-b2cd-2602f1aafcc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:47.721953 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e865944-8e76-4d2a-b2cd-2602f1aafcc3 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:47.728390 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 588/1161] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:37:47 2022] GET /identity/v3/role_assignments?user.id=a31921dd177d47b4abce5bba4e3389da&scope.project.id=befee23fb0c642d1930a562bfec0d7de&role.id=3ab888f5f68740bd8f9df4447f4f5a7a => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:49.996926 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98556a-a16b-48ba-8877-2d99c236d0f4 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:49.997480 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98556a-a16b-48ba-8877-2d99c236d0f4 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:49.997480 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98556a-a16b-48ba-8877-2d99c236d0f4 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:49.998829 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 574/1162] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:50.003990 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac151f3-e29f-4465-b2a4-26ac3b9e3545 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:50.004359 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac151f3-e29f-4465-b2a4-26ac3b9e3545 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:50.004557 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac151f3-e29f-4465-b2a4-26ac3b9e3545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:50.021591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-dac151f3-e29f-4465-b2a4-26ac3b9e3545 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:50.022763 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-dac151f3-e29f-4465-b2a4-26ac3b9e3545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:50.088361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 589/1163] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:37:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:37:50.110414 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98556a-a16b-48ba-8877-2d99c236d0f4 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:50.156902 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:50.213281 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98556a-a16b-48ba-8877-2d99c236d0f4 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:50.248455 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60057f41-9904-4680-a58a-b876ca9fda5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:50.249027 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60057f41-9904-4680-a58a-b876ca9fda5b None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:50.249305 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60057f41-9904-4680-a58a-b876ca9fda5b None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:50.249576 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60057f41-9904-4680-a58a-b876ca9fda5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:50.313737 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60057f41-9904-4680-a58a-b876ca9fda5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:50.315165 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60057f41-9904-4680-a58a-b876ca9fda5b None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:50.358123 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:50.409694 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 575/1164] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:37:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:37:50.416280 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac151f3-e29f-4465-b2a4-26ac3b9e3545 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:50.488308 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:50.512942 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac151f3-e29f-4465-b2a4-26ac3b9e3545 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:50.546148 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e6a74-e14d-42dc-82b7-f20f16f64459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:50.546935 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e6a74-e14d-42dc-82b7-f20f16f64459 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:50.547218 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e6a74-e14d-42dc-82b7-f20f16f64459 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:50.547494 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e6a74-e14d-42dc-82b7-f20f16f64459 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:50.554015 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e6a74-e14d-42dc-82b7-f20f16f64459 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:50.556031 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e6a74-e14d-42dc-82b7-f20f16f64459 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:50.570017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-788e6a74-e14d-42dc-82b7-f20f16f64459 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 23 15:37:50.570017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:50.570017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 23 15:37:50.570017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 23 15:37:50.570017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:37:50.570017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:37:50.570017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:37:50.570017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:37:50.570017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 23 15:37:50.570017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:50.570017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:37:50.570017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:50.570017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:37:50.570017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:37:50.570017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:37:50.570017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:37:50.570017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:37:50.575900 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:37:50.575900 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:37:50.575900 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:37:50.575900 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:37:50.575900 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:37:50.575900 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:37:50.575900 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:37:50.575900 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:37:50.575900 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:37:50.575900 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:37:50.575900 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:37:50.575900 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:37:50.575900 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:37:50.575900 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:37:50.575900 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:37:50.575900 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:37:50.576861 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:37:50.576861 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:37:50.576861 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:37:50.576861 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:37:50.576861 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:37:50.576861 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:37:50.576861 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:37:50.576861 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:37:50.576861 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:37:50.576861 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:37:50.576861 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 23 15:37:50.576861 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:37:50.576861 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 23 15:37:50.576861 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:37:50.576861 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 590/1165] 10.222.0.39 () {56 vars in 1117 bytes} [Mon May 23 15:37:50 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:37:50.577767 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60057f41-9904-4680-a58a-b876ca9fda5b None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:50.673095 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60057f41-9904-4680-a58a-b876ca9fda5b None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:50.706199 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75715fc-e204-445e-aec1-4c8b8bf9a8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:50.706845 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75715fc-e204-445e-aec1-4c8b8bf9a8da None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:50.707127 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75715fc-e204-445e-aec1-4c8b8bf9a8da None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:50.707402 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75715fc-e204-445e-aec1-4c8b8bf9a8da None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:50.708141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75715fc-e204-445e-aec1-4c8b8bf9a8da None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:37:50.708450 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75715fc-e204-445e-aec1-4c8b8bf9a8da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:50.709813 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75715fc-e204-445e-aec1-4c8b8bf9a8da None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:50.717380 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 576/1166] 10.222.0.39 () {56 vars in 1115 bytes} [Mon May 23 15:37:50 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:37:52.879422 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c682c-ffea-42d1-ae14-964b0b4a1843 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:52.880026 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c682c-ffea-42d1-ae14-964b0b4a1843 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:52.880026 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c682c-ffea-42d1-ae14-964b0b4a1843 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:52.881379 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 591/1167] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:52.887329 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21708d9e-c23f-4934-92e3-022c0646fe7b None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:52.887765 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21708d9e-c23f-4934-92e3-022c0646fe7b None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:52.887930 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21708d9e-c23f-4934-92e3-022c0646fe7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:52.904339 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-21708d9e-c23f-4934-92e3-022c0646fe7b None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:52.905505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-21708d9e-c23f-4934-92e3-022c0646fe7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:52.908202 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:52.970895 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 577/1168] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:37:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:37:52.994200 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c682c-ffea-42d1-ae14-964b0b4a1843 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:53.095485 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c682c-ffea-42d1-ae14-964b0b4a1843 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:53.128958 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5419079-2b6b-43ba-b942-3b829e73f777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:53.129649 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5419079-2b6b-43ba-b942-3b829e73f777 None admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:53.129885 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5419079-2b6b-43ba-b942-3b829e73f777 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:53.130163 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5419079-2b6b-43ba-b942-3b829e73f777 None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:53.130909 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5419079-2b6b-43ba-b942-3b829e73f777 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:53.132963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5419079-2b6b-43ba-b942-3b829e73f777 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:53.135527 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:53.196713 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 592/1169] 10.222.0.39 () {60 vars in 1138 bytes} [Mon May 23 15:37:52 2022] POST /identity/v3/domains => generated 267 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:37:55.392853 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6efdf-c3fa-4a1a-9fea-2b6b89597c22 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:55.393408 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6efdf-c3fa-4a1a-9fea-2b6b89597c22 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:55.393408 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6efdf-c3fa-4a1a-9fea-2b6b89597c22 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:55.394787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 578/1170] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:55.399958 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fc075-3ffb-4107-9ee0-2bc9ac26b6cd None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:55.400400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fc075-3ffb-4107-9ee0-2bc9ac26b6cd None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:55.400508 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fc075-3ffb-4107-9ee0-2bc9ac26b6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:55.417089 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-c69fc075-3ffb-4107-9ee0-2bc9ac26b6cd None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:55.418263 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-c69fc075-3ffb-4107-9ee0-2bc9ac26b6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:55.484092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 593/1171] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:37:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:37:55.507213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6efdf-c3fa-4a1a-9fea-2b6b89597c22 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:55.606037 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6efdf-c3fa-4a1a-9fea-2b6b89597c22 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:55.639052 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d4d44-c0c7-42a7-8237-7f37a676fe8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:55.639921 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d4d44-c0c7-42a7-8237-7f37a676fe8d None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:55.640203 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d4d44-c0c7-42a7-8237-7f37a676fe8d None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:55.640472 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d4d44-c0c7-42a7-8237-7f37a676fe8d None admin] PATH_INFO: `/v3/domains/ddd9e83d482141e49ed44f795dd00a29` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:55.648524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:55.650912 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d4d44-c0c7-42a7-8237-7f37a676fe8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=ddd9e83d482141e49ed44f795dd00a29)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:55.652378 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d4d44-c0c7-42a7-8237-7f37a676fe8d None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:55.653993 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 579/1172] 10.222.0.39 () {56 vars in 1183 bytes} [Mon May 23 15:37:55 2022] GET /identity/v3/domains/ddd9e83d482141e49ed44f795dd00a29 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:55.659770 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69fc075-3ffb-4107-9ee0-2bc9ac26b6cd None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:55.757247 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69fc075-3ffb-4107-9ee0-2bc9ac26b6cd None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:55.779524 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:55.790415 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7583c-7f83-4f29-b1d8-33259fce6640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:55.791072 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7583c-7f83-4f29-b1d8-33259fce6640 None admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:55.791351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7583c-7f83-4f29-b1d8-33259fce6640 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:55.791660 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7583c-7f83-4f29-b1d8-33259fce6640 None admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:55.792375 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7583c-7f83-4f29-b1d8-33259fce6640 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:55.793799 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7583c-7f83-4f29-b1d8-33259fce6640 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:55.893794 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 594/1173] 10.222.0.39 () {60 vars in 1141 bytes} [Mon May 23 15:37:55 2022] POST /identity/v3/projects => generated 361 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:37:58.100044 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d552fa-5748-49b7-a850-5dd282266285 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:58.100631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d552fa-5748-49b7-a850-5dd282266285 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:58.100631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d552fa-5748-49b7-a850-5dd282266285 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:58.102024 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 580/1174] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:37:58.107527 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604add8-8413-4fd6-8dbe-06150ca7be32 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:58.107980 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604add8-8413-4fd6-8dbe-06150ca7be32 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:58.108113 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604add8-8413-4fd6-8dbe-06150ca7be32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:58.125095 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-4604add8-8413-4fd6-8dbe-06150ca7be32 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:37:58.126259 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-4604add8-8413-4fd6-8dbe-06150ca7be32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:58.190924 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 595/1175] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:37:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:37:58.216075 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d552fa-5748-49b7-a850-5dd282266285 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:58.314267 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d552fa-5748-49b7-a850-5dd282266285 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:58.346135 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d1aba-02b0-4712-a03f-5ecdc4c98f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:58.346980 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d1aba-02b0-4712-a03f-5ecdc4c98f4f None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:58.347256 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d1aba-02b0-4712-a03f-5ecdc4c98f4f None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:58.347523 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d1aba-02b0-4712-a03f-5ecdc4c98f4f None admin] PATH_INFO: `/v3/domains/ddd9e83d482141e49ed44f795dd00a29` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:58.348698 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d1aba-02b0-4712-a03f-5ecdc4c98f4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=ddd9e83d482141e49ed44f795dd00a29)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:58.350165 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d1aba-02b0-4712-a03f-5ecdc4c98f4f None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:58.351788 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 581/1176] 10.222.0.39 () {56 vars in 1183 bytes} [Mon May 23 15:37:58 2022] GET /identity/v3/domains/ddd9e83d482141e49ed44f795dd00a29 => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:37:58.357694 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604add8-8413-4fd6-8dbe-06150ca7be32 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:58.453245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604add8-8413-4fd6-8dbe-06150ca7be32 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:58.460865 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:58.486518 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268d8f5-8828-49d2-a03c-1bb44b029439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:58.487170 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268d8f5-8828-49d2-a03c-1bb44b029439 None admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:58.487449 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268d8f5-8828-49d2-a03c-1bb44b029439 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:58.487751 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268d8f5-8828-49d2-a03c-1bb44b029439 None admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:58.488473 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268d8f5-8828-49d2-a03c-1bb44b029439 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:58.489886 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268d8f5-8828-49d2-a03c-1bb44b029439 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:58.590253 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 596/1177] 10.222.0.39 () {60 vars in 1132 bytes} [Mon May 23 15:37:58 2022] POST /identity/v3/users => generated 311 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:38:00.820811 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8eadd-3493-4af5-82b6-28087db728f4 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:00.821366 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8eadd-3493-4af5-82b6-28087db728f4 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:00.821767 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8eadd-3493-4af5-82b6-28087db728f4 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:00.824213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 582/1178] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:38:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:38:00.831524 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147b385-1c41-4e07-a348-bba76c625632 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:00.831964 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147b385-1c41-4e07-a348-bba76c625632 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:00.832123 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147b385-1c41-4e07-a348-bba76c625632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:00.849932 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-d147b385-1c41-4e07-a348-bba76c625632 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:00.851690 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-d147b385-1c41-4e07-a348-bba76c625632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:00.918648 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 597/1179] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:38:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:38:00.941702 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8eadd-3493-4af5-82b6-28087db728f4 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:01.008739 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:01.041622 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8eadd-3493-4af5-82b6-28087db728f4 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:01.074327 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0365d0b-7099-42b5-a457-909e4b2efb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:01.075036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0365d0b-7099-42b5-a457-909e4b2efb0a None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:01.075316 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0365d0b-7099-42b5-a457-909e4b2efb0a None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:01.075586 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0365d0b-7099-42b5-a457-909e4b2efb0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:01.085697 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0365d0b-7099-42b5-a457-909e4b2efb0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:38:01.093509 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-d0365d0b-7099-42b5-a457-909e4b2efb0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:38:01.093509 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:38:01.093509 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:38:01.093509 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:38:01.093509 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:38:01.093509 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:38:01.093509 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:38:01.093509 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:38:01.093509 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:38:01.093509 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:38:01.093509 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:38:01.093509 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:38:01.093509 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:38:01.093509 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:38:01.093509 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:38:01.093509 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:38:01.094631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:38:01.094631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:38:01.094631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:38:01.094631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:38:01.094631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:38:01.094631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:38:01.094631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:38:01.094631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:38:01.094631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:38:01.094631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:38:01.094631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:38:01.094631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:38:01.094631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:38:01.094631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:38:01.094631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:38:01.094631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:38:01.095762 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:38:01.095762 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:38:01.095762 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:38:01.095762 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:38:01.095762 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:38:01.095762 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:38:01.095762 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:38:01.095762 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:38:01.095762 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:38:01.095762 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:38:01.095762 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:38:01.095762 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:38:01.099590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 583/1180] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:38:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:38:01.100992 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147b385-1c41-4e07-a348-bba76c625632 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:01.189445 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:01.198403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147b385-1c41-4e07-a348-bba76c625632 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:01.232088 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872a2f5-a01e-4f33-8392-6638c2328e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:01.232746 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872a2f5-a01e-4f33-8392-6638c2328e02 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:01.233027 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872a2f5-a01e-4f33-8392-6638c2328e02 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:01.233298 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872a2f5-a01e-4f33-8392-6638c2328e02 None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:01.234037 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872a2f5-a01e-4f33-8392-6638c2328e02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:38:01.234341 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872a2f5-a01e-4f33-8392-6638c2328e02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:01.235714 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872a2f5-a01e-4f33-8392-6638c2328e02 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:01.244510 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 598/1181] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:38:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:38:01.250228 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0365d0b-7099-42b5-a457-909e4b2efb0a None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:01.346008 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0365d0b-7099-42b5-a457-909e4b2efb0a None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:01.371704 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:01.378975 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501973a1-24e0-41fd-a75c-5cc54efb8866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:01.383714 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501973a1-24e0-41fd-a75c-5cc54efb8866 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:01.383714 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501973a1-24e0-41fd-a75c-5cc54efb8866 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:01.383714 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501973a1-24e0-41fd-a75c-5cc54efb8866 None admin] PATH_INFO: `/v3/users/f37549c51e234cca89746fd0a2d2e8e4` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:01.393455 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501973a1-24e0-41fd-a75c-5cc54efb8866 None admin] RBAC: Authorizing `identity:get_user(user_id=f37549c51e234cca89746fd0a2d2e8e4)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:01.394914 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501973a1-24e0-41fd-a75c-5cc54efb8866 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:01.396874 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 584/1182] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:38:01 2022] GET /identity/v3/users/f37549c51e234cca89746fd0a2d2e8e4 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:38:01.402777 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872a2f5-a01e-4f33-8392-6638c2328e02 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:01.500922 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872a2f5-a01e-4f33-8392-6638c2328e02 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:01.532934 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d960d-2b92-44a7-94e0-91483a0e6483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:01.533568 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d960d-2b92-44a7-94e0-91483a0e6483 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:01.533848 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d960d-2b92-44a7-94e0-91483a0e6483 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:01.534129 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d960d-2b92-44a7-94e0-91483a0e6483 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:01.558254 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:01.601426 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d960d-2b92-44a7-94e0-91483a0e6483 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:01.603098 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d960d-2b92-44a7-94e0-91483a0e6483 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:01.697998 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 599/1183] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:38:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:38:01.703919 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501973a1-24e0-41fd-a75c-5cc54efb8866 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:01.800454 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501973a1-24e0-41fd-a75c-5cc54efb8866 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:01.833262 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6351e-2746-4cb4-a942-bcef3091b014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:01.834099 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6351e-2746-4cb4-a942-bcef3091b014 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:01.834382 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6351e-2746-4cb4-a942-bcef3091b014 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:01.835177 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6351e-2746-4cb4-a942-bcef3091b014 None admin] PATH_INFO: `/v3/projects/607c28904cdd46b3b4239654e41ec2f8` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:01.836443 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6351e-2746-4cb4-a942-bcef3091b014 None admin] RBAC: Authorizing `identity:get_project(project_id=607c28904cdd46b3b4239654e41ec2f8)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:01.837874 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6351e-2746-4cb4-a942-bcef3091b014 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:01.839539 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 585/1184] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:38:01 2022] GET /identity/v3/projects/607c28904cdd46b3b4239654e41ec2f8 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:38:01.845474 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d960d-2b92-44a7-94e0-91483a0e6483 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:01.901387 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:01.944825 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d960d-2b92-44a7-94e0-91483a0e6483 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:01.978376 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a0718-1537-4a0a-a393-4c4a462783cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:01.979014 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a0718-1537-4a0a-a393-4c4a462783cc None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:01.979295 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a0718-1537-4a0a-a393-4c4a462783cc None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:01.979568 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a0718-1537-4a0a-a393-4c4a462783cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:01.980414 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a0718-1537-4a0a-a393-4c4a462783cc None admin] RBAC: Adding query filter params (role.id=3ab888f5f68740bd8f9df4447f4f5a7a, scope.project.id=607c28904cdd46b3b4239654e41ec2f8, user.id=f37549c51e234cca89746fd0a2d2e8e4) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:38:01.980722 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a0718-1537-4a0a-a393-4c4a462783cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:01.982145 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a0718-1537-4a0a-a393-4c4a462783cc None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:01.987393 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 600/1185] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:38:01 2022] GET /identity/v3/role_assignments?user.id=f37549c51e234cca89746fd0a2d2e8e4&scope.project.id=607c28904cdd46b3b4239654e41ec2f8&role.id=3ab888f5f68740bd8f9df4447f4f5a7a => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:38:04.123146 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8909091-9aab-48b5-99db-e88775bcea09 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:04.123727 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8909091-9aab-48b5-99db-e88775bcea09 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:04.123727 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8909091-9aab-48b5-99db-e88775bcea09 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:04.125093 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 586/1186] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:38:04.130621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a0b1a-f530-4bbf-9f12-8c5ec6ef003c None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:04.131056 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a0b1a-f530-4bbf-9f12-8c5ec6ef003c None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:04.131186 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a0b1a-f530-4bbf-9f12-8c5ec6ef003c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:04.148770 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-c22a0b1a-f530-4bbf-9f12-8c5ec6ef003c None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:04.149969 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-c22a0b1a-f530-4bbf-9f12-8c5ec6ef003c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:04.215665 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 601/1187] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:38:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:38:04.238396 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8909091-9aab-48b5-99db-e88775bcea09 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:04.293837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:04.337924 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8909091-9aab-48b5-99db-e88775bcea09 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:04.370730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d558c-b726-42e0-b377-6dd4c38f27b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:04.371510 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d558c-b726-42e0-b377-6dd4c38f27b5 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:04.371822 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d558c-b726-42e0-b377-6dd4c38f27b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:04.372102 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d558c-b726-42e0-b377-6dd4c38f27b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:04.382533 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d558c-b726-42e0-b377-6dd4c38f27b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:38:04.390025 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-301d558c-b726-42e0-b377-6dd4c38f27b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:38:04.390025 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:38:04.390025 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:38:04.390025 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:38:04.390025 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:38:04.390025 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:38:04.390025 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:38:04.390025 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:38:04.390025 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:38:04.390025 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:38:04.390025 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:38:04.390025 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:38:04.390025 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:38:04.390025 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:38:04.390025 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:38:04.390025 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:38:04.391118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:38:04.391118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:38:04.391118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:38:04.391118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:38:04.391118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:38:04.391118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:38:04.391118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:38:04.391118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:38:04.391118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:38:04.391118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:38:04.391118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:38:04.391118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:38:04.391118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:38:04.391118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:38:04.391118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:38:04.391118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:38:04.392175 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:38:04.392175 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:38:04.392175 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:38:04.392175 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:38:04.392175 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:38:04.392175 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:38:04.392175 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:38:04.392175 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:38:04.392175 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:38:04.392175 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:38:04.392175 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:38:04.392175 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:38:04.392175 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 587/1188] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:38:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:38:04.397742 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a0b1a-f530-4bbf-9f12-8c5ec6ef003c None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:04.447303 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:04.499025 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a0b1a-f530-4bbf-9f12-8c5ec6ef003c None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:04.535107 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16e3e9-8748-4f76-81f1-0a7eca8917c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:04.535803 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16e3e9-8748-4f76-81f1-0a7eca8917c4 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:04.536094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16e3e9-8748-4f76-81f1-0a7eca8917c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:04.536377 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16e3e9-8748-4f76-81f1-0a7eca8917c4 None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:04.537126 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16e3e9-8748-4f76-81f1-0a7eca8917c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:38:04.537438 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16e3e9-8748-4f76-81f1-0a7eca8917c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:04.539798 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16e3e9-8748-4f76-81f1-0a7eca8917c4 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:04.551006 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 602/1189] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:38:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:38:04.558776 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d558c-b726-42e0-b377-6dd4c38f27b5 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:04.661261 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d558c-b726-42e0-b377-6dd4c38f27b5 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:04.675236 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:04.695982 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5b078-6769-42ff-9755-c27597eee20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:04.696842 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5b078-6769-42ff-9755-c27597eee20f None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:04.697129 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5b078-6769-42ff-9755-c27597eee20f None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:04.697407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5b078-6769-42ff-9755-c27597eee20f None admin] PATH_INFO: `/v3/users/f37549c51e234cca89746fd0a2d2e8e4` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:04.698577 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5b078-6769-42ff-9755-c27597eee20f None admin] RBAC: Authorizing `identity:get_user(user_id=f37549c51e234cca89746fd0a2d2e8e4)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:04.700064 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5b078-6769-42ff-9755-c27597eee20f None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:04.701671 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 588/1190] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:38:04 2022] GET /identity/v3/users/f37549c51e234cca89746fd0a2d2e8e4 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:38:04.707335 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16e3e9-8748-4f76-81f1-0a7eca8917c4 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:04.804767 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16e3e9-8748-4f76-81f1-0a7eca8917c4 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:04.814583 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:04.837700 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb72a2e-7e0f-48b9-9053-36a0b5d80b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:04.838533 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb72a2e-7e0f-48b9-9053-36a0b5d80b61 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:04.838894 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb72a2e-7e0f-48b9-9053-36a0b5d80b61 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:04.839169 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb72a2e-7e0f-48b9-9053-36a0b5d80b61 None admin] PATH_INFO: `/v3/projects/607c28904cdd46b3b4239654e41ec2f8` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:04.840348 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb72a2e-7e0f-48b9-9053-36a0b5d80b61 None admin] RBAC: Authorizing `identity:get_project(project_id=607c28904cdd46b3b4239654e41ec2f8)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:04.841765 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb72a2e-7e0f-48b9-9053-36a0b5d80b61 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:04.843417 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 603/1191] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:38:04 2022] GET /identity/v3/projects/607c28904cdd46b3b4239654e41ec2f8 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:38:04.849242 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5b078-6769-42ff-9755-c27597eee20f None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:04.950235 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5b078-6769-42ff-9755-c27597eee20f None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:04.983520 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14588660-804e-4173-b6ed-1b39c925fc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:04.984421 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14588660-804e-4173-b6ed-1b39c925fc98 None admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:04.984697 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14588660-804e-4173-b6ed-1b39c925fc98 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:04.984975 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14588660-804e-4173-b6ed-1b39c925fc98 None admin] PATH_INFO: `/v3/projects/607c28904cdd46b3b4239654e41ec2f8/users/f37549c51e234cca89746fd0a2d2e8e4/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:04.986906 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14588660-804e-4173-b6ed-1b39c925fc98 None admin] RBAC: Authorizing `identity:create_grant(project_id=607c28904cdd46b3b4239654e41ec2f8, user_id=f37549c51e234cca89746fd0a2d2e8e4, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:04.988367 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14588660-804e-4173-b6ed-1b39c925fc98 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:05.086170 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 589/1192] 10.222.0.39 () {58 vars in 1439 bytes} [Mon May 23 15:38:04 2022] PUT /identity/v3/projects/607c28904cdd46b3b4239654e41ec2f8/users/f37549c51e234cca89746fd0a2d2e8e4/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:07.224275 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2096933-0001-40ef-8d70-1dad3e60aff6 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:07.224679 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2096933-0001-40ef-8d70-1dad3e60aff6 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:07.224840 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2096933-0001-40ef-8d70-1dad3e60aff6 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:07.226818 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 604/1193] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:38:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:38:07.232456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe97ae5-17f3-470d-9fcb-e873905d198c None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:07.232852 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe97ae5-17f3-470d-9fcb-e873905d198c None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:07.233014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe97ae5-17f3-470d-9fcb-e873905d198c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:07.249375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-2fe97ae5-17f3-470d-9fcb-e873905d198c None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:07.250551 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-2fe97ae5-17f3-470d-9fcb-e873905d198c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:07.284362 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:07.314862 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 590/1194] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:38:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:38:07.338865 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2096933-0001-40ef-8d70-1dad3e60aff6 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:07.439687 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2096933-0001-40ef-8d70-1dad3e60aff6 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:07.472237 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da920344-4b33-494b-9227-4a2b7a7bfea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:07.472945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da920344-4b33-494b-9227-4a2b7a7bfea0 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:07.473226 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da920344-4b33-494b-9227-4a2b7a7bfea0 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:07.473499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da920344-4b33-494b-9227-4a2b7a7bfea0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:07.483917 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da920344-4b33-494b-9227-4a2b7a7bfea0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:38:07.492052 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-da920344-4b33-494b-9227-4a2b7a7bfea0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:38:07.492052 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:38:07.492052 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:38:07.492052 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:38:07.492052 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:38:07.492052 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:38:07.492052 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:38:07.492052 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:38:07.492052 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:38:07.492052 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:38:07.492052 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:38:07.492052 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:38:07.492052 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:38:07.492052 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:38:07.492052 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:38:07.492052 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:38:07.493179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:38:07.493179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:38:07.493179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:38:07.493179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:38:07.493179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:38:07.493179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:38:07.493179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:38:07.493179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:38:07.493179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:38:07.493179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:38:07.493179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:38:07.493179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:38:07.493179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:38:07.493179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:38:07.493179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:38:07.493179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:38:07.494081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:38:07.494081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:38:07.494081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:38:07.494081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:38:07.494081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:38:07.494081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:38:07.494081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:38:07.494081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:38:07.494081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:38:07.494081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:38:07.494081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:38:07.494081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:38:07.494081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 605/1195] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:38:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:38:07.499048 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe97ae5-17f3-470d-9fcb-e873905d198c None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:07.594236 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe97ae5-17f3-470d-9fcb-e873905d198c None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:07.628652 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2482d9-1eb5-45b2-a12a-532af38758dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:07.629314 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2482d9-1eb5-45b2-a12a-532af38758dd None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:07.629596 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2482d9-1eb5-45b2-a12a-532af38758dd None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:07.629871 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2482d9-1eb5-45b2-a12a-532af38758dd None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:07.630610 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2482d9-1eb5-45b2-a12a-532af38758dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:38:07.630917 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2482d9-1eb5-45b2-a12a-532af38758dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:07.632431 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2482d9-1eb5-45b2-a12a-532af38758dd None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:07.640211 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 591/1196] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:38:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:38:07.645901 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da920344-4b33-494b-9227-4a2b7a7bfea0 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:07.685843 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:07.744187 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da920344-4b33-494b-9227-4a2b7a7bfea0 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:07.777019 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983154c7-528b-4cf4-b1e7-1c349f77c69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:07.777871 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983154c7-528b-4cf4-b1e7-1c349f77c69a None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:07.778154 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983154c7-528b-4cf4-b1e7-1c349f77c69a None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:07.778435 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983154c7-528b-4cf4-b1e7-1c349f77c69a None admin] PATH_INFO: `/v3/users/f37549c51e234cca89746fd0a2d2e8e4` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:07.779631 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983154c7-528b-4cf4-b1e7-1c349f77c69a None admin] RBAC: Authorizing `identity:get_user(user_id=f37549c51e234cca89746fd0a2d2e8e4)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:07.781059 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983154c7-528b-4cf4-b1e7-1c349f77c69a None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:07.782664 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 606/1197] 10.222.0.39 () {56 vars in 1177 bytes} [Mon May 23 15:38:07 2022] GET /identity/v3/users/f37549c51e234cca89746fd0a2d2e8e4 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:38:07.788890 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2482d9-1eb5-45b2-a12a-532af38758dd None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:07.822674 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:07.886817 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2482d9-1eb5-45b2-a12a-532af38758dd None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:07.919948 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a37ebf-e5c9-4d2c-b1fb-69cd84efcc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:07.920586 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a37ebf-e5c9-4d2c-b1fb-69cd84efcc05 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:07.920866 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a37ebf-e5c9-4d2c-b1fb-69cd84efcc05 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:07.921139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a37ebf-e5c9-4d2c-b1fb-69cd84efcc05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:07.985202 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a37ebf-e5c9-4d2c-b1fb-69cd84efcc05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:07.986636 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a37ebf-e5c9-4d2c-b1fb-69cd84efcc05 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:08.017323 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:08.080303 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 592/1198] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:38:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:38:08.086962 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983154c7-528b-4cf4-b1e7-1c349f77c69a None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:08.183565 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983154c7-528b-4cf4-b1e7-1c349f77c69a None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:08.190655 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:08.217722 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b641db2-e97f-4ea2-91f6-9b1761fddd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:08.218795 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b641db2-e97f-4ea2-91f6-9b1761fddd25 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:08.219382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b641db2-e97f-4ea2-91f6-9b1761fddd25 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:08.219696 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b641db2-e97f-4ea2-91f6-9b1761fddd25 None admin] PATH_INFO: `/v3/projects/607c28904cdd46b3b4239654e41ec2f8` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:08.220894 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b641db2-e97f-4ea2-91f6-9b1761fddd25 None admin] RBAC: Authorizing `identity:get_project(project_id=607c28904cdd46b3b4239654e41ec2f8)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:08.222324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b641db2-e97f-4ea2-91f6-9b1761fddd25 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:08.224158 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 607/1199] 10.222.0.39 () {56 vars in 1186 bytes} [Mon May 23 15:38:08 2022] GET /identity/v3/projects/607c28904cdd46b3b4239654e41ec2f8 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:38:08.230637 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a37ebf-e5c9-4d2c-b1fb-69cd84efcc05 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:08.327643 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a37ebf-e5c9-4d2c-b1fb-69cd84efcc05 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:08.361723 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271bdbb-33a2-49ef-841f-54e05f934077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:08.362359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271bdbb-33a2-49ef-841f-54e05f934077 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:08.362639 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271bdbb-33a2-49ef-841f-54e05f934077 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:08.362911 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271bdbb-33a2-49ef-841f-54e05f934077 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:08.363756 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271bdbb-33a2-49ef-841f-54e05f934077 None admin] RBAC: Adding query filter params (role.id=3ab888f5f68740bd8f9df4447f4f5a7a, scope.project.id=607c28904cdd46b3b4239654e41ec2f8, user.id=f37549c51e234cca89746fd0a2d2e8e4) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:38:08.364064 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271bdbb-33a2-49ef-841f-54e05f934077 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:08.365564 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271bdbb-33a2-49ef-841f-54e05f934077 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:08.367538 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:08.372062 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 593/1200] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:38:08 2022] GET /identity/v3/role_assignments?user.id=f37549c51e234cca89746fd0a2d2e8e4&scope.project.id=607c28904cdd46b3b4239654e41ec2f8&role.id=3ab888f5f68740bd8f9df4447f4f5a7a => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:38:18.219551 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=13 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:18.395160 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:23.832313 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da1a6e-05e6-48a3-87af-aa0112bbc27d None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:23.832897 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da1a6e-05e6-48a3-87af-aa0112bbc27d None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:23.832897 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da1a6e-05e6-48a3-87af-aa0112bbc27d None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:23.834305 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 608/1201] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:39:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:39:23.839703 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506876b-6dbf-4b5b-9b84-3a7da2f603a9 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:23.840129 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506876b-6dbf-4b5b-9b84-3a7da2f603a9 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:23.840240 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506876b-6dbf-4b5b-9b84-3a7da2f603a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:23.857937 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-c506876b-6dbf-4b5b-9b84-3a7da2f603a9 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:39:23.859106 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-c506876b-6dbf-4b5b-9b84-3a7da2f603a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:39:23.923663 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 594/1202] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:39:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:39:23.948330 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da1a6e-05e6-48a3-87af-aa0112bbc27d None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:24.049796 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da1a6e-05e6-48a3-87af-aa0112bbc27d None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:24.083504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adf3a2-afb5-41f1-abe7-155fbcdd571c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:24.084241 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adf3a2-afb5-41f1-abe7-155fbcdd571c None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:24.084526 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adf3a2-afb5-41f1-abe7-155fbcdd571c None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:24.084804 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adf3a2-afb5-41f1-abe7-155fbcdd571c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:24.094673 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18adf3a2-afb5-41f1-abe7-155fbcdd571c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:24.100350 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18adf3a2-afb5-41f1-abe7-155fbcdd571c None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:24.113477 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-18adf3a2-afb5-41f1-abe7-155fbcdd571c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:39:24.113477 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:39:24.113477 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:39:24.113477 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:39:24.113477 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:39:24.113477 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:39:24.113477 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:39:24.113477 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:39:24.113477 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:39:24.113477 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:39:24.113477 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:39:24.113477 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:39:24.113477 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:39:24.113477 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:39:24.113477 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:39:24.114529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:39:24.114529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:39:24.114529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:39:24.114529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:39:24.114529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:39:24.114529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:39:24.114529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:39:24.114529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:39:24.114529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:39:24.114529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:39:24.114529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:39:24.114529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:39:24.114529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:39:24.114529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:39:24.114529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:39:24.114529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:39:24.114529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:39:24.115492 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:39:24.115492 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:39:24.115492 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:39:24.115492 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:39:24.115492 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 609/1203] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:39:24.120686 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506876b-6dbf-4b5b-9b84-3a7da2f603a9 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:24.220580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506876b-6dbf-4b5b-9b84-3a7da2f603a9 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:24.248122 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:24.254327 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848225d-d75f-48d7-8a6b-c9ff9a1d52a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:24.254977 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848225d-d75f-48d7-8a6b-c9ff9a1d52a5 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:24.255257 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848225d-d75f-48d7-8a6b-c9ff9a1d52a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:24.255529 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848225d-d75f-48d7-8a6b-c9ff9a1d52a5 None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:24.256273 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848225d-d75f-48d7-8a6b-c9ff9a1d52a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:24.256578 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848225d-d75f-48d7-8a6b-c9ff9a1d52a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:24.257941 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848225d-d75f-48d7-8a6b-c9ff9a1d52a5 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:24.270059 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 595/1204] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:24.275819 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adf3a2-afb5-41f1-abe7-155fbcdd571c None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:24.329451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:24.375201 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adf3a2-afb5-41f1-abe7-155fbcdd571c None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:24.411131 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b070f9-62dd-4066-a4b7-4c8e1e78402d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:24.411834 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b070f9-62dd-4066-a4b7-4c8e1e78402d None admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:24.412119 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b070f9-62dd-4066-a4b7-4c8e1e78402d None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:24.412397 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b070f9-62dd-4066-a4b7-4c8e1e78402d None admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:24.413109 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b070f9-62dd-4066-a4b7-4c8e1e78402d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:24.414574 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b070f9-62dd-4066-a4b7-4c8e1e78402d None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:24.488981 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 610/1205] 10.222.0.39 () {60 vars in 1132 bytes} [Mon May 23 15:39:24 2022] POST /identity/v3/users => generated 251 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:39:26.701427 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb7f99-57f0-435c-b93a-bbf2c0656670 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:26.701991 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb7f99-57f0-435c-b93a-bbf2c0656670 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:26.701991 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb7f99-57f0-435c-b93a-bbf2c0656670 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:26.703328 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 596/1206] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:39:26.709190 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f646c5f-0ec7-40ae-971b-3202f2be0828 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:26.709613 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f646c5f-0ec7-40ae-971b-3202f2be0828 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:26.709756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f646c5f-0ec7-40ae-971b-3202f2be0828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:26.727357 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-6f646c5f-0ec7-40ae-971b-3202f2be0828 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:39:26.728627 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-6f646c5f-0ec7-40ae-971b-3202f2be0828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:39:26.799710 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 611/1207] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:39:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:39:26.823700 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb7f99-57f0-435c-b93a-bbf2c0656670 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:26.925632 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb7f99-57f0-435c-b93a-bbf2c0656670 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:26.958728 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71464c58-ced9-4a45-bd8a-c29b194b36f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:26.959452 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71464c58-ced9-4a45-bd8a-c29b194b36f2 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:26.959765 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71464c58-ced9-4a45-bd8a-c29b194b36f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:26.960041 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71464c58-ced9-4a45-bd8a-c29b194b36f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:26.970515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71464c58-ced9-4a45-bd8a-c29b194b36f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:39:26.978734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-71464c58-ced9-4a45-bd8a-c29b194b36f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:39:26.978734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:39:26.978734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:39:26.978734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:39:26.978734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:39:26.978734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:39:26.978734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:39:26.978734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:39:26.978734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:39:26.978734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:39:26.978734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:39:26.978734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:39:26.978734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:39:26.978734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:39:26.978734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:39:26.978734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:39:26.979913 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:39:26.979913 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:39:26.979913 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:39:26.979913 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:39:26.979913 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:39:26.979913 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:39:26.979913 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:39:26.979913 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:39:26.979913 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:39:26.979913 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:39:26.979913 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:39:26.979913 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:39:26.979913 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:39:26.979913 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:39:26.979913 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:39:26.979913 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:39:26.981036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:39:26.981036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:39:26.981036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:39:26.981036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:39:26.981036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:39:26.981036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:39:26.981036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:39:26.981036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:39:26.981036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:39:26.981036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:39:26.981036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:39:26.981036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:39:26.981036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 597/1208] 10.222.0.39 () {56 vars in 1102 bytes} [Mon May 23 15:39:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:39:26.985930 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f646c5f-0ec7-40ae-971b-3202f2be0828 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:27.026686 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:27.085333 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f646c5f-0ec7-40ae-971b-3202f2be0828 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:27.118159 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd403960-8ad2-4908-9bbc-680fa5a66050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:27.118819 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd403960-8ad2-4908-9bbc-680fa5a66050 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:27.119098 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd403960-8ad2-4908-9bbc-680fa5a66050 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:27.119368 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd403960-8ad2-4908-9bbc-680fa5a66050 None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:27.120140 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd403960-8ad2-4908-9bbc-680fa5a66050 None admin] RBAC: Adding query filter params (name=service) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:27.120445 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd403960-8ad2-4908-9bbc-680fa5a66050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:27.121790 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd403960-8ad2-4908-9bbc-680fa5a66050 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:27.130236 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 612/1209] 10.222.0.39 () {56 vars in 1103 bytes} [Mon May 23 15:39:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:27.135975 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71464c58-ced9-4a45-bd8a-c29b194b36f2 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:27.185534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:27.235020 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71464c58-ced9-4a45-bd8a-c29b194b36f2 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:27.269931 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c543545-52e4-41df-bdb3-3932c0248f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:27.270654 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c543545-52e4-41df-bdb3-3932c0248f23 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:27.270932 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c543545-52e4-41df-bdb3-3932c0248f23 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:27.271202 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c543545-52e4-41df-bdb3-3932c0248f23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:27.280984 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c543545-52e4-41df-bdb3-3932c0248f23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:27.282420 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c543545-52e4-41df-bdb3-3932c0248f23 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:27.300251 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-3c543545-52e4-41df-bdb3-3932c0248f23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:39:27.300251 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:39:27.300251 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:39:27.300251 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:39:27.300251 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:39:27.300251 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:39:27.300251 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:39:27.300251 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:39:27.300251 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:39:27.300251 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:39:27.300251 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:39:27.300251 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:39:27.300251 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:39:27.300251 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:39:27.300251 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:39:27.303504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:39:27.303504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:39:27.303504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:39:27.303504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:39:27.303504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:39:27.303504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:39:27.303504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:39:27.303504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:39:27.303504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:39:27.303504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:39:27.303504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:39:27.303504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:39:27.303504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:39:27.303504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:39:27.303504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:39:27.303504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:39:27.303504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:39:27.304447 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:39:27.304447 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:39:27.304447 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:39:27.304447 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:39:27.304447 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 598/1210] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:39:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:39:27.307176 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd403960-8ad2-4908-9bbc-680fa5a66050 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:27.404846 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:27.407764 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd403960-8ad2-4908-9bbc-680fa5a66050 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:27.441446 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e4dc3-a38f-4a3a-bf67-dded2906690c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:27.442096 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e4dc3-a38f-4a3a-bf67-dded2906690c None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:27.442377 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e4dc3-a38f-4a3a-bf67-dded2906690c None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:27.442650 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e4dc3-a38f-4a3a-bf67-dded2906690c None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:27.443361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e4dc3-a38f-4a3a-bf67-dded2906690c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:27.443697 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e4dc3-a38f-4a3a-bf67-dded2906690c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:27.445054 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e4dc3-a38f-4a3a-bf67-dded2906690c None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:27.456507 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 613/1211] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:27.461919 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c543545-52e4-41df-bdb3-3932c0248f23 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:27.560869 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c543545-52e4-41df-bdb3-3932c0248f23 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:27.562421 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:27.595061 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d48bfa-46cd-4cc5-bb3d-d1a9d8297f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:27.595871 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d48bfa-46cd-4cc5-bb3d-d1a9d8297f62 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:27.596210 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d48bfa-46cd-4cc5-bb3d-d1a9d8297f62 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:27.596476 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d48bfa-46cd-4cc5-bb3d-d1a9d8297f62 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:27.604730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d48bfa-46cd-4cc5-bb3d-d1a9d8297f62 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:27.610098 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d48bfa-46cd-4cc5-bb3d-d1a9d8297f62 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:27.620717 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-c7d48bfa-46cd-4cc5-bb3d-d1a9d8297f62 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 15:39:27.620717 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:39:27.620717 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:39:27.620717 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:39:27.620717 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:39:27.620717 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:39:27.620717 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:39:27.620717 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:39:27.620717 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:39:27.620717 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:39:27.620717 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:39:27.620717 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:39:27.620717 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:39:27.620717 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:39:27.620717 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:39:27.620717 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:39:27.621893 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:39:27.621893 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:39:27.621893 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:39:27.621893 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:39:27.621893 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:39:27.621893 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:39:27.621893 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:39:27.621893 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:39:27.621893 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:39:27.621893 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:39:27.621893 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:39:27.621893 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:39:27.621893 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:39:27.621893 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:39:27.621893 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:39:27.621893 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:39:27.621893 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:39:27.621893 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:39:27.623088 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:39:27.623088 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:39:27.623088 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:39:27.623088 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:39:27.623088 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:39:27.623088 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:39:27.623088 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:39:27.623088 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:39:27.623088 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 15:39:27.623088 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:39:27.623088 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 599/1212] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:39:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:39:27.628579 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e4dc3-a38f-4a3a-bf67-dded2906690c None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:27.726899 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e4dc3-a38f-4a3a-bf67-dded2906690c None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:27.761152 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdda54a-2ba4-4f7a-b12b-fc8852021996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:27.761816 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdda54a-2ba4-4f7a-b12b-fc8852021996 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:27.762102 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdda54a-2ba4-4f7a-b12b-fc8852021996 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:27.762383 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdda54a-2ba4-4f7a-b12b-fc8852021996 None admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:27.763205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdda54a-2ba4-4f7a-b12b-fc8852021996 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:27.763514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdda54a-2ba4-4f7a-b12b-fc8852021996 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:27.764963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdda54a-2ba4-4f7a-b12b-fc8852021996 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:27.782068 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 614/1213] 10.222.0.39 () {56 vars in 1143 bytes} [Mon May 23 15:39:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:27.793648 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d48bfa-46cd-4cc5-bb3d-d1a9d8297f62 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:27.889928 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d48bfa-46cd-4cc5-bb3d-d1a9d8297f62 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:27.925812 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61d6b5-d2dd-480b-b131-f9ee970f4b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:27.926466 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61d6b5-d2dd-480b-b131-f9ee970f4b59 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:27.926753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61d6b5-d2dd-480b-b131-f9ee970f4b59 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:27.927028 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61d6b5-d2dd-480b-b131-f9ee970f4b59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:27.957820 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:27.995946 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61d6b5-d2dd-480b-b131-f9ee970f4b59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:27.997459 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61d6b5-d2dd-480b-b131-f9ee970f4b59 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:28.097806 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 600/1214] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:39:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:39:28.104125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdda54a-2ba4-4f7a-b12b-fc8852021996 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:28.124226 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:28.204771 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdda54a-2ba4-4f7a-b12b-fc8852021996 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:28.242308 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed4266-6fbc-4ebd-afee-296334dc964b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:28.243097 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed4266-6fbc-4ebd-afee-296334dc964b None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:28.243381 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed4266-6fbc-4ebd-afee-296334dc964b None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:28.243686 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed4266-6fbc-4ebd-afee-296334dc964b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:28.253606 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed4266-6fbc-4ebd-afee-296334dc964b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:28.255127 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed4266-6fbc-4ebd-afee-296334dc964b None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:28.273105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-d7ed4266-6fbc-4ebd-afee-296334dc964b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:39:28.273105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:39:28.273105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:39:28.273105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:39:28.273105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:39:28.273105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:39:28.273105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:39:28.273105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:39:28.273105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:39:28.273105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:39:28.273105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:39:28.273105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:39:28.273105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:39:28.273105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:39:28.273105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:39:28.274250 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:39:28.274250 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:39:28.274250 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:39:28.274250 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:39:28.274250 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:39:28.274250 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:39:28.274250 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:39:28.274250 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:39:28.274250 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:39:28.274250 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:39:28.274250 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:39:28.274250 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:39:28.274250 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:39:28.274250 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:39:28.274250 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:39:28.274250 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:39:28.274250 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:39:28.275369 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:39:28.275369 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:39:28.275369 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:39:28.275369 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:39:28.275369 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 615/1215] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:39:28.280134 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61d6b5-d2dd-480b-b131-f9ee970f4b59 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:28.343069 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:28.381189 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61d6b5-d2dd-480b-b131-f9ee970f4b59 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:28.413423 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9df2bd-fe8f-430b-9fa8-7031c983d303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:28.414124 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9df2bd-fe8f-430b-9fa8-7031c983d303 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:28.414406 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9df2bd-fe8f-430b-9fa8-7031c983d303 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:28.414676 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9df2bd-fe8f-430b-9fa8-7031c983d303 None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:28.415415 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9df2bd-fe8f-430b-9fa8-7031c983d303 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:28.415751 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9df2bd-fe8f-430b-9fa8-7031c983d303 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:28.417112 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9df2bd-fe8f-430b-9fa8-7031c983d303 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:28.428518 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 601/1216] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:28.434119 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed4266-6fbc-4ebd-afee-296334dc964b None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:28.504573 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:28.535206 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed4266-6fbc-4ebd-afee-296334dc964b None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:28.568327 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d79e33-24b0-4ff4-b9dc-ac83fe5240c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:28.569107 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d79e33-24b0-4ff4-b9dc-ac83fe5240c1 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:28.569393 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d79e33-24b0-4ff4-b9dc-ac83fe5240c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:28.569668 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d79e33-24b0-4ff4-b9dc-ac83fe5240c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:28.576114 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d79e33-24b0-4ff4-b9dc-ac83fe5240c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:28.577552 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d79e33-24b0-4ff4-b9dc-ac83fe5240c1 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:28.591044 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-22d79e33-24b0-4ff4-b9dc-ac83fe5240c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:39:28.591044 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:39:28.591044 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:39:28.591044 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:39:28.591044 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:39:28.591044 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:39:28.591044 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:39:28.591044 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:39:28.591044 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:39:28.591044 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:39:28.591044 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:39:28.591044 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:39:28.591044 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:39:28.591044 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:39:28.591044 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:39:28.597608 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:39:28.597608 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:39:28.597608 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:39:28.597608 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:39:28.597608 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:39:28.597608 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:39:28.597608 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:39:28.597608 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:39:28.597608 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:39:28.597608 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:39:28.597608 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:39:28.597608 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:39:28.597608 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:39:28.597608 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:39:28.597608 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:39:28.597608 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:39:28.597608 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:39:28.598727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:39:28.598727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:39:28.598727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:39:28.598727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:39:28.598727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:39:28.598727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:39:28.598727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:39:28.598727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:39:28.598727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 616/1217] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:39:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:39:28.599635 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9df2bd-fe8f-430b-9fa8-7031c983d303 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:28.700386 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9df2bd-fe8f-430b-9fa8-7031c983d303 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:28.722820 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:28.734133 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd6a71-e815-474f-b5c8-9f52c86d8632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:28.734783 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd6a71-e815-474f-b5c8-9f52c86d8632 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:28.735064 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd6a71-e815-474f-b5c8-9f52c86d8632 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:28.735337 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd6a71-e815-474f-b5c8-9f52c86d8632 None admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:28.736187 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd6a71-e815-474f-b5c8-9f52c86d8632 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:28.736493 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd6a71-e815-474f-b5c8-9f52c86d8632 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:28.738445 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd6a71-e815-474f-b5c8-9f52c86d8632 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:28.750090 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 602/1218] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:39:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:28.756644 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d79e33-24b0-4ff4-b9dc-ac83fe5240c1 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:28.859201 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d79e33-24b0-4ff4-b9dc-ac83fe5240c1 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:28.887463 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:28.893942 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e854a1-2391-407c-bed9-355e397da8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:28.894902 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e854a1-2391-407c-bed9-355e397da8f7 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:28.895194 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e854a1-2391-407c-bed9-355e397da8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:28.895469 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e854a1-2391-407c-bed9-355e397da8f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:28.896368 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e854a1-2391-407c-bed9-355e397da8f7 None admin] RBAC: Adding query filter params (role.id=b57c4ebab8e842088df37b551053b113, scope.project.id=8addb03b903842609168ee2fafc8ec6b, user.id=84f06d35d7cc48658262bf79d9c72280) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:28.896683 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e854a1-2391-407c-bed9-355e397da8f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:28.898150 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e854a1-2391-407c-bed9-355e397da8f7 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:28.903462 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 617/1219] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:39:28 2022] GET /identity/v3/role_assignments?user.id=84f06d35d7cc48658262bf79d9c72280&scope.project.id=8addb03b903842609168ee2fafc8ec6b&role.id=b57c4ebab8e842088df37b551053b113 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:31.071343 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a242360-5cbf-4eaf-bca7-91a574f38422 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:31.071924 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a242360-5cbf-4eaf-bca7-91a574f38422 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:31.072020 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a242360-5cbf-4eaf-bca7-91a574f38422 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:31.073365 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 603/1220] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:39:31.078640 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696073e-e46b-4d83-a285-e176e9af7f36 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:31.079062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696073e-e46b-4d83-a285-e176e9af7f36 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:31.079197 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696073e-e46b-4d83-a285-e176e9af7f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:31.097116 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-8696073e-e46b-4d83-a285-e176e9af7f36 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:39:31.098262 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-8696073e-e46b-4d83-a285-e176e9af7f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:39:31.164595 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 618/1221] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:39:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:39:31.187367 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a242360-5cbf-4eaf-bca7-91a574f38422 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:31.290813 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a242360-5cbf-4eaf-bca7-91a574f38422 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:31.324217 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f313f-13f7-469a-a63d-47697b8c3708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:31.324939 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f313f-13f7-469a-a63d-47697b8c3708 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:31.325218 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f313f-13f7-469a-a63d-47697b8c3708 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:31.325489 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f313f-13f7-469a-a63d-47697b8c3708 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:31.335863 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f313f-13f7-469a-a63d-47697b8c3708 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:39:31.343367 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-254f313f-13f7-469a-a63d-47697b8c3708 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:39:31.343367 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:39:31.343367 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:39:31.343367 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:39:31.343367 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:39:31.343367 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:39:31.343367 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:39:31.343367 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:39:31.343367 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:39:31.343367 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:39:31.343367 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:39:31.343367 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:39:31.343367 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:39:31.343367 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:39:31.343367 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:39:31.343367 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:39:31.344459 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:39:31.344459 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:39:31.344459 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:39:31.344459 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:39:31.344459 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:39:31.344459 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:39:31.344459 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:39:31.344459 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:39:31.344459 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:39:31.344459 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:39:31.344459 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:39:31.344459 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:39:31.344459 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:39:31.344459 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:39:31.344459 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:39:31.344459 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:39:31.345350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:39:31.345350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:39:31.345350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:39:31.345350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:39:31.345350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:39:31.345350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:39:31.345350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:39:31.345350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:39:31.345350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:39:31.345350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:39:31.345350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:39:31.345350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:39:31.345350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 604/1222] 10.222.0.39 () {56 vars in 1102 bytes} [Mon May 23 15:39:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:39:31.351495 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696073e-e46b-4d83-a285-e176e9af7f36 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:31.447266 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696073e-e46b-4d83-a285-e176e9af7f36 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:31.470369 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:31.483350 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c4664-721a-4e04-a79c-1cbee3037616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:31.484477 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c4664-721a-4e04-a79c-1cbee3037616 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:31.484982 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c4664-721a-4e04-a79c-1cbee3037616 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:31.485483 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c4664-721a-4e04-a79c-1cbee3037616 None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:31.486721 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c4664-721a-4e04-a79c-1cbee3037616 None admin] RBAC: Adding query filter params (name=service) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:31.487033 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c4664-721a-4e04-a79c-1cbee3037616 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:31.488431 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c4664-721a-4e04-a79c-1cbee3037616 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:31.497362 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 619/1223] 10.222.0.39 () {56 vars in 1103 bytes} [Mon May 23 15:39:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:31.504108 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f313f-13f7-469a-a63d-47697b8c3708 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:31.546836 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:31.602422 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f313f-13f7-469a-a63d-47697b8c3708 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:31.635738 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed5f0e-a5ac-4fd3-a74f-2660d82ca1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:31.636522 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed5f0e-a5ac-4fd3-a74f-2660d82ca1fe None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:31.638597 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed5f0e-a5ac-4fd3-a74f-2660d82ca1fe None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:31.638597 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed5f0e-a5ac-4fd3-a74f-2660d82ca1fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:31.648821 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed5f0e-a5ac-4fd3-a74f-2660d82ca1fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:31.650255 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed5f0e-a5ac-4fd3-a74f-2660d82ca1fe None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:31.666916 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-93ed5f0e-a5ac-4fd3-a74f-2660d82ca1fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:39:31.666916 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:39:31.666916 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:39:31.666916 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:39:31.666916 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:39:31.666916 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:39:31.666916 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:39:31.666916 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:39:31.666916 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:39:31.666916 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:39:31.666916 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:39:31.666916 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:39:31.666916 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:39:31.666916 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:39:31.666916 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:39:31.667886 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:39:31.667886 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:39:31.667886 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:39:31.667886 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:39:31.667886 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:39:31.667886 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:39:31.667886 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:39:31.667886 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:39:31.667886 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:39:31.667886 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:39:31.667886 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:39:31.667886 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:39:31.667886 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:39:31.667886 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:39:31.667886 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:39:31.667886 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:39:31.667886 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:39:31.668808 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:39:31.668808 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:39:31.668808 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:39:31.668808 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:39:31.668808 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 605/1224] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:39:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:39:31.674042 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c4664-721a-4e04-a79c-1cbee3037616 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:31.773544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c4664-721a-4e04-a79c-1cbee3037616 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:31.808359 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343befd-482d-48dd-b66b-4b65ff1c6ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:31.809014 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343befd-482d-48dd-b66b-4b65ff1c6ba4 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:31.809293 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343befd-482d-48dd-b66b-4b65ff1c6ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:31.809570 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343befd-482d-48dd-b66b-4b65ff1c6ba4 None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:31.810288 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343befd-482d-48dd-b66b-4b65ff1c6ba4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:31.810590 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343befd-482d-48dd-b66b-4b65ff1c6ba4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:31.812078 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343befd-482d-48dd-b66b-4b65ff1c6ba4 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:31.824620 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 620/1225] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:31.830941 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed5f0e-a5ac-4fd3-a74f-2660d82ca1fe None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:31.923129 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:31.929735 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed5f0e-a5ac-4fd3-a74f-2660d82ca1fe None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:31.962693 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655ae03-c37c-4c6d-947f-f6be7495a932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:31.963803 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655ae03-c37c-4c6d-947f-f6be7495a932 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:31.964251 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655ae03-c37c-4c6d-947f-f6be7495a932 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:31.964881 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655ae03-c37c-4c6d-947f-f6be7495a932 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:31.973199 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5655ae03-c37c-4c6d-947f-f6be7495a932 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:31.974945 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5655ae03-c37c-4c6d-947f-f6be7495a932 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:31.988953 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-5655ae03-c37c-4c6d-947f-f6be7495a932 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 15:39:31.988953 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:39:31.988953 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:39:31.988953 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:39:31.988953 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:39:31.988953 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:39:31.988953 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:39:31.988953 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:39:31.988953 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:39:31.988953 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:39:31.988953 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:39:31.988953 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:39:31.988953 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:39:31.988953 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:39:31.988953 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:39:31.988953 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:39:31.990073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:39:31.990073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:39:31.990073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:39:31.990073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:39:31.990073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:39:31.990073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:39:31.990073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:39:31.990073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:39:31.990073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:39:31.990073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:39:31.990073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:39:31.990073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:39:31.990073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:39:31.990073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:39:31.990073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:39:31.990073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:39:31.990073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:39:31.990073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:39:31.991429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:39:31.991429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:39:31.991429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:39:31.991429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:39:31.991429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:39:31.991429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:39:31.991429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:39:31.991429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:39:31.991429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 15:39:31.991429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:39:31.991429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 606/1226] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:39:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:39:31.996310 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343befd-482d-48dd-b66b-4b65ff1c6ba4 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:32.044346 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:32.094830 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343befd-482d-48dd-b66b-4b65ff1c6ba4 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:32.128424 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7669a-fb96-44e6-bb92-9a110d2cfa02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:32.129078 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7669a-fb96-44e6-bb92-9a110d2cfa02 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:32.129358 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7669a-fb96-44e6-bb92-9a110d2cfa02 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:32.129622 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7669a-fb96-44e6-bb92-9a110d2cfa02 None admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:32.130446 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7669a-fb96-44e6-bb92-9a110d2cfa02 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:32.130752 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7669a-fb96-44e6-bb92-9a110d2cfa02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:32.132199 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7669a-fb96-44e6-bb92-9a110d2cfa02 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:32.150724 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 621/1227] 10.222.0.39 () {56 vars in 1143 bytes} [Mon May 23 15:39:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:32.156493 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655ae03-c37c-4c6d-947f-f6be7495a932 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:32.257283 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655ae03-c37c-4c6d-947f-f6be7495a932 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:32.290269 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5607d-4ce1-4780-926b-f0ee83c852ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:32.291049 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5607d-4ce1-4780-926b-f0ee83c852ba None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:32.291330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5607d-4ce1-4780-926b-f0ee83c852ba None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:32.291631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5607d-4ce1-4780-926b-f0ee83c852ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:32.302190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5607d-4ce1-4780-926b-f0ee83c852ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:32.303798 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5607d-4ce1-4780-926b-f0ee83c852ba None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:32.320883 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-b2c5607d-4ce1-4780-926b-f0ee83c852ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:39:32.320883 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:39:32.320883 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:39:32.320883 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:39:32.320883 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:39:32.320883 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:39:32.320883 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:39:32.320883 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:39:32.320883 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:39:32.320883 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:39:32.320883 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:39:32.320883 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:39:32.320883 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:39:32.320883 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:39:32.320883 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:39:32.321974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:39:32.321974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:39:32.321974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:39:32.321974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:39:32.321974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:39:32.321974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:39:32.321974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:39:32.321974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:39:32.321974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:39:32.321974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:39:32.321974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:39:32.321974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:39:32.321974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:39:32.321974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:39:32.321974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:39:32.321974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:39:32.321974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:39:32.322923 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:39:32.322923 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:39:32.322923 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:39:32.322923 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:39:32.322923 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 607/1228] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:39:32.328200 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7669a-fb96-44e6-bb92-9a110d2cfa02 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:32.428641 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7669a-fb96-44e6-bb92-9a110d2cfa02 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:32.430913 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:32.463159 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9d53c-5d4f-496b-a5f9-e888da94020b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:32.463804 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9d53c-5d4f-496b-a5f9-e888da94020b None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:32.464087 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9d53c-5d4f-496b-a5f9-e888da94020b None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:32.464360 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9d53c-5d4f-496b-a5f9-e888da94020b None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:32.465075 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9d53c-5d4f-496b-a5f9-e888da94020b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:32.465379 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9d53c-5d4f-496b-a5f9-e888da94020b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:32.466897 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9d53c-5d4f-496b-a5f9-e888da94020b None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:32.478949 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 622/1229] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:32.484587 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5607d-4ce1-4780-926b-f0ee83c852ba None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:32.493936 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:32.584270 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5607d-4ce1-4780-926b-f0ee83c852ba None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:32.618057 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b17ae-2e43-4e27-aed2-699c1321df1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:32.618896 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b17ae-2e43-4e27-aed2-699c1321df1d None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:32.619167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b17ae-2e43-4e27-aed2-699c1321df1d None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:32.619446 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b17ae-2e43-4e27-aed2-699c1321df1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:32.626213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b17ae-2e43-4e27-aed2-699c1321df1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:32.627748 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b17ae-2e43-4e27-aed2-699c1321df1d None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:32.644173 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-cd0b17ae-2e43-4e27-aed2-699c1321df1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:39:32.644173 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:39:32.644173 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:39:32.644173 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:39:32.644173 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:39:32.644173 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:39:32.644173 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:39:32.644173 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:39:32.644173 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:39:32.644173 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:39:32.644173 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:39:32.644173 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:39:32.644173 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:39:32.644173 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:39:32.644173 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:39:32.645505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:39:32.645505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:39:32.645505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:39:32.645505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:39:32.645505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:39:32.645505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:39:32.645505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:39:32.645505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:39:32.645505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:39:32.645505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:39:32.645505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:39:32.645505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:39:32.645505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:39:32.645505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:39:32.645505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:39:32.645505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:39:32.645505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:39:32.646390 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:39:32.646390 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:39:32.646390 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:39:32.646390 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:39:32.646390 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:39:32.646390 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:39:32.646390 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:39:32.646390 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:39:32.646390 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 608/1230] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:39:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:39:32.651775 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9d53c-5d4f-496b-a5f9-e888da94020b None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:32.756046 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9d53c-5d4f-496b-a5f9-e888da94020b None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:32.788091 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e18e65-fffb-4b82-800a-c8233abaf8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:32.788745 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e18e65-fffb-4b82-800a-c8233abaf8ce None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:32.789028 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e18e65-fffb-4b82-800a-c8233abaf8ce None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:32.789304 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e18e65-fffb-4b82-800a-c8233abaf8ce None admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:32.790083 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e18e65-fffb-4b82-800a-c8233abaf8ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:32.790393 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e18e65-fffb-4b82-800a-c8233abaf8ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:32.791844 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e18e65-fffb-4b82-800a-c8233abaf8ce None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:32.804200 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 623/1231] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:39:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:32.810197 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b17ae-2e43-4e27-aed2-699c1321df1d None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:32.876456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:32.911656 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b17ae-2e43-4e27-aed2-699c1321df1d None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:32.945110 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61081c22-ae45-420d-b4c4-35b84b6e9df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:32.946050 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61081c22-ae45-420d-b4c4-35b84b6e9df9 None admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:32.946313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61081c22-ae45-420d-b4c4-35b84b6e9df9 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:32.946586 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61081c22-ae45-420d-b4c4-35b84b6e9df9 None admin] PATH_INFO: `/v3/projects/8addb03b903842609168ee2fafc8ec6b/users/84f06d35d7cc48658262bf79d9c72280/roles/b57c4ebab8e842088df37b551053b113` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:32.961468 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61081c22-ae45-420d-b4c4-35b84b6e9df9 None admin] RBAC: Authorizing `identity:create_grant(project_id=8addb03b903842609168ee2fafc8ec6b, user_id=84f06d35d7cc48658262bf79d9c72280, role_id=b57c4ebab8e842088df37b551053b113)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:32.962933 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61081c22-ae45-420d-b4c4-35b84b6e9df9 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:33.038145 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 609/1232] 10.222.0.39 () {58 vars in 1439 bytes} [Mon May 23 15:39:32 2022] PUT /identity/v3/projects/8addb03b903842609168ee2fafc8ec6b/users/84f06d35d7cc48658262bf79d9c72280/roles/b57c4ebab8e842088df37b551053b113 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:39:35.197654 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e47a24-2a44-42ea-b342-eb5f3efce1cc None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:35.198175 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e47a24-2a44-42ea-b342-eb5f3efce1cc None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:35.198288 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e47a24-2a44-42ea-b342-eb5f3efce1cc None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:35.199588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 624/1233] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:39:35.204920 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182d156-e1c0-48a8-a15d-ac0d0935d07e None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:35.205370 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182d156-e1c0-48a8-a15d-ac0d0935d07e None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:35.205496 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182d156-e1c0-48a8-a15d-ac0d0935d07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:35.223580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-a182d156-e1c0-48a8-a15d-ac0d0935d07e None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:39:35.225057 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-a182d156-e1c0-48a8-a15d-ac0d0935d07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:39:35.290736 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 610/1234] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:39:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:39:35.314380 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e47a24-2a44-42ea-b342-eb5f3efce1cc None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:35.339556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:35.413960 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e47a24-2a44-42ea-b342-eb5f3efce1cc None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:35.448260 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adedcb8-4ba6-43de-b01d-3d1ca5e33ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:35.448947 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adedcb8-4ba6-43de-b01d-3d1ca5e33ea4 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:35.449228 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adedcb8-4ba6-43de-b01d-3d1ca5e33ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:35.449502 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adedcb8-4ba6-43de-b01d-3d1ca5e33ea4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:35.459825 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adedcb8-4ba6-43de-b01d-3d1ca5e33ea4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:39:35.467430 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-2adedcb8-4ba6-43de-b01d-3d1ca5e33ea4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:39:35.467430 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:39:35.467430 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:39:35.467430 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:39:35.467430 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:39:35.467430 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:39:35.467430 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:39:35.467430 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:39:35.467430 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:39:35.467430 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:39:35.467430 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:39:35.467430 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:39:35.467430 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:39:35.467430 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:39:35.467430 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:39:35.467430 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:39:35.468602 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:39:35.468602 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:39:35.468602 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:39:35.468602 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:39:35.468602 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:39:35.468602 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:39:35.468602 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:39:35.468602 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:39:35.468602 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:39:35.468602 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:39:35.468602 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:39:35.468602 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:39:35.468602 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:39:35.468602 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:39:35.468602 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:39:35.468602 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:39:35.469652 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:39:35.469652 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:39:35.469652 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:39:35.469652 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:39:35.469652 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:39:35.469652 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:39:35.469652 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:39:35.469652 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:39:35.469652 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:39:35.469652 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:39:35.469652 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:39:35.469652 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:39:35.469652 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 625/1235] 10.222.0.39 () {56 vars in 1102 bytes} [Mon May 23 15:39:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:39:35.475484 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182d156-e1c0-48a8-a15d-ac0d0935d07e None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:35.522702 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:35.573241 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182d156-e1c0-48a8-a15d-ac0d0935d07e None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:35.607533 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500b8a4-ca02-447c-abfb-f3215d985d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:35.608223 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500b8a4-ca02-447c-abfb-f3215d985d54 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:35.608510 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500b8a4-ca02-447c-abfb-f3215d985d54 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:35.608790 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500b8a4-ca02-447c-abfb-f3215d985d54 None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:35.609542 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500b8a4-ca02-447c-abfb-f3215d985d54 None admin] RBAC: Adding query filter params (name=service) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:35.609852 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500b8a4-ca02-447c-abfb-f3215d985d54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:35.611257 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500b8a4-ca02-447c-abfb-f3215d985d54 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:35.620134 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 611/1236] 10.222.0.39 () {56 vars in 1103 bytes} [Mon May 23 15:39:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:39:35.626018 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adedcb8-4ba6-43de-b01d-3d1ca5e33ea4 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:35.711840 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:35.728140 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adedcb8-4ba6-43de-b01d-3d1ca5e33ea4 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:35.760081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f47235-e18b-4059-9178-8f4f45bb35ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:35.760871 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f47235-e18b-4059-9178-8f4f45bb35ba None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:35.761153 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f47235-e18b-4059-9178-8f4f45bb35ba None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:35.761429 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f47235-e18b-4059-9178-8f4f45bb35ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:35.772285 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f47235-e18b-4059-9178-8f4f45bb35ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:35.773725 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f47235-e18b-4059-9178-8f4f45bb35ba None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:35.791017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-31f47235-e18b-4059-9178-8f4f45bb35ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:39:35.791017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:39:35.791017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:39:35.791017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:39:35.791017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:39:35.791017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:39:35.791017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:39:35.791017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:39:35.791017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:39:35.791017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:39:35.791017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:39:35.791017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:39:35.791017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:39:35.791017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:39:35.791017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:39:35.792145 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:39:35.792145 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:39:35.792145 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:39:35.792145 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:39:35.792145 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:39:35.792145 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:39:35.792145 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:39:35.792145 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:39:35.792145 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:39:35.792145 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:39:35.792145 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:39:35.792145 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:39:35.792145 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:39:35.792145 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:39:35.792145 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:39:35.792145 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:39:35.792145 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:39:35.793268 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:39:35.793268 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:39:35.793268 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:39:35.793268 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:39:35.793268 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 626/1237] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:39:35.798046 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500b8a4-ca02-447c-abfb-f3215d985d54 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:35.898376 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500b8a4-ca02-447c-abfb-f3215d985d54 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:35.907468 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:35.932512 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3196dd2a-00d4-471e-98d8-d62431a3e221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:35.933167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196dd2a-00d4-471e-98d8-d62431a3e221 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:35.933456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196dd2a-00d4-471e-98d8-d62431a3e221 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:35.933734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196dd2a-00d4-471e-98d8-d62431a3e221 None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:35.934497 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3196dd2a-00d4-471e-98d8-d62431a3e221 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:35.934804 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3196dd2a-00d4-471e-98d8-d62431a3e221 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:35.936215 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3196dd2a-00d4-471e-98d8-d62431a3e221 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:35.947549 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 612/1238] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:35.953216 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f47235-e18b-4059-9178-8f4f45bb35ba None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:36.054953 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f47235-e18b-4059-9178-8f4f45bb35ba None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:36.088077 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93df852-ee57-41b8-8439-2edc6d5c0897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:36.088869 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93df852-ee57-41b8-8439-2edc6d5c0897 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:36.089155 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93df852-ee57-41b8-8439-2edc6d5c0897 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:36.089450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93df852-ee57-41b8-8439-2edc6d5c0897 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:36.092180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:36.097107 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93df852-ee57-41b8-8439-2edc6d5c0897 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:36.099425 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93df852-ee57-41b8-8439-2edc6d5c0897 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:36.114135 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-f93df852-ee57-41b8-8439-2edc6d5c0897 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 15:39:36.114135 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:39:36.114135 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:39:36.114135 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:39:36.114135 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:39:36.114135 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:39:36.114135 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:39:36.114135 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:39:36.114135 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:39:36.114135 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:39:36.114135 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:39:36.114135 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:39:36.114135 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:39:36.114135 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:39:36.114135 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:39:36.114135 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:39:36.115267 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:39:36.115267 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:39:36.115267 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:39:36.115267 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:39:36.115267 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:39:36.115267 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:39:36.115267 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:39:36.115267 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:39:36.115267 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:39:36.115267 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:39:36.115267 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:39:36.115267 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:39:36.115267 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:39:36.115267 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:39:36.115267 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:39:36.115267 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:39:36.115267 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:39:36.115267 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:39:36.116480 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:39:36.116480 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:39:36.116480 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:39:36.116480 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:39:36.116480 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:39:36.116480 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:39:36.116480 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:39:36.116480 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:39:36.116480 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 15:39:36.116480 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:39:36.116480 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 627/1239] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:39:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:39:36.121200 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3196dd2a-00d4-471e-98d8-d62431a3e221 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:36.223337 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3196dd2a-00d4-471e-98d8-d62431a3e221 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:36.257255 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5fb32-859c-4e8c-9a31-190bf58f4043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:36.257909 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5fb32-859c-4e8c-9a31-190bf58f4043 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:36.258190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5fb32-859c-4e8c-9a31-190bf58f4043 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:36.258465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5fb32-859c-4e8c-9a31-190bf58f4043 None admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:36.259321 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5fb32-859c-4e8c-9a31-190bf58f4043 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:36.259696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5fb32-859c-4e8c-9a31-190bf58f4043 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:36.261065 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5fb32-859c-4e8c-9a31-190bf58f4043 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:36.279235 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 613/1240] 10.222.0.39 () {56 vars in 1143 bytes} [Mon May 23 15:39:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:36.286166 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93df852-ee57-41b8-8439-2edc6d5c0897 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:36.386717 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93df852-ee57-41b8-8439-2edc6d5c0897 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:36.420631 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84e731-3be9-4a52-a99a-41289bfbe09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:36.421262 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84e731-3be9-4a52-a99a-41289bfbe09a None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:36.421544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84e731-3be9-4a52-a99a-41289bfbe09a None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:36.421816 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84e731-3be9-4a52-a99a-41289bfbe09a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:36.482016 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:36.488611 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84e731-3be9-4a52-a99a-41289bfbe09a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:36.490173 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84e731-3be9-4a52-a99a-41289bfbe09a None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:36.587532 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 628/1241] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:39:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:39:36.593677 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5fb32-859c-4e8c-9a31-190bf58f4043 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:36.621283 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:36.694424 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5fb32-859c-4e8c-9a31-190bf58f4043 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:36.729905 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df372e-3a3a-48c3-ab19-3507e82a3ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:36.730686 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df372e-3a3a-48c3-ab19-3507e82a3ac4 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:36.730966 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df372e-3a3a-48c3-ab19-3507e82a3ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:36.731238 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df372e-3a3a-48c3-ab19-3507e82a3ac4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:36.741207 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df372e-3a3a-48c3-ab19-3507e82a3ac4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:36.742746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df372e-3a3a-48c3-ab19-3507e82a3ac4 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:36.760662 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-27df372e-3a3a-48c3-ab19-3507e82a3ac4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:39:36.760662 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:39:36.760662 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:39:36.760662 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:39:36.760662 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:39:36.760662 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:39:36.760662 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:39:36.760662 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:39:36.760662 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:39:36.760662 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:39:36.760662 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:39:36.760662 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:39:36.760662 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:39:36.760662 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:39:36.760662 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:39:36.761723 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:39:36.761723 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:39:36.761723 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:39:36.761723 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:39:36.761723 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:39:36.761723 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:39:36.761723 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:39:36.761723 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:39:36.761723 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:39:36.761723 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:39:36.761723 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:39:36.761723 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:39:36.761723 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:39:36.761723 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:39:36.761723 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:39:36.761723 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:39:36.761723 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:39:36.762996 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:39:36.762996 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:39:36.762996 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:39:36.762996 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:39:36.762996 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 614/1242] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:39:36.767614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84e731-3be9-4a52-a99a-41289bfbe09a None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:36.862700 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:36.868627 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84e731-3be9-4a52-a99a-41289bfbe09a None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:36.902383 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6261e95-858e-4cb4-be39-e8cf06c97e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:36.903045 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6261e95-858e-4cb4-be39-e8cf06c97e73 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:36.903388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6261e95-858e-4cb4-be39-e8cf06c97e73 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:36.903689 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6261e95-858e-4cb4-be39-e8cf06c97e73 None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:36.904419 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6261e95-858e-4cb4-be39-e8cf06c97e73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:36.904726 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6261e95-858e-4cb4-be39-e8cf06c97e73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:36.906107 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6261e95-858e-4cb4-be39-e8cf06c97e73 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:36.917916 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 629/1243] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:36.923546 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df372e-3a3a-48c3-ab19-3507e82a3ac4 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:37.002190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:37.024489 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df372e-3a3a-48c3-ab19-3507e82a3ac4 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:37.058524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558506bb-634d-44e8-bf6b-6c16cba89f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:37.059292 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558506bb-634d-44e8-bf6b-6c16cba89f64 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:37.059573 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558506bb-634d-44e8-bf6b-6c16cba89f64 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:37.059878 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558506bb-634d-44e8-bf6b-6c16cba89f64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:37.066444 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558506bb-634d-44e8-bf6b-6c16cba89f64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:37.068054 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558506bb-634d-44e8-bf6b-6c16cba89f64 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:37.082989 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-558506bb-634d-44e8-bf6b-6c16cba89f64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:39:37.082989 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:39:37.082989 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:39:37.082989 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:39:37.082989 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:39:37.082989 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:39:37.082989 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:39:37.082989 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:39:37.082989 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:39:37.082989 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:39:37.082989 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:39:37.082989 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:39:37.082989 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:39:37.082989 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:39:37.082989 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:39:37.084083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:39:37.084083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:39:37.084083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:39:37.084083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:39:37.084083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:39:37.084083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:39:37.084083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:39:37.084083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:39:37.084083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:39:37.084083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:39:37.084083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:39:37.084083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:39:37.084083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:39:37.084083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:39:37.084083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:39:37.084083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:39:37.084083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:39:37.085264 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:39:37.085264 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:39:37.085264 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:39:37.085264 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:39:37.085264 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:39:37.085264 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:39:37.085264 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:39:37.085264 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:39:37.085264 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 615/1244] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:39:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:39:37.090080 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6261e95-858e-4cb4-be39-e8cf06c97e73 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:37.190667 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6261e95-858e-4cb4-be39-e8cf06c97e73 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:37.228280 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b572a47-3a84-4d20-a81c-f55736a19c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:37.228940 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b572a47-3a84-4d20-a81c-f55736a19c34 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:37.229221 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b572a47-3a84-4d20-a81c-f55736a19c34 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:37.229490 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b572a47-3a84-4d20-a81c-f55736a19c34 None admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:37.230266 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b572a47-3a84-4d20-a81c-f55736a19c34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:37.230571 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b572a47-3a84-4d20-a81c-f55736a19c34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:37.232083 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b572a47-3a84-4d20-a81c-f55736a19c34 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:37.244046 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 630/1245] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:39:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:37.250243 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558506bb-634d-44e8-bf6b-6c16cba89f64 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:37.353450 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558506bb-634d-44e8-bf6b-6c16cba89f64 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:37.390374 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b36c31-43ba-443d-ad72-108adaab4b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:37.391017 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b36c31-43ba-443d-ad72-108adaab4b6c None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:37.391330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b36c31-43ba-443d-ad72-108adaab4b6c None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:37.391617 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b36c31-43ba-443d-ad72-108adaab4b6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:37.392449 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b36c31-43ba-443d-ad72-108adaab4b6c None admin] RBAC: Adding query filter params (role.id=b57c4ebab8e842088df37b551053b113, scope.project.id=8addb03b903842609168ee2fafc8ec6b, user.id=84f06d35d7cc48658262bf79d9c72280) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:37.392760 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b36c31-43ba-443d-ad72-108adaab4b6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:37.394812 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b36c31-43ba-443d-ad72-108adaab4b6c None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:37.400536 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 616/1246] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:39:37 2022] GET /identity/v3/role_assignments?user.id=84f06d35d7cc48658262bf79d9c72280&scope.project.id=8addb03b903842609168ee2fafc8ec6b&role.id=b57c4ebab8e842088df37b551053b113 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:39.635780 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c17b0a-fe71-4081-9484-52f5d065f387 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:39.636315 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c17b0a-fe71-4081-9484-52f5d065f387 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:39.636410 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c17b0a-fe71-4081-9484-52f5d065f387 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:39.637746 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 631/1247] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:39:39.643034 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfee89-b134-40e5-a4c1-eee85794ccb3 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:39.643458 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfee89-b134-40e5-a4c1-eee85794ccb3 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:39.643590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfee89-b134-40e5-a4c1-eee85794ccb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:39.648648 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:39.661022 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-4ecfee89-b134-40e5-a4c1-eee85794ccb3 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:39:39.662197 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-4ecfee89-b134-40e5-a4c1-eee85794ccb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:39:39.727080 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 617/1248] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:39:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:39:39.751013 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c17b0a-fe71-4081-9484-52f5d065f387 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:39.769332 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:39.852440 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c17b0a-fe71-4081-9484-52f5d065f387 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:39.886875 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef1d5d-43aa-49f5-b3f7-b4abae0184bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:39.887591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef1d5d-43aa-49f5-b3f7-b4abae0184bd None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:39.887899 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef1d5d-43aa-49f5-b3f7-b4abae0184bd None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:39.888171 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef1d5d-43aa-49f5-b3f7-b4abae0184bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:39.899002 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef1d5d-43aa-49f5-b3f7-b4abae0184bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:39:39.906972 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-59ef1d5d-43aa-49f5-b3f7-b4abae0184bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:39:39.906972 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:39:39.906972 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:39:39.906972 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:39:39.906972 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:39:39.906972 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:39:39.906972 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:39:39.906972 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:39:39.906972 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:39:39.906972 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:39:39.906972 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:39:39.906972 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:39:39.906972 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:39:39.906972 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:39:39.906972 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:39:39.906972 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:39:39.908094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:39:39.908094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:39:39.908094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:39:39.908094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:39:39.908094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:39:39.908094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:39:39.908094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:39:39.908094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:39:39.908094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:39:39.908094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:39:39.908094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:39:39.908094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:39:39.908094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:39:39.908094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:39:39.908094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:39:39.908094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:39:39.909206 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:39:39.909206 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:39:39.909206 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:39:39.909206 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:39:39.909206 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:39:39.909206 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:39:39.909206 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:39:39.909206 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:39:39.909206 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:39:39.909206 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:39:39.909206 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:39:39.909206 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:39:39.909206 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 632/1249] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:39:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:39:39.915340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecfee89-b134-40e5-a4c1-eee85794ccb3 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:40.014028 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecfee89-b134-40e5-a4c1-eee85794ccb3 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:40.045086 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:40.049813 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28576679-3a6c-4b83-9722-368e7a0a5cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:40.050480 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28576679-3a6c-4b83-9722-368e7a0a5cf6 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:40.050766 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28576679-3a6c-4b83-9722-368e7a0a5cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:40.051048 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28576679-3a6c-4b83-9722-368e7a0a5cf6 None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:40.051838 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28576679-3a6c-4b83-9722-368e7a0a5cf6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:40.052137 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28576679-3a6c-4b83-9722-368e7a0a5cf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:40.053559 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28576679-3a6c-4b83-9722-368e7a0a5cf6 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:40.061557 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 618/1250] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:39:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:40.067742 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef1d5d-43aa-49f5-b3f7-b4abae0184bd None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:40.148171 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:40.170209 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef1d5d-43aa-49f5-b3f7-b4abae0184bd None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:40.203260 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642c13b-0d15-4d41-a18b-aacd93b89e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:40.204079 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642c13b-0d15-4d41-a18b-aacd93b89e56 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:40.204365 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642c13b-0d15-4d41-a18b-aacd93b89e56 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:40.204640 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642c13b-0d15-4d41-a18b-aacd93b89e56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:40.216128 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642c13b-0d15-4d41-a18b-aacd93b89e56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:40.217579 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642c13b-0d15-4d41-a18b-aacd93b89e56 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:40.235945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-b642c13b-0d15-4d41-a18b-aacd93b89e56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:39:40.235945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:39:40.235945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:39:40.235945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:39:40.235945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:39:40.235945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:39:40.235945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:39:40.235945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:39:40.235945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:39:40.235945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:39:40.235945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:39:40.235945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:39:40.235945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:39:40.235945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:39:40.235945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:39:40.238388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:39:40.238388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:39:40.238388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:39:40.238388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:39:40.238388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:39:40.238388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:39:40.238388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:39:40.238388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:39:40.238388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:39:40.238388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:39:40.238388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:39:40.238388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:39:40.238388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:39:40.238388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:39:40.238388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:39:40.238388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:39:40.238388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:39:40.239473 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:39:40.239473 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:39:40.239473 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:39:40.239473 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:39:40.239473 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 633/1251] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:39:40.242913 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28576679-3a6c-4b83-9722-368e7a0a5cf6 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:40.344506 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28576679-3a6c-4b83-9722-368e7a0a5cf6 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:40.377869 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b57061-c38d-4b83-a610-8ac5f6cb9ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:40.379124 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b57061-c38d-4b83-a610-8ac5f6cb9ac1 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:40.379480 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b57061-c38d-4b83-a610-8ac5f6cb9ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:40.379790 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b57061-c38d-4b83-a610-8ac5f6cb9ac1 None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:40.380511 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b57061-c38d-4b83-a610-8ac5f6cb9ac1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:40.380819 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b57061-c38d-4b83-a610-8ac5f6cb9ac1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:40.382187 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b57061-c38d-4b83-a610-8ac5f6cb9ac1 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:40.393732 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 619/1252] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:40.399517 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642c13b-0d15-4d41-a18b-aacd93b89e56 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:40.499559 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642c13b-0d15-4d41-a18b-aacd93b89e56 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:40.525042 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:40.532642 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0925d8-d6e7-4cc7-aa2c-70e80ec48bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:40.533435 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0925d8-d6e7-4cc7-aa2c-70e80ec48bad None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:40.533724 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0925d8-d6e7-4cc7-aa2c-70e80ec48bad None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:40.534003 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0925d8-d6e7-4cc7-aa2c-70e80ec48bad None admin] PATH_INFO: `/v3/users/placement` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:40.541994 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0925d8-d6e7-4cc7-aa2c-70e80ec48bad None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:40.543430 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0925d8-d6e7-4cc7-aa2c-70e80ec48bad None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:40.558047 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-0a0925d8-d6e7-4cc7-aa2c-70e80ec48bad None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 15:39:40.558047 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:39:40.558047 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:39:40.558047 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:39:40.558047 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:39:40.558047 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:39:40.558047 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:39:40.558047 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:39:40.558047 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:39:40.558047 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:39:40.558047 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:39:40.558047 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:39:40.558047 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:39:40.558047 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:39:40.558047 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:39:40.558047 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:39:40.559074 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:39:40.559074 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:39:40.559074 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:39:40.559074 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:39:40.559074 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:39:40.559074 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:39:40.559074 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:39:40.559074 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:39:40.559074 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:39:40.559074 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:39:40.559074 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:39:40.559074 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:39:40.559074 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:39:40.559074 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:39:40.559074 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:39:40.559074 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:39:40.559074 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:39:40.559074 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:39:40.560245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:39:40.560245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:39:40.560245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:39:40.560245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:39:40.560245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:39:40.560245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:39:40.560245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:39:40.560245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:39:40.560245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 15:39:40.560245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:39:40.560245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 634/1253] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:39:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:39:40.565364 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b57061-c38d-4b83-a610-8ac5f6cb9ac1 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:40.619340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:40.662141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b57061-c38d-4b83-a610-8ac5f6cb9ac1 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:40.696316 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a8e02-212d-4fd0-a564-c7f81aa2f4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:40.696976 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a8e02-212d-4fd0-a564-c7f81aa2f4d2 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:40.697255 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a8e02-212d-4fd0-a564-c7f81aa2f4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:40.697524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a8e02-212d-4fd0-a564-c7f81aa2f4d2 None admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:40.698342 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a8e02-212d-4fd0-a564-c7f81aa2f4d2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:40.698649 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a8e02-212d-4fd0-a564-c7f81aa2f4d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:40.700220 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a8e02-212d-4fd0-a564-c7f81aa2f4d2 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:40.717258 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 620/1254] 10.222.0.39 () {56 vars in 1143 bytes} [Mon May 23 15:39:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:40.723499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0925d8-d6e7-4cc7-aa2c-70e80ec48bad None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:40.823087 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0925d8-d6e7-4cc7-aa2c-70e80ec48bad None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:40.856548 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28a489-6d4a-45f8-8acb-b525bf34a9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:40.857182 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28a489-6d4a-45f8-8acb-b525bf34a9d3 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:40.857463 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28a489-6d4a-45f8-8acb-b525bf34a9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:40.857736 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28a489-6d4a-45f8-8acb-b525bf34a9d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:40.912025 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:40.923884 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28a489-6d4a-45f8-8acb-b525bf34a9d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:40.925824 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28a489-6d4a-45f8-8acb-b525bf34a9d3 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:41.019960 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 635/1255] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:39:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:39:41.025754 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a8e02-212d-4fd0-a564-c7f81aa2f4d2 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:41.124478 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a8e02-212d-4fd0-a564-c7f81aa2f4d2 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:41.137969 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:41.158382 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119d536-a73a-4f54-99ca-a6a6b1f4f17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:41.159170 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119d536-a73a-4f54-99ca-a6a6b1f4f17d None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:41.159458 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119d536-a73a-4f54-99ca-a6a6b1f4f17d None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:41.160267 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119d536-a73a-4f54-99ca-a6a6b1f4f17d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:41.170023 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119d536-a73a-4f54-99ca-a6a6b1f4f17d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:41.171470 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119d536-a73a-4f54-99ca-a6a6b1f4f17d None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:41.188697 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-0119d536-a73a-4f54-99ca-a6a6b1f4f17d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:39:41.188697 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:39:41.188697 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:39:41.188697 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:39:41.188697 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:39:41.188697 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:39:41.188697 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:39:41.188697 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:39:41.188697 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:39:41.188697 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:39:41.188697 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:39:41.188697 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:39:41.188697 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:39:41.188697 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:39:41.188697 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:39:41.189769 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:39:41.189769 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:39:41.189769 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:39:41.189769 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:39:41.189769 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:39:41.189769 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:39:41.189769 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:39:41.189769 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:39:41.189769 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:39:41.189769 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:39:41.189769 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:39:41.189769 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:39:41.189769 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:39:41.189769 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:39:41.189769 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:39:41.189769 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:39:41.189769 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:39:41.191487 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:39:41.191487 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:39:41.191487 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:39:41.191487 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:39:41.191487 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 621/1256] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:39:41.196181 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28a489-6d4a-45f8-8acb-b525bf34a9d3 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:41.283723 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:41.295089 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28a489-6d4a-45f8-8acb-b525bf34a9d3 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:41.328253 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6705861-e6a6-44bf-a07b-a627d90da9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:41.328907 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6705861-e6a6-44bf-a07b-a627d90da9ce None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:41.329190 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6705861-e6a6-44bf-a07b-a627d90da9ce None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:41.329466 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6705861-e6a6-44bf-a07b-a627d90da9ce None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:41.330182 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6705861-e6a6-44bf-a07b-a627d90da9ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:41.330489 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6705861-e6a6-44bf-a07b-a627d90da9ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:41.332697 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6705861-e6a6-44bf-a07b-a627d90da9ce None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:41.344153 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 636/1257] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:41.350201 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119d536-a73a-4f54-99ca-a6a6b1f4f17d None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:41.448280 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119d536-a73a-4f54-99ca-a6a6b1f4f17d None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:41.481381 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8fba0-56ce-4bc9-a852-27bb8cf497d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:41.482170 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8fba0-56ce-4bc9-a852-27bb8cf497d3 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:41.482446 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8fba0-56ce-4bc9-a852-27bb8cf497d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:41.482716 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8fba0-56ce-4bc9-a852-27bb8cf497d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:41.489140 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8fba0-56ce-4bc9-a852-27bb8cf497d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:41.492263 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8fba0-56ce-4bc9-a852-27bb8cf497d3 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:41.504472 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-30a8fba0-56ce-4bc9-a852-27bb8cf497d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:39:41.504472 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:39:41.504472 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:39:41.504472 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:39:41.504472 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:39:41.504472 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:39:41.504472 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:39:41.504472 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:39:41.504472 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:39:41.504472 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:39:41.504472 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:39:41.504472 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:39:41.504472 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:39:41.504472 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:39:41.504472 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:39:41.505614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:39:41.505614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:39:41.505614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:39:41.505614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:39:41.505614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:39:41.505614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:39:41.505614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:39:41.505614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:39:41.505614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:39:41.505614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:39:41.505614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:39:41.505614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:39:41.505614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:39:41.505614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:39:41.505614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:39:41.505614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:39:41.505614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:39:41.506574 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:39:41.506574 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:39:41.506574 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:39:41.506574 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:39:41.506574 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:39:41.506574 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:39:41.506574 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:39:41.506574 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:39:41.506574 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 622/1258] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:39:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:39:41.512247 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6705861-e6a6-44bf-a07b-a627d90da9ce None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:41.612586 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6705861-e6a6-44bf-a07b-a627d90da9ce None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:41.650903 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4dd99e-b39d-46b4-9e4b-f5e2dbc28465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:41.651563 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4dd99e-b39d-46b4-9e4b-f5e2dbc28465 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:41.651881 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4dd99e-b39d-46b4-9e4b-f5e2dbc28465 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:41.652161 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4dd99e-b39d-46b4-9e4b-f5e2dbc28465 None admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:41.652981 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4dd99e-b39d-46b4-9e4b-f5e2dbc28465 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:41.653294 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4dd99e-b39d-46b4-9e4b-f5e2dbc28465 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:41.654731 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4dd99e-b39d-46b4-9e4b-f5e2dbc28465 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:41.667180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 637/1259] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:39:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:41.673239 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8fba0-56ce-4bc9-a852-27bb8cf497d3 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:41.704518 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:41.774871 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8fba0-56ce-4bc9-a852-27bb8cf497d3 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:41.808242 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a505ce-7444-4f49-a3d2-706eded598a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:41.808873 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a505ce-7444-4f49-a3d2-706eded598a8 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:41.809215 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a505ce-7444-4f49-a3d2-706eded598a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:41.809492 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a505ce-7444-4f49-a3d2-706eded598a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:41.810304 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a505ce-7444-4f49-a3d2-706eded598a8 None admin] RBAC: Adding query filter params (role.id=3ab888f5f68740bd8f9df4447f4f5a7a, scope.project.id=8addb03b903842609168ee2fafc8ec6b, user.id=84f06d35d7cc48658262bf79d9c72280) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:41.810617 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a505ce-7444-4f49-a3d2-706eded598a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:41.812074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a505ce-7444-4f49-a3d2-706eded598a8 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:41.819329 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 623/1260] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:39:41 2022] GET /identity/v3/role_assignments?user.id=84f06d35d7cc48658262bf79d9c72280&scope.project.id=8addb03b903842609168ee2fafc8ec6b&role.id=3ab888f5f68740bd8f9df4447f4f5a7a => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:39:43.972574 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af85136-e9f9-4b78-92ed-04b8b3dad54f None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:43.973163 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af85136-e9f9-4b78-92ed-04b8b3dad54f None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:43.973163 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af85136-e9f9-4b78-92ed-04b8b3dad54f None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:43.975058 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 638/1261] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:39:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:39:43.980056 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3955e2-5efe-4849-a524-e80ac3db5496 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:43.980514 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3955e2-5efe-4849-a524-e80ac3db5496 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:43.984027 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3955e2-5efe-4849-a524-e80ac3db5496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:43.997442 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-2e3955e2-5efe-4849-a524-e80ac3db5496 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:39:43.998600 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-2e3955e2-5efe-4849-a524-e80ac3db5496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:39:44.062883 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 624/1262] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:39:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:39:44.086257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af85136-e9f9-4b78-92ed-04b8b3dad54f None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:44.097954 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:44.188816 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af85136-e9f9-4b78-92ed-04b8b3dad54f None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:44.222798 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab763c2b-d0da-4c50-9b78-9dcff689358b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:44.223505 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab763c2b-d0da-4c50-9b78-9dcff689358b None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:44.223821 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab763c2b-d0da-4c50-9b78-9dcff689358b None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:44.224092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab763c2b-d0da-4c50-9b78-9dcff689358b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:44.234242 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab763c2b-d0da-4c50-9b78-9dcff689358b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:39:44.242030 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-ab763c2b-d0da-4c50-9b78-9dcff689358b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:39:44.242030 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:39:44.242030 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:39:44.242030 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:39:44.242030 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:39:44.242030 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:39:44.242030 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:39:44.242030 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:39:44.242030 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:39:44.242030 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:39:44.242030 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:39:44.242030 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:39:44.242030 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:39:44.242030 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:39:44.242030 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:39:44.242030 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:39:44.243240 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:39:44.243240 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:39:44.243240 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:39:44.243240 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:39:44.243240 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:39:44.243240 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:39:44.243240 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:39:44.243240 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:39:44.243240 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:39:44.243240 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:39:44.243240 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:39:44.243240 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:39:44.243240 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:39:44.243240 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:39:44.243240 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:39:44.243240 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:39:44.244151 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:39:44.244151 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:39:44.244151 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:39:44.244151 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:39:44.244151 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:39:44.244151 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:39:44.244151 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:39:44.244151 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:39:44.244151 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:39:44.244151 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:39:44.244151 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:39:44.244151 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:39:44.244151 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 639/1263] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:39:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:39:44.249415 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3955e2-5efe-4849-a524-e80ac3db5496 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:44.268077 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:44.348406 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3955e2-5efe-4849-a524-e80ac3db5496 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:44.382206 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c648d8-0491-45ee-8605-e5e593a2cd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:44.382946 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c648d8-0491-45ee-8605-e5e593a2cd0d None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:44.383227 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c648d8-0491-45ee-8605-e5e593a2cd0d None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:44.383498 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c648d8-0491-45ee-8605-e5e593a2cd0d None admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:44.384302 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c648d8-0491-45ee-8605-e5e593a2cd0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:44.384609 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c648d8-0491-45ee-8605-e5e593a2cd0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:44.386049 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c648d8-0491-45ee-8605-e5e593a2cd0d None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:44.395928 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 625/1264] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:39:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:44.401878 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab763c2b-d0da-4c50-9b78-9dcff689358b None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:44.469340 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:44.504901 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab763c2b-d0da-4c50-9b78-9dcff689358b None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:44.537617 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11034e2a-0920-41d4-b58d-de210689c5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:44.538404 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11034e2a-0920-41d4-b58d-de210689c5be None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:44.538683 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11034e2a-0920-41d4-b58d-de210689c5be None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:44.538957 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11034e2a-0920-41d4-b58d-de210689c5be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:44.549458 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11034e2a-0920-41d4-b58d-de210689c5be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:44.551681 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11034e2a-0920-41d4-b58d-de210689c5be None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:44.568481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-11034e2a-0920-41d4-b58d-de210689c5be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:39:44.568481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:39:44.568481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:39:44.568481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:39:44.568481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:39:44.568481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:39:44.568481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:39:44.568481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:39:44.568481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:39:44.568481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:39:44.568481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:39:44.568481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:39:44.568481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:39:44.568481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:39:44.568481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:39:44.569414 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:39:44.569414 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:39:44.569414 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:39:44.569414 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:39:44.569414 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:39:44.569414 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:39:44.569414 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:39:44.569414 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:39:44.569414 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:39:44.569414 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:39:44.569414 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:39:44.569414 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:39:44.569414 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:39:44.569414 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:39:44.569414 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:39:44.569414 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:39:44.569414 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:39:44.570429 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:39:44.570429 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:39:44.570429 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:39:44.570429 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:39:44.570429 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 640/1265] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:39:44.575431 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c648d8-0491-45ee-8605-e5e593a2cd0d None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:44.660113 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:44.679342 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c648d8-0491-45ee-8605-e5e593a2cd0d None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:44.712595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e98e9-1309-4117-a769-0268cf10ac48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:44.713290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e98e9-1309-4117-a769-0268cf10ac48 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:44.713562 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e98e9-1309-4117-a769-0268cf10ac48 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:44.713836 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e98e9-1309-4117-a769-0268cf10ac48 None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:44.714552 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e98e9-1309-4117-a769-0268cf10ac48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:44.714860 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e98e9-1309-4117-a769-0268cf10ac48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:44.716259 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e98e9-1309-4117-a769-0268cf10ac48 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:44.728540 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 626/1266] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:44.734515 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11034e2a-0920-41d4-b58d-de210689c5be None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:44.835968 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11034e2a-0920-41d4-b58d-de210689c5be None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:44.855121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:44.869195 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa615bd9-5de9-433c-a0f9-489142272f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:44.869984 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa615bd9-5de9-433c-a0f9-489142272f84 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:44.870265 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa615bd9-5de9-433c-a0f9-489142272f84 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:44.870538 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa615bd9-5de9-433c-a0f9-489142272f84 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:44.877917 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa615bd9-5de9-433c-a0f9-489142272f84 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:44.880078 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa615bd9-5de9-433c-a0f9-489142272f84 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:44.894456 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-aa615bd9-5de9-433c-a0f9-489142272f84 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 15:39:44.894456 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:39:44.894456 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:39:44.894456 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:39:44.894456 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:39:44.894456 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:39:44.894456 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:39:44.894456 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:39:44.894456 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:39:44.894456 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:39:44.894456 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:39:44.894456 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:39:44.894456 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:39:44.894456 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:39:44.894456 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:39:44.894456 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:39:44.895663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:39:44.895663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:39:44.895663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:39:44.895663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:39:44.895663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:39:44.895663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:39:44.895663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:39:44.895663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:39:44.895663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:39:44.895663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:39:44.895663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:39:44.895663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:39:44.895663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:39:44.895663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:39:44.895663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:39:44.895663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:39:44.895663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:39:44.895663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:39:44.901073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:39:44.901073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:39:44.901073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:39:44.901073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:39:44.901073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:39:44.901073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:39:44.901073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:39:44.901073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:39:44.901073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 15:39:44.901073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:39:44.901073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 641/1267] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:39:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:39:44.901917 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e98e9-1309-4117-a769-0268cf10ac48 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:45.000790 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e98e9-1309-4117-a769-0268cf10ac48 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:45.034071 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96a41a-b91a-4fe2-9309-e4703f94ca91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:45.035639 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96a41a-b91a-4fe2-9309-e4703f94ca91 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:45.035927 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96a41a-b91a-4fe2-9309-e4703f94ca91 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:45.036866 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96a41a-b91a-4fe2-9309-e4703f94ca91 None admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:45.037721 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96a41a-b91a-4fe2-9309-e4703f94ca91 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:45.038031 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96a41a-b91a-4fe2-9309-e4703f94ca91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:45.039468 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96a41a-b91a-4fe2-9309-e4703f94ca91 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:45.048718 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:45.058125 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 627/1268] 10.222.0.39 () {56 vars in 1143 bytes} [Mon May 23 15:39:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:45.063800 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa615bd9-5de9-433c-a0f9-489142272f84 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:45.164026 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa615bd9-5de9-433c-a0f9-489142272f84 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:45.199528 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a076b-46fa-42ef-bb83-b68aaf790873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:45.200351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a076b-46fa-42ef-bb83-b68aaf790873 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:45.200635 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a076b-46fa-42ef-bb83-b68aaf790873 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:45.200910 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a076b-46fa-42ef-bb83-b68aaf790873 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:45.213920 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a076b-46fa-42ef-bb83-b68aaf790873 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:45.213920 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a076b-46fa-42ef-bb83-b68aaf790873 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:45.232774 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-e73a076b-46fa-42ef-bb83-b68aaf790873 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:39:45.232774 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:39:45.232774 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:39:45.232774 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:39:45.232774 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:39:45.232774 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:39:45.232774 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:39:45.232774 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:39:45.232774 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:39:45.232774 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:39:45.232774 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:39:45.232774 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:39:45.232774 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:39:45.232774 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:39:45.232774 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:39:45.233848 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:39:45.233848 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:39:45.233848 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:39:45.233848 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:39:45.233848 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:39:45.233848 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:39:45.233848 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:39:45.233848 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:39:45.233848 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:39:45.233848 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:39:45.233848 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:39:45.233848 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:39:45.233848 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:39:45.233848 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:39:45.233848 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:39:45.233848 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:39:45.233848 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:39:45.235077 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:39:45.235077 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:39:45.235077 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:39:45.235077 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:39:45.235077 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 642/1269] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:39:45.240294 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96a41a-b91a-4fe2-9309-e4703f94ca91 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:45.341188 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96a41a-b91a-4fe2-9309-e4703f94ca91 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:45.375862 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28633df-77a8-4bb7-a958-3f461796c315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:45.376512 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28633df-77a8-4bb7-a958-3f461796c315 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:45.376793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28633df-77a8-4bb7-a958-3f461796c315 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:45.377066 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28633df-77a8-4bb7-a958-3f461796c315 None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:45.377776 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28633df-77a8-4bb7-a958-3f461796c315 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:45.378119 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28633df-77a8-4bb7-a958-3f461796c315 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:45.379530 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28633df-77a8-4bb7-a958-3f461796c315 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:45.390453 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 628/1270] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:45.396764 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a076b-46fa-42ef-bb83-b68aaf790873 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:45.432494 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:45.500239 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a076b-46fa-42ef-bb83-b68aaf790873 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:45.538227 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35c66b-3564-4106-add0-b8442edc2353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:45.539009 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35c66b-3564-4106-add0-b8442edc2353 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:45.539290 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35c66b-3564-4106-add0-b8442edc2353 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:45.539563 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35c66b-3564-4106-add0-b8442edc2353 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:45.546560 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35c66b-3564-4106-add0-b8442edc2353 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:45.548056 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35c66b-3564-4106-add0-b8442edc2353 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:45.561591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-9f35c66b-3564-4106-add0-b8442edc2353 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:39:45.561591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:39:45.561591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:39:45.561591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:39:45.561591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:39:45.561591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:39:45.561591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:39:45.561591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:39:45.561591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:39:45.561591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:39:45.561591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:39:45.561591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:39:45.561591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:39:45.561591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:39:45.561591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:39:45.564323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:39:45.564323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:39:45.564323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:39:45.564323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:39:45.564323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:39:45.564323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:39:45.564323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:39:45.564323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:39:45.564323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:39:45.564323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:39:45.564323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:39:45.564323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:39:45.564323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:39:45.564323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:39:45.564323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:39:45.564323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:39:45.564323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:39:45.565432 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:39:45.565432 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:39:45.565432 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:39:45.565432 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:39:45.565432 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:39:45.565432 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:39:45.565432 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:39:45.565432 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:39:45.565432 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 643/1271] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:39:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:39:45.568886 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28633df-77a8-4bb7-a958-3f461796c315 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:45.631197 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:45.673065 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28633df-77a8-4bb7-a958-3f461796c315 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:45.706251 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16c481-f27c-4cdc-9ebc-f3507cc2f39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:45.707396 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16c481-f27c-4cdc-9ebc-f3507cc2f39e None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:45.707698 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16c481-f27c-4cdc-9ebc-f3507cc2f39e None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:45.707974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16c481-f27c-4cdc-9ebc-f3507cc2f39e None admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:45.708748 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16c481-f27c-4cdc-9ebc-f3507cc2f39e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:45.709052 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16c481-f27c-4cdc-9ebc-f3507cc2f39e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:45.710468 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16c481-f27c-4cdc-9ebc-f3507cc2f39e None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:45.728018 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 629/1272] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:39:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:45.729269 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35c66b-3564-4106-add0-b8442edc2353 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:45.822583 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:45.830935 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35c66b-3564-4106-add0-b8442edc2353 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:45.864264 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52e9e1-a2b1-42d7-8dd3-b8e555a19d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:45.865144 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52e9e1-a2b1-42d7-8dd3-b8e555a19d25 None admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:45.865430 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52e9e1-a2b1-42d7-8dd3-b8e555a19d25 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:45.865705 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52e9e1-a2b1-42d7-8dd3-b8e555a19d25 None admin] PATH_INFO: `/v3/projects/8addb03b903842609168ee2fafc8ec6b/users/84f06d35d7cc48658262bf79d9c72280/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:45.867679 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52e9e1-a2b1-42d7-8dd3-b8e555a19d25 None admin] RBAC: Authorizing `identity:create_grant(project_id=8addb03b903842609168ee2fafc8ec6b, user_id=84f06d35d7cc48658262bf79d9c72280, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:45.869123 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52e9e1-a2b1-42d7-8dd3-b8e555a19d25 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:45.980394 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 644/1273] 10.222.0.39 () {58 vars in 1439 bytes} [Mon May 23 15:39:45 2022] PUT /identity/v3/projects/8addb03b903842609168ee2fafc8ec6b/users/84f06d35d7cc48658262bf79d9c72280/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:39:48.219270 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872375d9-20d3-409e-bcc5-24b908a6c9c4 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:48.219758 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872375d9-20d3-409e-bcc5-24b908a6c9c4 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:48.219870 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872375d9-20d3-409e-bcc5-24b908a6c9c4 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:48.221261 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 630/1274] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:39:48.227366 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed6d39-2082-4978-9f79-dafd4c01987a None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:48.227802 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed6d39-2082-4978-9f79-dafd4c01987a None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:48.227977 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed6d39-2082-4978-9f79-dafd4c01987a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:48.245121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-3bed6d39-2082-4978-9f79-dafd4c01987a None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:39:48.246310 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-3bed6d39-2082-4978-9f79-dafd4c01987a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:39:48.314295 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 645/1275] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:39:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:39:48.339356 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872375d9-20d3-409e-bcc5-24b908a6c9c4 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:48.439070 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872375d9-20d3-409e-bcc5-24b908a6c9c4 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:48.456347 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:48.472771 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a7a7d-7264-4888-8039-2910404b3473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:48.473530 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a7a7d-7264-4888-8039-2910404b3473 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:48.473808 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a7a7d-7264-4888-8039-2910404b3473 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:48.474080 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a7a7d-7264-4888-8039-2910404b3473 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:48.484113 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a7a7d-7264-4888-8039-2910404b3473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:39:48.492301 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-681a7a7d-7264-4888-8039-2910404b3473 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:39:48.492301 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:39:48.492301 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:39:48.492301 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:39:48.492301 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:39:48.492301 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:39:48.492301 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:39:48.492301 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:39:48.492301 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:39:48.492301 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:39:48.492301 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:39:48.492301 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:39:48.492301 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:39:48.492301 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:39:48.492301 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:39:48.492301 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:39:48.493318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:39:48.493318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:39:48.493318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:39:48.493318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:39:48.493318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:39:48.493318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:39:48.493318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:39:48.493318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:39:48.493318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:39:48.493318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:39:48.493318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:39:48.493318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:39:48.493318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:39:48.493318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:39:48.493318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:39:48.493318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:39:48.494212 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:39:48.494212 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:39:48.494212 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:39:48.494212 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:39:48.494212 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:39:48.494212 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:39:48.494212 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:39:48.494212 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:39:48.494212 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:39:48.494212 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:39:48.494212 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:39:48.494212 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:39:48.494212 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 631/1276] 10.222.0.39 () {56 vars in 1096 bytes} [Mon May 23 15:39:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:39:48.499627 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed6d39-2082-4978-9f79-dafd4c01987a None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:48.579730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:48.597486 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed6d39-2082-4978-9f79-dafd4c01987a None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:48.631729 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dca813-a477-4449-b9d3-2aae6da0b28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:48.632391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dca813-a477-4449-b9d3-2aae6da0b28e None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:48.632675 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dca813-a477-4449-b9d3-2aae6da0b28e None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:48.632950 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dca813-a477-4449-b9d3-2aae6da0b28e None admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:48.633690 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dca813-a477-4449-b9d3-2aae6da0b28e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:48.633998 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dca813-a477-4449-b9d3-2aae6da0b28e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:48.635355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dca813-a477-4449-b9d3-2aae6da0b28e None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:48.643898 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 646/1277] 10.222.0.39 () {56 vars in 1099 bytes} [Mon May 23 15:39:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:48.650561 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a7a7d-7264-4888-8039-2910404b3473 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:48.755652 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a7a7d-7264-4888-8039-2910404b3473 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:48.791608 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f10e7b-3c7e-406a-abef-364b3bc3b543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:48.792484 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f10e7b-3c7e-406a-abef-364b3bc3b543 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:48.792774 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f10e7b-3c7e-406a-abef-364b3bc3b543 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:48.793053 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f10e7b-3c7e-406a-abef-364b3bc3b543 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:48.804244 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f10e7b-3c7e-406a-abef-364b3bc3b543 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:48.805697 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f10e7b-3c7e-406a-abef-364b3bc3b543 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:48.822812 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-e4f10e7b-3c7e-406a-abef-364b3bc3b543 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:39:48.822812 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:39:48.822812 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:39:48.822812 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:39:48.822812 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:39:48.822812 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:39:48.822812 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:39:48.822812 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:39:48.822812 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:39:48.822812 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:39:48.822812 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:39:48.822812 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:39:48.822812 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:39:48.822812 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:39:48.822812 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:39:48.823908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:39:48.823908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:39:48.823908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:39:48.823908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:39:48.823908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:39:48.823908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:39:48.823908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:39:48.823908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:39:48.823908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:39:48.823908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:39:48.823908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:39:48.823908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:39:48.823908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:39:48.823908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:39:48.823908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:39:48.823908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:39:48.823908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:39:48.825048 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:39:48.825048 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:39:48.825048 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:39:48.825048 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:39:48.825048 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 632/1278] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:39:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:39:48.829750 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dca813-a477-4449-b9d3-2aae6da0b28e None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:48.929552 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dca813-a477-4449-b9d3-2aae6da0b28e None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:48.961906 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25eeeb-d827-433e-959e-af2b136c6e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:48.962558 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25eeeb-d827-433e-959e-af2b136c6e56 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:48.962842 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25eeeb-d827-433e-959e-af2b136c6e56 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:48.963119 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25eeeb-d827-433e-959e-af2b136c6e56 None admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:48.963867 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e25eeeb-d827-433e-959e-af2b136c6e56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:48.964184 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e25eeeb-d827-433e-959e-af2b136c6e56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:48.965558 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e25eeeb-d827-433e-959e-af2b136c6e56 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:48.978219 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 647/1279] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:48.983986 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f10e7b-3c7e-406a-abef-364b3bc3b543 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:49.015360 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:49.083139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f10e7b-3c7e-406a-abef-364b3bc3b543 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:49.116864 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38503ed9-5a2d-42f3-8392-82108c1e68a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:49.117657 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38503ed9-5a2d-42f3-8392-82108c1e68a9 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:49.117939 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38503ed9-5a2d-42f3-8392-82108c1e68a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:49.118211 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38503ed9-5a2d-42f3-8392-82108c1e68a9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:49.126339 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38503ed9-5a2d-42f3-8392-82108c1e68a9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:49.127821 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38503ed9-5a2d-42f3-8392-82108c1e68a9 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:49.143304 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-38503ed9-5a2d-42f3-8392-82108c1e68a9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 15:39:49.143304 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:39:49.143304 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:39:49.143304 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:39:49.143304 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:39:49.143304 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:39:49.143304 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:39:49.143304 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:39:49.143304 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:39:49.143304 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:39:49.143304 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:39:49.143304 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:39:49.143304 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:39:49.143304 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:39:49.143304 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:39:49.143304 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:39:49.145010 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:39:49.145010 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:39:49.145010 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:39:49.145010 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:39:49.145010 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:39:49.145010 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:39:49.145010 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:39:49.145010 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:39:49.145010 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:39:49.145010 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:39:49.145010 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:39:49.145010 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:39:49.145010 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:39:49.145010 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:39:49.145010 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:39:49.145010 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:39:49.145010 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:39:49.145010 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:39:49.146019 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:39:49.146019 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:39:49.146019 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:39:49.146019 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:39:49.146019 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:39:49.146019 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:39:49.146019 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:39:49.146019 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:39:49.146019 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 15:39:49.146019 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:39:49.146019 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 633/1280] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:39:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:39:49.150743 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25eeeb-d827-433e-959e-af2b136c6e56 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:49.154590 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:49.256228 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25eeeb-d827-433e-959e-af2b136c6e56 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:49.289680 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93959eb2-6f6f-4199-867f-f43eed45ada1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:49.290281 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93959eb2-6f6f-4199-867f-f43eed45ada1 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:49.290565 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93959eb2-6f6f-4199-867f-f43eed45ada1 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:49.290840 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93959eb2-6f6f-4199-867f-f43eed45ada1 None admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:49.291707 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93959eb2-6f6f-4199-867f-f43eed45ada1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:49.292019 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93959eb2-6f6f-4199-867f-f43eed45ada1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:49.293431 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93959eb2-6f6f-4199-867f-f43eed45ada1 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:49.310538 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 648/1281] 10.222.0.39 () {56 vars in 1143 bytes} [Mon May 23 15:39:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:49.317057 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38503ed9-5a2d-42f3-8392-82108c1e68a9 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:49.408662 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:49.418487 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38503ed9-5a2d-42f3-8392-82108c1e68a9 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:49.452714 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61ff30-7714-4772-95ac-3c9dbfb73283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:49.453383 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61ff30-7714-4772-95ac-3c9dbfb73283 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:49.453665 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61ff30-7714-4772-95ac-3c9dbfb73283 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:49.453939 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61ff30-7714-4772-95ac-3c9dbfb73283 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:49.530184 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b61ff30-7714-4772-95ac-3c9dbfb73283 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:49.531863 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b61ff30-7714-4772-95ac-3c9dbfb73283 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:49.634877 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:49.646179 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 634/1282] 10.222.0.39 () {58 vars in 1282 bytes} [Mon May 23 15:39:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:39:49.652610 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93959eb2-6f6f-4199-867f-f43eed45ada1 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:49.727202 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:49.773235 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93959eb2-6f6f-4199-867f-f43eed45ada1 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:49.810761 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85ebe5-5544-4b22-ad5a-0a0229aa1525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:49.811559 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85ebe5-5544-4b22-ad5a-0a0229aa1525 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:49.811868 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85ebe5-5544-4b22-ad5a-0a0229aa1525 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:49.812140 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85ebe5-5544-4b22-ad5a-0a0229aa1525 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:49.824975 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf85ebe5-5544-4b22-ad5a-0a0229aa1525 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:49.826439 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf85ebe5-5544-4b22-ad5a-0a0229aa1525 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:49.844622 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-bf85ebe5-5544-4b22-ad5a-0a0229aa1525 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:39:49.844622 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:39:49.844622 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:39:49.844622 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:39:49.844622 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:39:49.844622 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:39:49.844622 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:39:49.844622 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:39:49.844622 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:39:49.844622 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:39:49.844622 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:39:49.844622 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:39:49.844622 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:39:49.844622 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:39:49.844622 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:39:49.847257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:39:49.847257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:39:49.847257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:39:49.847257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:39:49.847257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:39:49.847257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:39:49.847257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:39:49.847257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:39:49.847257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:39:49.847257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:39:49.847257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:39:49.847257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:39:49.847257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:39:49.847257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:39:49.847257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:39:49.847257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:39:49.847257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:39:49.848455 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:39:49.848455 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:39:49.848455 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:39:49.848455 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:39:49.848455 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 649/1283] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:39:49.852656 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61ff30-7714-4772-95ac-3c9dbfb73283 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:49.992523 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61ff30-7714-4772-95ac-3c9dbfb73283 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:50.030823 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40795315-e4ae-4bc5-bdaa-ffb1183ef03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:50.031484 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40795315-e4ae-4bc5-bdaa-ffb1183ef03e None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:50.031797 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40795315-e4ae-4bc5-bdaa-ffb1183ef03e None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:50.032075 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40795315-e4ae-4bc5-bdaa-ffb1183ef03e None admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:50.032800 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40795315-e4ae-4bc5-bdaa-ffb1183ef03e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:50.033112 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40795315-e4ae-4bc5-bdaa-ffb1183ef03e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:50.035889 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40795315-e4ae-4bc5-bdaa-ffb1183ef03e None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:50.047408 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 635/1284] 10.222.0.39 () {56 vars in 1109 bytes} [Mon May 23 15:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:39:50.053993 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85ebe5-5544-4b22-ad5a-0a0229aa1525 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:50.162431 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85ebe5-5544-4b22-ad5a-0a0229aa1525 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:50.177229 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:50.200062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73e699-70f7-4f25-b0ba-1126fcff83a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:50.200856 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73e699-70f7-4f25-b0ba-1126fcff83a1 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:50.201184 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73e699-70f7-4f25-b0ba-1126fcff83a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:50.201462 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73e699-70f7-4f25-b0ba-1126fcff83a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:50.208485 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73e699-70f7-4f25-b0ba-1126fcff83a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:50.209935 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73e699-70f7-4f25-b0ba-1126fcff83a1 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:50.226268 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application [None req-bc73e699-70f7-4f25-b0ba-1126fcff83a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:39:50.226268 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:39:50.226268 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:39:50.226268 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:39:50.226268 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:39:50.226268 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:39:50.226268 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:39:50.226268 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:39:50.226268 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:39:50.226268 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:39:50.226268 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:39:50.226268 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:39:50.226268 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:39:50.226268 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:39:50.226268 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:39:50.227367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:39:50.227367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:39:50.227367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:39:50.227367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:39:50.227367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:39:50.227367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:39:50.227367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:39:50.227367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:39:50.227367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application with Lock( May 23 15:39:50.227367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:39:50.227367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._enter() May 23 15:39:50.227367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:39:50.227367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:39:50.227367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:39:50.227367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.creator() May 23 15:39:50.227367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:39:50.227367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application created_value = creator( May 23 15:39:50.228542 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:39:50.228542 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:39:50.228542 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:39:50.228542 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:39:50.228542 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:39:50.228542 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:39:50.228542 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:39:50.228542 dv-cinder-842119-2-smb devstack@keystone.service[87191]: ERROR keystone.server.flask.application May 23 15:39:50.228542 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 650/1285] 10.222.0.39 () {56 vars in 1111 bytes} [Mon May 23 15:39:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:39:50.233831 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40795315-e4ae-4bc5-bdaa-ffb1183ef03e None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:50.289855 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:50.345426 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40795315-e4ae-4bc5-bdaa-ffb1183ef03e None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:50.380671 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d57b75-4211-4271-bc22-228ca82867ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:50.381324 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d57b75-4211-4271-bc22-228ca82867ca None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:50.381607 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d57b75-4211-4271-bc22-228ca82867ca None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:50.381883 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d57b75-4211-4271-bc22-228ca82867ca None admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:50.382663 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d57b75-4211-4271-bc22-228ca82867ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:50.382972 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d57b75-4211-4271-bc22-228ca82867ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:50.384441 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d57b75-4211-4271-bc22-228ca82867ca None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:50.396474 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 636/1286] 10.222.0.39 () {56 vars in 1148 bytes} [Mon May 23 15:39:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:50.402916 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73e699-70f7-4f25-b0ba-1126fcff83a1 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:50.501582 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73e699-70f7-4f25-b0ba-1126fcff83a1 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:50.535957 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d40b2f-0060-482e-b60b-5a4110d67327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:50.536613 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d40b2f-0060-482e-b60b-5a4110d67327 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:50.536896 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d40b2f-0060-482e-b60b-5a4110d67327 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:50.537169 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d40b2f-0060-482e-b60b-5a4110d67327 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:50.537994 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d40b2f-0060-482e-b60b-5a4110d67327 None admin] RBAC: Adding query filter params (role.id=3ab888f5f68740bd8f9df4447f4f5a7a, scope.project.id=8addb03b903842609168ee2fafc8ec6b, user.id=84f06d35d7cc48658262bf79d9c72280) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:50.538309 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d40b2f-0060-482e-b60b-5a4110d67327 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:50.539760 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d40b2f-0060-482e-b60b-5a4110d67327 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:50.545499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 651/1287] 10.222.0.39 () {56 vars in 1374 bytes} [Mon May 23 15:39:50 2022] GET /identity/v3/role_assignments?user.id=84f06d35d7cc48658262bf79d9c72280&scope.project.id=8addb03b903842609168ee2fafc8ec6b&role.id=3ab888f5f68740bd8f9df4447f4f5a7a => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:52.779147 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085697c-b92b-444d-a132-a93e964eb4b5 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:52.779773 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085697c-b92b-444d-a132-a93e964eb4b5 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:52.779773 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085697c-b92b-444d-a132-a93e964eb4b5 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:52.781082 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 637/1288] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:39:52.786753 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbb44b-d8fe-40e8-ae7f-3386dc95fe9f None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:52.787134 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbb44b-d8fe-40e8-ae7f-3386dc95fe9f None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:52.787312 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbb44b-d8fe-40e8-ae7f-3386dc95fe9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:52.804774 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-c6bbb44b-d8fe-40e8-ae7f-3386dc95fe9f None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:39:52.812904 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-c6bbb44b-d8fe-40e8-ae7f-3386dc95fe9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:39:52.835714 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:52.872929 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 652/1289] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:39:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:39:52.895385 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085697c-b92b-444d-a132-a93e964eb4b5 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:52.996641 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085697c-b92b-444d-a132-a93e964eb4b5 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:53.008841 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:53.031685 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578eddf-0afd-44ab-8ed9-975c706607fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:53.032500 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578eddf-0afd-44ab-8ed9-975c706607fa None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:53.032783 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578eddf-0afd-44ab-8ed9-975c706607fa None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:53.033062 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578eddf-0afd-44ab-8ed9-975c706607fa None admin] PATH_INFO: `/v3/services/placement` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:53.033719 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a578eddf-0afd-44ab-8ed9-975c706607fa None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:53.035090 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a578eddf-0afd-44ab-8ed9-975c706607fa None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:53.047399 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-a578eddf-0afd-44ab-8ed9-975c706607fa None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 23 15:39:53.047399 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:39:53.047399 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:39:53.047399 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:39:53.047399 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:39:53.047399 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:39:53.047399 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:39:53.047399 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:39:53.047399 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 15:39:53.047399 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:39:53.047399 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:39:53.047399 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:39:53.047399 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:39:53.047399 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:39:53.047399 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:39:53.047399 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:39:53.047399 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:39:53.048696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:39:53.048696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:39:53.048696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:39:53.048696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:39:53.048696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:39:53.048696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:39:53.048696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:39:53.048696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:39:53.048696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:39:53.048696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:39:53.048696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:39:53.048696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:39:53.048696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:39:53.048696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:39:53.048696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:39:53.048696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:39:53.049677 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:39:53.049677 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:39:53.049677 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:39:53.049677 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:39:53.049677 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:39:53.049677 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:39:53.049677 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:39:53.049677 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:39:53.049677 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:39:53.049677 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:39:53.049677 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:39:53.049677 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:39:53.049677 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 15:39:53.049677 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:39:53.049677 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 638/1290] 10.222.0.39 () {56 vars in 1117 bytes} [Mon May 23 15:39:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:39:53.055398 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbb44b-d8fe-40e8-ae7f-3386dc95fe9f None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:53.166682 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbb44b-d8fe-40e8-ae7f-3386dc95fe9f None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:53.201629 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b79bd-9f53-4780-b4e1-a773152d5bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:53.202292 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b79bd-9f53-4780-b4e1-a773152d5bc3 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:53.202578 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b79bd-9f53-4780-b4e1-a773152d5bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:53.202857 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b79bd-9f53-4780-b4e1-a773152d5bc3 None admin] PATH_INFO: `/v3/services` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:53.203565 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b79bd-9f53-4780-b4e1-a773152d5bc3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:53.203913 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b79bd-9f53-4780-b4e1-a773152d5bc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:53.205285 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b79bd-9f53-4780-b4e1-a773152d5bc3 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:53.211300 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 653/1291] 10.222.0.39 () {56 vars in 1116 bytes} [Mon May 23 15:39:53 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:53.217209 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578eddf-0afd-44ab-8ed9-975c706607fa None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:53.314366 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578eddf-0afd-44ab-8ed9-975c706607fa None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:53.346553 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b4192-154c-49d0-9a9a-0c4d0f9ce5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:53.347204 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b4192-154c-49d0-9a9a-0c4d0f9ce5c2 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:53.347485 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b4192-154c-49d0-9a9a-0c4d0f9ce5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:53.348365 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b4192-154c-49d0-9a9a-0c4d0f9ce5c2 None admin] PATH_INFO: `/v3/services` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:53.349045 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b4192-154c-49d0-9a9a-0c4d0f9ce5c2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:53.349616 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b4192-154c-49d0-9a9a-0c4d0f9ce5c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:53.350983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b4192-154c-49d0-9a9a-0c4d0f9ce5c2 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:53.355354 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 639/1292] 10.222.0.39 () {56 vars in 1116 bytes} [Mon May 23 15:39:53 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:55.506331 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0e180-a821-4cd4-88f0-cf57d016279d None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:55.506867 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0e180-a821-4cd4-88f0-cf57d016279d None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:55.506867 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0e180-a821-4cd4-88f0-cf57d016279d None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:55.508276 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 654/1293] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:39:55.513586 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63301059-7271-45d2-a2f5-283fcae3682d None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:55.514023 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63301059-7271-45d2-a2f5-283fcae3682d None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:55.514156 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63301059-7271-45d2-a2f5-283fcae3682d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:55.530807 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-63301059-7271-45d2-a2f5-283fcae3682d None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:39:55.532023 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-63301059-7271-45d2-a2f5-283fcae3682d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:39:55.561954 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:55.597434 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 640/1294] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:39:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:39:55.621040 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0e180-a821-4cd4-88f0-cf57d016279d None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:55.652660 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:55.722415 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0e180-a821-4cd4-88f0-cf57d016279d None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:55.757840 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d6f898-e58f-4c86-a64e-d98463b6ba97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:55.758464 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6f898-e58f-4c86-a64e-d98463b6ba97 None admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:55.758724 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6f898-e58f-4c86-a64e-d98463b6ba97 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:55.758997 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6f898-e58f-4c86-a64e-d98463b6ba97 None admin] PATH_INFO: `/v3/services` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:55.759738 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d6f898-e58f-4c86-a64e-d98463b6ba97 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:55.761089 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d6f898-e58f-4c86-a64e-d98463b6ba97 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:55.855739 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 655/1295] 10.222.0.39 () {60 vars in 1141 bytes} [Mon May 23 15:39:55 2022] POST /identity/v3/services => generated 246 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:39:58.059098 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a36183-efbd-469f-9d4d-6bbd9f658b02 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:58.059739 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a36183-efbd-469f-9d4d-6bbd9f658b02 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:58.059739 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a36183-efbd-469f-9d4d-6bbd9f658b02 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:58.061150 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 641/1296] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:39:58.066425 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f45ce7-ca27-41cd-8359-588b44d9346a None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:58.067745 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f45ce7-ca27-41cd-8359-588b44d9346a None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:58.067745 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f45ce7-ca27-41cd-8359-588b44d9346a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:58.085273 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-e1f45ce7-ca27-41cd-8359-588b44d9346a None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:39:58.086446 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-e1f45ce7-ca27-41cd-8359-588b44d9346a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:39:58.158526 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 656/1297] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:39:58 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:39:58.182448 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a36183-efbd-469f-9d4d-6bbd9f658b02 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:58.282609 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a36183-efbd-469f-9d4d-6bbd9f658b02 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:58.317332 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f0b66-5561-40bc-a5b4-bb8cd2079573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:58.318032 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f0b66-5561-40bc-a5b4-bb8cd2079573 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:58.318318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f0b66-5561-40bc-a5b4-bb8cd2079573 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:58.318599 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f0b66-5561-40bc-a5b4-bb8cd2079573 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:58.319249 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f0b66-5561-40bc-a5b4-bb8cd2079573 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:58.320658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f0b66-5561-40bc-a5b4-bb8cd2079573 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:58.332836 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-908f0b66-5561-40bc-a5b4-bb8cd2079573 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 23 15:39:58.332836 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:39:58.332836 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:39:58.332836 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:39:58.332836 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:39:58.332836 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:39:58.332836 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:39:58.332836 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:39:58.332836 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 15:39:58.332836 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:39:58.332836 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:39:58.332836 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:39:58.332836 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:39:58.332836 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:39:58.332836 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:39:58.332836 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:39:58.332836 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:39:58.334158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:39:58.334158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:39:58.334158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:39:58.334158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:39:58.334158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:39:58.334158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:39:58.334158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:39:58.334158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:39:58.334158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:39:58.334158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:39:58.334158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:39:58.334158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:39:58.334158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:39:58.334158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:39:58.334158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:39:58.334158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:39:58.335286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:39:58.335286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:39:58.335286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:39:58.335286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:39:58.335286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:39:58.335286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:39:58.335286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:39:58.335286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:39:58.335286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:39:58.335286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:39:58.335286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:39:58.335286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:39:58.335286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 15:39:58.335286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:39:58.335286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 642/1298] 10.222.0.39 () {56 vars in 1117 bytes} [Mon May 23 15:39:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:39:58.340319 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f45ce7-ca27-41cd-8359-588b44d9346a None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:58.359430 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:58.438939 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f45ce7-ca27-41cd-8359-588b44d9346a None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:58.472443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6c446-e2ef-4b6c-8cc8-a2a041c96104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:58.473095 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6c446-e2ef-4b6c-8cc8-a2a041c96104 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:58.473371 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6c446-e2ef-4b6c-8cc8-a2a041c96104 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:58.473643 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6c446-e2ef-4b6c-8cc8-a2a041c96104 None admin] PATH_INFO: `/v3/services` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:58.474600 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6c446-e2ef-4b6c-8cc8-a2a041c96104 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:58.474905 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6c446-e2ef-4b6c-8cc8-a2a041c96104 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:58.476328 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6c446-e2ef-4b6c-8cc8-a2a041c96104 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:58.481277 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 657/1299] 10.222.0.39 () {56 vars in 1116 bytes} [Mon May 23 15:39:58 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:58.487352 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f0b66-5561-40bc-a5b4-bb8cd2079573 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:58.518956 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:58.585704 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f0b66-5561-40bc-a5b4-bb8cd2079573 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:58.618743 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116c8cd-4854-4a23-8908-ec43526c511e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:58.619382 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116c8cd-4854-4a23-8908-ec43526c511e None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:58.619699 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116c8cd-4854-4a23-8908-ec43526c511e None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:58.620972 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116c8cd-4854-4a23-8908-ec43526c511e None admin] PATH_INFO: `/v3/endpoints` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:58.620972 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116c8cd-4854-4a23-8908-ec43526c511e None admin] RBAC: Adding query filter params (interface=public, service_id=6fef0ee9500e408885dbeda2a46df22a, region_id=RegionOne) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:58.621187 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116c8cd-4854-4a23-8908-ec43526c511e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:58.622380 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116c8cd-4854-4a23-8908-ec43526c511e None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:58.627289 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 643/1300] 10.222.0.39 () {56 vars in 1251 bytes} [Mon May 23 15:39:58 2022] GET /identity/v3/endpoints?service_id=6fef0ee9500e408885dbeda2a46df22a&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:58.633578 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6c446-e2ef-4b6c-8cc8-a2a041c96104 None admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:58.717353 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:58.735281 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6c446-e2ef-4b6c-8cc8-a2a041c96104 None admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:58.768427 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dfe83f-6ca0-403e-86aa-a39d59c566e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:58.769079 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dfe83f-6ca0-403e-86aa-a39d59c566e6 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:58.769360 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dfe83f-6ca0-403e-86aa-a39d59c566e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:58.773101 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dfe83f-6ca0-403e-86aa-a39d59c566e6 None admin] PATH_INFO: `/v3/services` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:58.773101 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dfe83f-6ca0-403e-86aa-a39d59c566e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:58.773101 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dfe83f-6ca0-403e-86aa-a39d59c566e6 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:58.779025 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 658/1301] 10.222.0.39 () {56 vars in 1087 bytes} [Mon May 23 15:39:58 2022] GET /identity/v3/services => generated 2191 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:40:00.986110 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ae667-bdd0-4877-8d8a-b6c5da374b00 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:40:00.986638 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ae667-bdd0-4877-8d8a-b6c5da374b00 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:40:00.986638 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ae667-bdd0-4877-8d8a-b6c5da374b00 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:40:00.988105 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 644/1302] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:40:00.994183 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a0b77-ea60-4277-ba15-c04c8793b458 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:40:00.994704 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a0b77-ea60-4277-ba15-c04c8793b458 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:40:00.994704 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a0b77-ea60-4277-ba15-c04c8793b458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:40:01.011498 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-4c3a0b77-ea60-4277-ba15-c04c8793b458 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:40:01.012691 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-4c3a0b77-ea60-4277-ba15-c04c8793b458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:40:01.078433 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 659/1303] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:40:00 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:40:01.102757 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ae667-bdd0-4877-8d8a-b6c5da374b00 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:40:01.198828 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:40:01.205479 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ae667-bdd0-4877-8d8a-b6c5da374b00 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:40:01.240345 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fddc24c-e193-4ac0-b1cd-b18eaac1d520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:40:01.241082 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddc24c-e193-4ac0-b1cd-b18eaac1d520 None admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:40:01.241434 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddc24c-e193-4ac0-b1cd-b18eaac1d520 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:40:01.241719 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddc24c-e193-4ac0-b1cd-b18eaac1d520 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:40:01.242371 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fddc24c-e193-4ac0-b1cd-b18eaac1d520 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:40:01.243801 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fddc24c-e193-4ac0-b1cd-b18eaac1d520 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:40:01.256114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application [None req-4fddc24c-e193-4ac0-b1cd-b18eaac1d520 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 23 15:40:01.256114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:40:01.256114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:40:01.256114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:40:01.256114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:40:01.256114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:40:01.256114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:40:01.256114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:40:01.256114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 15:40:01.256114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:40:01.256114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:40:01.256114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:40:01.256114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:40:01.256114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:40:01.256114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:40:01.256114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:40:01.256114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:40:01.260094 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:40:01.260094 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:40:01.260094 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:40:01.260094 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:40:01.260094 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:40:01.260094 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:40:01.260094 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:40:01.260094 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:40:01.260094 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:40:01.260094 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:40:01.260094 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:40:01.260094 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:40:01.260094 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:40:01.260094 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:40:01.260094 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:40:01.260094 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:40:01.261040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:40:01.261040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application with Lock( May 23 15:40:01.261040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:40:01.261040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self._enter() May 23 15:40:01.261040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:40:01.261040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:40:01.261040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:40:01.261040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application return self.creator() May 23 15:40:01.261040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:40:01.261040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application created_value = creator( May 23 15:40:01.261040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:40:01.261040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:40:01.261040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 15:40:01.261040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: ERROR keystone.server.flask.application May 23 15:40:01.261040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 645/1304] 10.222.0.39 () {56 vars in 1117 bytes} [Mon May 23 15:40:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:40:01.263452 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a0b77-ea60-4277-ba15-c04c8793b458 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:40:01.346200 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:40:01.369384 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a0b77-ea60-4277-ba15-c04c8793b458 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:40:01.402624 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad3114-523e-4a95-b582-7565ca573658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:40:01.403354 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad3114-523e-4a95-b582-7565ca573658 None admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:40:01.403662 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad3114-523e-4a95-b582-7565ca573658 None admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:40:01.403941 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad3114-523e-4a95-b582-7565ca573658 None admin] PATH_INFO: `/v3/services` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:40:01.404648 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad3114-523e-4a95-b582-7565ca573658 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:40:01.404952 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad3114-523e-4a95-b582-7565ca573658 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:40:01.406315 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad3114-523e-4a95-b582-7565ca573658 None admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:40:01.412024 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 660/1305] 10.222.0.39 () {56 vars in 1116 bytes} [Mon May 23 15:40:01 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:40:01.418248 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fddc24c-e193-4ac0-b1cd-b18eaac1d520 None admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:40:01.518235 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fddc24c-e193-4ac0-b1cd-b18eaac1d520 None admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:40:01.551465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f470a-35b7-41a5-a81c-84f32b745158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:40:01.552141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f470a-35b7-41a5-a81c-84f32b745158 None admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:40:01.552423 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f470a-35b7-41a5-a81c-84f32b745158 None admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:40:01.552698 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f470a-35b7-41a5-a81c-84f32b745158 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:40:01.553420 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f470a-35b7-41a5-a81c-84f32b745158 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:40:01.554782 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f470a-35b7-41a5-a81c-84f32b745158 None admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:40:01.627133 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 646/1306] 10.222.0.39 () {60 vars in 1144 bytes} [Mon May 23 15:40:01 2022] POST /identity/v3/endpoints => generated 331 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:40:11.438704 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=30 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:40:11.622496 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:09.423277 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739aee0b-0246-442a-880d-744ccafbdcaf None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:09.428964 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739aee0b-0246-442a-880d-744ccafbdcaf None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:09.428964 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739aee0b-0246-442a-880d-744ccafbdcaf None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:09.430645 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd033d-4f8c-42ee-a13b-df60880b5911 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:09.431089 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd033d-4f8c-42ee-a13b-df60880b5911 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:09.431185 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd033d-4f8c-42ee-a13b-df60880b5911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:09.433405 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 661/1307] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:46:09 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:46:09.512193 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-99cd033d-4f8c-42ee-a13b-df60880b5911 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:09.513530 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-99cd033d-4f8c-42ee-a13b-df60880b5911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:09.669247 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 647/1308] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:46:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:46:09.703681 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b13fc-8528-4853-a3c5-dc836c0b88ec None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:09.703983 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b13fc-8528-4853-a3c5-dc836c0b88ec None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:09.704269 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b13fc-8528-4853-a3c5-dc836c0b88ec None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:09.705954 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 662/1309] 10.222.0.39 () {54 vars in 964 bytes} [Mon May 23 15:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:46:09.719938 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd742f-e548-4db7-b795-d5f4e3cf3c27 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:09.721016 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd742f-e548-4db7-b795-d5f4e3cf3c27 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:09.722235 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd742f-e548-4db7-b795-d5f4e3cf3c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:09.824670 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-7cbd742f-e548-4db7-b795-d5f4e3cf3c27 None None] MFA Rules not processed for user `f831a06a9cf344a2aa068c20a987b6da`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:09.826969 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-7cbd742f-e548-4db7-b795-d5f4e3cf3c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:09.850706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:09.912095 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 648/1310] 10.222.0.39 () {58 vars in 1061 bytes} [Mon May 23 15:46:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:46:09.921367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b13fc-8528-4853-a3c5-dc836c0b88ec None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:09.923147 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-178b13fc-8528-4853-a3c5-dc836c0b88ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:10.049523 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b13fc-8528-4853-a3c5-dc836c0b88ec None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:10.129543 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d5736-ef96-4639-bdf2-c70ceeebe9d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:10.130210 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d5736-ef96-4639-bdf2-c70ceeebe9d2 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:10.130499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d5736-ef96-4639-bdf2-c70ceeebe9d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:10.130898 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d5736-ef96-4639-bdf2-c70ceeebe9d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:10.132649 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-3a3d5736-ef96-4639-bdf2-c70ceeebe9d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:10.191727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:10.257130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d5736-ef96-4639-bdf2-c70ceeebe9d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:10.258594 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d5736-ef96-4639-bdf2-c70ceeebe9d2 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:10.278315 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 663/1311] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:46:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:46:12.842020 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a043d-dc4c-4021-9fc2-0b930d2937d0 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:12.842889 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a043d-dc4c-4021-9fc2-0b930d2937d0 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:12.843338 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a043d-dc4c-4021-9fc2-0b930d2937d0 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:12.849063 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 649/1312] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:46:12 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:46:12.855629 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cec1b-97d0-44ba-9641-c8747077a795 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:12.855629 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cec1b-97d0-44ba-9641-c8747077a795 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:12.855629 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cec1b-97d0-44ba-9641-c8747077a795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:12.958257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-db8cec1b-97d0-44ba-9641-c8747077a795 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:12.959579 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-db8cec1b-97d0-44ba-9641-c8747077a795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:13.063569 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 664/1313] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:46:13.115423 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54d314-72fa-49d0-b99a-f8fbd46f7937 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:13.115752 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54d314-72fa-49d0-b99a-f8fbd46f7937 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:13.116173 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54d314-72fa-49d0-b99a-f8fbd46f7937 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:13.117854 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 650/1314] 10.222.0.39 () {54 vars in 964 bytes} [Mon May 23 15:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:46:13.123909 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c0656-462c-47bb-9235-998c41b8f3eb None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:13.124230 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c0656-462c-47bb-9235-998c41b8f3eb None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:13.124532 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c0656-462c-47bb-9235-998c41b8f3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:13.136000 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:13.214524 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-2f6c0656-462c-47bb-9235-998c41b8f3eb None None] MFA Rules not processed for user `f831a06a9cf344a2aa068c20a987b6da`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:13.216160 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-2f6c0656-462c-47bb-9235-998c41b8f3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:13.295806 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 665/1315] 10.222.0.39 () {58 vars in 1061 bytes} [Mon May 23 15:46:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:46:13.304540 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54d314-72fa-49d0-b99a-f8fbd46f7937 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:13.306241 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-2e54d314-72fa-49d0-b99a-f8fbd46f7937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:13.418208 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54d314-72fa-49d0-b99a-f8fbd46f7937 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:13.497946 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:13.500746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22f9c7-464f-4125-a081-89300e0ae420 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:13.501405 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22f9c7-464f-4125-a081-89300e0ae420 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:13.501688 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22f9c7-464f-4125-a081-89300e0ae420 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:13.501965 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22f9c7-464f-4125-a081-89300e0ae420 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:13.503676 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-ae22f9c7-464f-4125-a081-89300e0ae420 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:13.621980 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22f9c7-464f-4125-a081-89300e0ae420 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:13.623437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22f9c7-464f-4125-a081-89300e0ae420 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:13.642189 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 651/1316] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:46:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:46:16.759431 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3048a05-2024-49c8-82d4-ebe4940b1a04 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:16.760014 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3048a05-2024-49c8-82d4-ebe4940b1a04 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:16.760112 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3048a05-2024-49c8-82d4-ebe4940b1a04 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:16.761466 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 666/1317] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:46:16.766671 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f164b9-5e25-4aff-b43d-3c912b8e4d26 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:16.767139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f164b9-5e25-4aff-b43d-3c912b8e4d26 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:16.767251 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f164b9-5e25-4aff-b43d-3c912b8e4d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:16.832678 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-b1f164b9-5e25-4aff-b43d-3c912b8e4d26 None None] MFA Rules not processed for user `838e751633d3499ab737f10ad9b3cd2b`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:16.833870 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-b1f164b9-5e25-4aff-b43d-3c912b8e4d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:16.884964 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:16.928957 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 652/1318] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:46:16 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:46:16.968719 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3048a05-2024-49c8-82d4-ebe4940b1a04 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:16.970245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-a3048a05-2024-49c8-82d4-ebe4940b1a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:17.073183 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3048a05-2024-49c8-82d4-ebe4940b1a04 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:17.076860 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:17.155303 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41787add-49c6-4b72-a63d-0f344e91de6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:17.155973 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41787add-49c6-4b72-a63d-0f344e91de6c service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:17.156261 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41787add-49c6-4b72-a63d-0f344e91de6c service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:17.156543 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41787add-49c6-4b72-a63d-0f344e91de6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:17.158209 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-41787add-49c6-4b72-a63d-0f344e91de6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:17.270641 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41787add-49c6-4b72-a63d-0f344e91de6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:17.272119 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41787add-49c6-4b72-a63d-0f344e91de6c service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:17.290996 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 667/1319] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:46:16 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:46:20.564114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539bdf1-002b-49c2-9fdd-cd8b800e51f1 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:20.564639 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539bdf1-002b-49c2-9fdd-cd8b800e51f1 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:20.564762 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539bdf1-002b-49c2-9fdd-cd8b800e51f1 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:20.566065 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 653/1320] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:46:20.572245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045f810-8d44-4f39-89d1-d5b8b05702f8 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:20.572675 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045f810-8d44-4f39-89d1-d5b8b05702f8 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:20.572824 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045f810-8d44-4f39-89d1-d5b8b05702f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:20.619964 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:20.647643 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-5045f810-8d44-4f39-89d1-d5b8b05702f8 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:20.649053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-5045f810-8d44-4f39-89d1-d5b8b05702f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:20.783964 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 668/1321] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:46:20 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:46:20.823109 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539bdf1-002b-49c2-9fdd-cd8b800e51f1 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:20.825330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-7539bdf1-002b-49c2-9fdd-cd8b800e51f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:20.974984 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539bdf1-002b-49c2-9fdd-cd8b800e51f1 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:21.063702 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c52ac-5f8a-451d-a55b-129cd7bb9209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:21.064477 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c52ac-5f8a-451d-a55b-129cd7bb9209 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:21.064816 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c52ac-5f8a-451d-a55b-129cd7bb9209 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:21.065151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c52ac-5f8a-451d-a55b-129cd7bb9209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:21.067262 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-326c52ac-5f8a-451d-a55b-129cd7bb9209 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:21.078031 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:21.191834 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c52ac-5f8a-451d-a55b-129cd7bb9209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:21.193297 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c52ac-5f8a-451d-a55b-129cd7bb9209 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:21.213196 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 654/1322] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:46:20 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:46:24.863955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b7ae0-728d-491c-b1cc-8121fb6d71ad None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:24.864490 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b7ae0-728d-491c-b1cc-8121fb6d71ad None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:24.864605 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b7ae0-728d-491c-b1cc-8121fb6d71ad None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:24.866040 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 669/1323] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:46:24.871822 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c612645-03c1-4a0d-953e-6f683cfc5821 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:24.872270 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c612645-03c1-4a0d-953e-6f683cfc5821 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:24.872270 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c612645-03c1-4a0d-953e-6f683cfc5821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:24.936515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-8c612645-03c1-4a0d-953e-6f683cfc5821 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:24.937708 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-8c612645-03c1-4a0d-953e-6f683cfc5821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:24.995833 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:25.034201 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 655/1324] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:46:25.069731 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b7ae0-728d-491c-b1cc-8121fb6d71ad None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:25.071365 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-2a6b7ae0-728d-491c-b1cc-8121fb6d71ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:25.174769 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b7ae0-728d-491c-b1cc-8121fb6d71ad None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:25.186606 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:25.252344 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f42f7-4a84-4c54-9877-14b3f90f7c44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:25.252999 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f42f7-4a84-4c54-9877-14b3f90f7c44 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:25.253283 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f42f7-4a84-4c54-9877-14b3f90f7c44 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:25.253581 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f42f7-4a84-4c54-9877-14b3f90f7c44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:25.255224 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-947f42f7-4a84-4c54-9877-14b3f90f7c44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:25.369048 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f42f7-4a84-4c54-9877-14b3f90f7c44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:25.370486 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f42f7-4a84-4c54-9877-14b3f90f7c44 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:25.390362 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 670/1325] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:46:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:46:27.994225 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f6b72-06b0-4d3c-880b-3261621421b6 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:27.994792 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f6b72-06b0-4d3c-880b-3261621421b6 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:27.994890 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f6b72-06b0-4d3c-880b-3261621421b6 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:27.997584 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 656/1326] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:46:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:46:28.002557 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff55d9-a7c3-487f-a8b9-1280a6b42305 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:28.003026 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff55d9-a7c3-487f-a8b9-1280a6b42305 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:28.003558 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff55d9-a7c3-487f-a8b9-1280a6b42305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:28.082909 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:28.102859 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-d6ff55d9-a7c3-487f-a8b9-1280a6b42305 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:28.104098 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-d6ff55d9-a7c3-487f-a8b9-1280a6b42305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:28.234469 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 671/1327] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:46:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:46:28.280457 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f6b72-06b0-4d3c-880b-3261621421b6 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:28.282305 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-630f6b72-06b0-4d3c-880b-3261621421b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:28.431526 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f6b72-06b0-4d3c-880b-3261621421b6 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:28.513872 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fa681-1d3c-4d6d-9112-0574cc0cc43f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:28.514525 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fa681-1d3c-4d6d-9112-0574cc0cc43f service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:28.514807 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fa681-1d3c-4d6d-9112-0574cc0cc43f service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:28.515085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fa681-1d3c-4d6d-9112-0574cc0cc43f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:28.516897 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-362fa681-1d3c-4d6d-9112-0574cc0cc43f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:28.536360 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:28.649187 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362fa681-1d3c-4d6d-9112-0574cc0cc43f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:28.650654 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362fa681-1d3c-4d6d-9112-0574cc0cc43f service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:28.670974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 657/1328] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:46:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:46:31.035892 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c60729-a581-45df-9b2f-1b28d13f78bc None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:31.036729 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c60729-a581-45df-9b2f-1b28d13f78bc None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:31.036729 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c60729-a581-45df-9b2f-1b28d13f78bc None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:31.037894 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 672/1329] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:46:31.047189 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05266f-817a-42f4-9723-28bd16712ae5 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:31.048074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05266f-817a-42f4-9723-28bd16712ae5 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:31.048277 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05266f-817a-42f4-9723-28bd16712ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:31.138531 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-aa05266f-817a-42f4-9723-28bd16712ae5 None None] MFA Rules not processed for user `838e751633d3499ab737f10ad9b3cd2b`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:31.140076 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-aa05266f-817a-42f4-9723-28bd16712ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:31.250503 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:31.314329 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 658/1330] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:46:31 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:46:31.363092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c60729-a581-45df-9b2f-1b28d13f78bc None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:31.365893 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-51c60729-a581-45df-9b2f-1b28d13f78bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:31.566336 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c60729-a581-45df-9b2f-1b28d13f78bc None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:31.613435 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:31.707029 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfd112-8c82-4da4-9477-5407b920ce35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:31.708105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfd112-8c82-4da4-9477-5407b920ce35 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:31.708601 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfd112-8c82-4da4-9477-5407b920ce35 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:31.709088 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfd112-8c82-4da4-9477-5407b920ce35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:31.712259 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-e9bfd112-8c82-4da4-9477-5407b920ce35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:31.848401 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bfd112-8c82-4da4-9477-5407b920ce35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:31.849748 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bfd112-8c82-4da4-9477-5407b920ce35 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:31.868420 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 673/1331] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:46:31 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:46:34.596540 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc23e25-cbbd-42bc-8e04-a0487ff346dc None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:34.596540 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc23e25-cbbd-42bc-8e04-a0487ff346dc None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:34.596540 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc23e25-cbbd-42bc-8e04-a0487ff346dc None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:34.597827 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 659/1332] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:46:34.603409 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fc08b-df31-4e00-bfbe-09d8509dfa12 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:34.603898 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fc08b-df31-4e00-bfbe-09d8509dfa12 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:34.604011 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fc08b-df31-4e00-bfbe-09d8509dfa12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:34.665818 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:34.668982 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-bb7fc08b-df31-4e00-bfbe-09d8509dfa12 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:34.670178 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-bb7fc08b-df31-4e00-bfbe-09d8509dfa12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:34.782053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 674/1333] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:46:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:46:34.818222 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc23e25-cbbd-42bc-8e04-a0487ff346dc None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:34.819880 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-2dc23e25-cbbd-42bc-8e04-a0487ff346dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:34.932331 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc23e25-cbbd-42bc-8e04-a0487ff346dc None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:35.008827 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d043885-0450-4eac-82d0-89c08d20bdcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:35.009363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d043885-0450-4eac-82d0-89c08d20bdcd service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:35.009643 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d043885-0450-4eac-82d0-89c08d20bdcd service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:35.009916 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d043885-0450-4eac-82d0-89c08d20bdcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:35.012135 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-6d043885-0450-4eac-82d0-89c08d20bdcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:35.039029 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:35.121206 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d043885-0450-4eac-82d0-89c08d20bdcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:35.122653 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d043885-0450-4eac-82d0-89c08d20bdcd service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:35.141581 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 660/1334] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:46:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:46:37.407205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7f17a-04d9-43ac-98b3-19d93890ab02 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:37.407774 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7f17a-04d9-43ac-98b3-19d93890ab02 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:37.407774 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7f17a-04d9-43ac-98b3-19d93890ab02 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:37.409175 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 675/1335] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:46:37.414467 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33746342-6f4e-43b0-aa74-1ab6e925a2e7 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:37.414929 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33746342-6f4e-43b0-aa74-1ab6e925a2e7 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:37.415032 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33746342-6f4e-43b0-aa74-1ab6e925a2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:37.481764 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-33746342-6f4e-43b0-aa74-1ab6e925a2e7 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:37.483133 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-33746342-6f4e-43b0-aa74-1ab6e925a2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:37.562867 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:37.594025 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 661/1336] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:46:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:46:37.656912 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7f17a-04d9-43ac-98b3-19d93890ab02 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:37.659341 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-9ce7f17a-04d9-43ac-98b3-19d93890ab02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:37.805734 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7f17a-04d9-43ac-98b3-19d93890ab02 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:37.847179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:37.903903 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb5428-c6c1-4e6e-94e6-246fe20dbc00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:37.904547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb5428-c6c1-4e6e-94e6-246fe20dbc00 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:37.904824 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb5428-c6c1-4e6e-94e6-246fe20dbc00 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:37.905098 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb5428-c6c1-4e6e-94e6-246fe20dbc00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:37.906735 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-56fb5428-c6c1-4e6e-94e6-246fe20dbc00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:38.014729 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb5428-c6c1-4e6e-94e6-246fe20dbc00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:38.016119 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb5428-c6c1-4e6e-94e6-246fe20dbc00 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:38.034646 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 676/1337] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:46:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:46:40.930562 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf4ced-afa0-4d40-be1b-9f449d2f28ff None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:40.931109 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf4ced-afa0-4d40-be1b-9f449d2f28ff None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:40.931109 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf4ced-afa0-4d40-be1b-9f449d2f28ff None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:40.932520 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 662/1338] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:46:40.937807 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1043c2-3be0-4176-88ad-192cdedfce38 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:40.938257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1043c2-3be0-4176-88ad-192cdedfce38 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:40.938374 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1043c2-3be0-4176-88ad-192cdedfce38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:41.008999 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-5c1043c2-3be0-4176-88ad-192cdedfce38 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:41.010187 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-5c1043c2-3be0-4176-88ad-192cdedfce38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:41.019098 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:41.114731 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 677/1339] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:46:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:46:41.150932 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf4ced-afa0-4d40-be1b-9f449d2f28ff None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:41.154327 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-09bf4ced-afa0-4d40-be1b-9f449d2f28ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:41.252633 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf4ced-afa0-4d40-be1b-9f449d2f28ff None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:41.256193 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a258079-6d0d-4167-9a35-6096f4890b77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:41.256826 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a258079-6d0d-4167-9a35-6096f4890b77 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:41.257107 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a258079-6d0d-4167-9a35-6096f4890b77 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:41.257378 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a258079-6d0d-4167-9a35-6096f4890b77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:41.266954 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a258079-6d0d-4167-9a35-6096f4890b77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:41.268405 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a258079-6d0d-4167-9a35-6096f4890b77 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:41.277731 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 663/1340] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:46:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:46:46.070294 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4096996-9978-43a9-80fd-43d24d1ddd5a None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:46.070818 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4096996-9978-43a9-80fd-43d24d1ddd5a None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:46.070921 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4096996-9978-43a9-80fd-43d24d1ddd5a None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:46.072283 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 678/1341] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:46:46.078414 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1863c9-93c5-4024-9754-6b593008a644 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:46.078871 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1863c9-93c5-4024-9754-6b593008a644 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:46.078971 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1863c9-93c5-4024-9754-6b593008a644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:46.113331 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-bf1863c9-93c5-4024-9754-6b593008a644 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:46.114549 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-bf1863c9-93c5-4024-9754-6b593008a644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:46.204566 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 664/1342] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:46:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:46:46.244455 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4096996-9978-43a9-80fd-43d24d1ddd5a None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:46.255339 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4096996-9978-43a9-80fd-43d24d1ddd5a None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:46.258872 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e596606-82b9-48ca-9c88-2aad27ca6ba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:46.259507 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e596606-82b9-48ca-9c88-2aad27ca6ba3 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:46.259820 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e596606-82b9-48ca-9c88-2aad27ca6ba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:46.260099 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e596606-82b9-48ca-9c88-2aad27ca6ba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:46.269813 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e596606-82b9-48ca-9c88-2aad27ca6ba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:46.271357 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e596606-82b9-48ca-9c88-2aad27ca6ba3 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:46.282088 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 679/1343] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:46:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:46:49.765433 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee3bd9-efea-4243-9143-58018e24566f None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:49.765975 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee3bd9-efea-4243-9143-58018e24566f None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:49.765975 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee3bd9-efea-4243-9143-58018e24566f None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:49.767522 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 665/1344] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:46:49.773080 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa2037-5204-4768-8e94-08e51200f235 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:49.773513 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa2037-5204-4768-8e94-08e51200f235 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:49.773649 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa2037-5204-4768-8e94-08e51200f235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:49.791895 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-2efa2037-5204-4768-8e94-08e51200f235 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:49.793245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-2efa2037-5204-4768-8e94-08e51200f235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:49.801112 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 680/1345] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:46:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:46:49.837942 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee3bd9-efea-4243-9143-58018e24566f None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:49.849594 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee3bd9-efea-4243-9143-58018e24566f None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:49.858899 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a1067-2318-40c7-a810-2f1116efd4d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:49.859580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a1067-2318-40c7-a810-2f1116efd4d8 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:49.859943 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a1067-2318-40c7-a810-2f1116efd4d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:49.860220 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a1067-2318-40c7-a810-2f1116efd4d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:49.870228 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a1067-2318-40c7-a810-2f1116efd4d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:49.871718 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a1067-2318-40c7-a810-2f1116efd4d8 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:49.885739 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 666/1346] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:46:49 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:46:54.444114 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07da202-089a-4fcd-966a-ba8305252c50 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:54.444833 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07da202-089a-4fcd-966a-ba8305252c50 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:54.444833 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07da202-089a-4fcd-966a-ba8305252c50 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:54.446250 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 681/1347] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:46:54.452129 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c2545-fcbb-48e3-b554-b5a79f38dea9 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:54.452556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c2545-fcbb-48e3-b554-b5a79f38dea9 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:54.452713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c2545-fcbb-48e3-b554-b5a79f38dea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:54.472251 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-823c2545-fcbb-48e3-b554-b5a79f38dea9 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:46:54.473425 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-823c2545-fcbb-48e3-b554-b5a79f38dea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:54.481410 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 667/1348] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:46:54.519698 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07da202-089a-4fcd-966a-ba8305252c50 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:54.531258 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07da202-089a-4fcd-966a-ba8305252c50 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:54.534765 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0b111-91db-48a5-bc43-d4064487c494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:54.535403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0b111-91db-48a5-bc43-d4064487c494 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:54.535712 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0b111-91db-48a5-bc43-d4064487c494 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:54.535991 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0b111-91db-48a5-bc43-d4064487c494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:54.545153 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0b111-91db-48a5-bc43-d4064487c494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:54.546596 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0b111-91db-48a5-bc43-d4064487c494 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:54.556748 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 682/1349] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:46:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:47:00.196674 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831226e-200e-4bb1-9d70-84441842ce10 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:00.197679 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831226e-200e-4bb1-9d70-84441842ce10 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:00.198141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831226e-200e-4bb1-9d70-84441842ce10 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:00.200365 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 668/1350] 10.222.0.39 () {54 vars in 921 bytes} [Mon May 23 15:47:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:47:00.205369 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b353ee-a14c-4954-805f-bb8781716c37 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:00.205817 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b353ee-a14c-4954-805f-bb8781716c37 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:00.205933 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b353ee-a14c-4954-805f-bb8781716c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:00.285133 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-50b353ee-a14c-4954-805f-bb8781716c37 None None] MFA Rules not processed for user `84f06d35d7cc48658262bf79d9c72280`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:00.286766 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-50b353ee-a14c-4954-805f-bb8781716c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:00.343986 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:00.369259 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 683/1351] 10.222.0.39 () {58 vars in 1018 bytes} [Mon May 23 15:47:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:04.466910 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=98 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:04.601826 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd180ba-608b-42bc-b389-a86d756e954b None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:04.602116 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd180ba-608b-42bc-b389-a86d756e954b None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:04.602762 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd180ba-608b-42bc-b389-a86d756e954b None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:04.604564 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 669/1352] 10.222.0.39 () {54 vars in 921 bytes} [Mon May 23 15:47:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:47:04.610351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff432a52-e3b2-467b-821c-40c82d9ffd33 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:04.610888 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff432a52-e3b2-467b-821c-40c82d9ffd33 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:04.610888 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff432a52-e3b2-467b-821c-40c82d9ffd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:04.630314 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-ff432a52-e3b2-467b-821c-40c82d9ffd33 None None] MFA Rules not processed for user `84f06d35d7cc48658262bf79d9c72280`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:04.631655 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-ff432a52-e3b2-467b-821c-40c82d9ffd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:04.641392 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 684/1353] 10.222.0.39 () {58 vars in 1018 bytes} [Mon May 23 15:47:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:06.250996 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f16be-4cbd-44b3-862c-8079b4b099c7 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:06.251515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f16be-4cbd-44b3-862c-8079b4b099c7 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:06.251643 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f16be-4cbd-44b3-862c-8079b4b099c7 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:06.252985 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 670/1354] 10.222.0.39 () {54 vars in 921 bytes} [Mon May 23 15:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:47:06.258410 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a98ade-8e87-4be8-b750-10e9f5bd18a8 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:06.258866 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a98ade-8e87-4be8-b750-10e9f5bd18a8 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:06.259110 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a98ade-8e87-4be8-b750-10e9f5bd18a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:06.277622 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-95a98ade-8e87-4be8-b750-10e9f5bd18a8 None None] MFA Rules not processed for user `84f06d35d7cc48658262bf79d9c72280`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:06.278820 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-95a98ade-8e87-4be8-b750-10e9f5bd18a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:06.287367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 685/1355] 10.222.0.39 () {58 vars in 1018 bytes} [Mon May 23 15:47:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:47:10.088234 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13583ec-e4a1-4259-94d0-6a5fc163e7cc None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:10.089305 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13583ec-e4a1-4259-94d0-6a5fc163e7cc None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:10.089305 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13583ec-e4a1-4259-94d0-6a5fc163e7cc None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:10.090945 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 671/1356] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:47:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:47:10.096013 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87645dc9-ddd3-4791-8f3e-9395b7ac6c43 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:10.096458 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87645dc9-ddd3-4791-8f3e-9395b7ac6c43 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:10.096566 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87645dc9-ddd3-4791-8f3e-9395b7ac6c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:10.115508 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-87645dc9-ddd3-4791-8f3e-9395b7ac6c43 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:10.116732 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-87645dc9-ddd3-4791-8f3e-9395b7ac6c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:10.125950 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 686/1357] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:47:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:47:10.182980 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe1068-4064-4328-a6a9-6112c2706478 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:10.185995 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe1068-4064-4328-a6a9-6112c2706478 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:10.185995 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe1068-4064-4328-a6a9-6112c2706478 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:10.187011 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 672/1358] 10.222.0.39 () {54 vars in 961 bytes} [Mon May 23 15:47:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:47:10.193624 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1198253-7135-4436-b714-95c5fee82622 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:10.193914 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1198253-7135-4436-b714-95c5fee82622 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:10.194192 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1198253-7135-4436-b714-95c5fee82622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:10.250808 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-b1198253-7135-4436-b714-95c5fee82622 None None] MFA Rules not processed for user `76f7895b7b5748e7b4461f7fde1d558a`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:10.252127 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-b1198253-7135-4436-b714-95c5fee82622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:10.343810 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 687/1359] 10.222.0.39 () {58 vars in 1058 bytes} [Mon May 23 15:47:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:47:10.351588 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe1068-4064-4328-a6a9-6112c2706478 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:10.367137 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe1068-4064-4328-a6a9-6112c2706478 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:10.385020 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38ba6d-9c00-413a-9264-9c0889925af8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:10.385020 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38ba6d-9c00-413a-9264-9c0889925af8 service nova] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:10.385020 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38ba6d-9c00-413a-9264-9c0889925af8 service nova] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:10.386081 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38ba6d-9c00-413a-9264-9c0889925af8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:10.395402 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc38ba6d-9c00-413a-9264-9c0889925af8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:10.397151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc38ba6d-9c00-413a-9264-9c0889925af8 service nova] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:10.408782 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 673/1360] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:47:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:47:12.906453 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c966d15-fc29-4a1f-8f37-2db4aeb178ff None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:12.907019 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c966d15-fc29-4a1f-8f37-2db4aeb178ff None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:12.907019 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c966d15-fc29-4a1f-8f37-2db4aeb178ff None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:12.908716 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 688/1361] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:47:12.914094 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb128a1-b133-4d39-8144-7d207a6a0653 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:12.914563 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb128a1-b133-4d39-8144-7d207a6a0653 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:12.914657 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb128a1-b133-4d39-8144-7d207a6a0653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:12.933963 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-9eb128a1-b133-4d39-8144-7d207a6a0653 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:12.935071 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-9eb128a1-b133-4d39-8144-7d207a6a0653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:12.943301 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 674/1362] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:12.987258 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c966d15-fc29-4a1f-8f37-2db4aeb178ff None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:13.007813 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c966d15-fc29-4a1f-8f37-2db4aeb178ff None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:13.014151 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a4ac4-1a94-4066-9fe3-c9e4beb4e96a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:13.014801 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a4ac4-1a94-4066-9fe3-c9e4beb4e96a service nova] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:13.015088 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a4ac4-1a94-4066-9fe3-c9e4beb4e96a service nova] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:13.015396 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a4ac4-1a94-4066-9fe3-c9e4beb4e96a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:13.025343 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a4ac4-1a94-4066-9fe3-c9e4beb4e96a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:13.027451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a4ac4-1a94-4066-9fe3-c9e4beb4e96a service nova] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:13.039011 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 689/1363] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:47:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:47:15.727918 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68cb654-246f-4144-a685-5a66668b1f7d None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:15.728426 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68cb654-246f-4144-a685-5a66668b1f7d None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:15.728571 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68cb654-246f-4144-a685-5a66668b1f7d None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:15.730738 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 675/1364] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:47:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:47:15.736184 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec34de3-24d2-4332-828a-2a970bf7b74a None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:15.736970 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec34de3-24d2-4332-828a-2a970bf7b74a None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:15.737255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec34de3-24d2-4332-828a-2a970bf7b74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:15.756419 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-3ec34de3-24d2-4332-828a-2a970bf7b74a None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:15.757738 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-3ec34de3-24d2-4332-828a-2a970bf7b74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:15.766646 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 690/1365] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:15.824570 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea4102-af92-4761-ab0b-7ee53125434e None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:15.825122 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea4102-af92-4761-ab0b-7ee53125434e None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:15.825558 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea4102-af92-4761-ab0b-7ee53125434e None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:15.826939 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 676/1366] 10.222.0.39 () {54 vars in 961 bytes} [Mon May 23 15:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:47:15.833298 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7978fd-691b-4101-912d-2c167af2f537 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:15.834203 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7978fd-691b-4101-912d-2c167af2f537 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:15.834203 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7978fd-691b-4101-912d-2c167af2f537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:15.853356 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-3c7978fd-691b-4101-912d-2c167af2f537 None None] MFA Rules not processed for user `76f7895b7b5748e7b4461f7fde1d558a`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:15.855216 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-3c7978fd-691b-4101-912d-2c167af2f537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:15.864478 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 691/1367] 10.222.0.39 () {58 vars in 1058 bytes} [Mon May 23 15:47:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:15.872243 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea4102-af92-4761-ab0b-7ee53125434e None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:15.889049 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea4102-af92-4761-ab0b-7ee53125434e None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:15.894333 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1aa70-1f1a-4eb3-a9a5-29ed79e9b9bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:15.894964 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1aa70-1f1a-4eb3-a9a5-29ed79e9b9bf service nova] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:15.895246 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1aa70-1f1a-4eb3-a9a5-29ed79e9b9bf service nova] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:15.895523 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1aa70-1f1a-4eb3-a9a5-29ed79e9b9bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:15.904760 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c1aa70-1f1a-4eb3-a9a5-29ed79e9b9bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:15.906344 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c1aa70-1f1a-4eb3-a9a5-29ed79e9b9bf service nova] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:15.915767 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 677/1368] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:47:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:47:18.389014 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be0c15-9f3d-4345-b0a2-26892e922871 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:18.389580 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be0c15-9f3d-4345-b0a2-26892e922871 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:18.389580 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be0c15-9f3d-4345-b0a2-26892e922871 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:18.391094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 692/1369] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:47:18.397793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf3530-376b-40b5-9970-d38e9fb545b8 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:18.398621 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf3530-376b-40b5-9970-d38e9fb545b8 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:18.398621 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf3530-376b-40b5-9970-d38e9fb545b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:18.419260 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-0cdf3530-376b-40b5-9970-d38e9fb545b8 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:18.420642 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-0cdf3530-376b-40b5-9970-d38e9fb545b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:18.428797 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 678/1370] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:47:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:18.475851 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be0c15-9f3d-4345-b0a2-26892e922871 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:18.492451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be0c15-9f3d-4345-b0a2-26892e922871 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:18.499032 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997ab15-d764-4c12-a007-f1ac416cc320 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:18.500141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997ab15-d764-4c12-a007-f1ac416cc320 service nova] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:18.500507 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997ab15-d764-4c12-a007-f1ac416cc320 service nova] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:18.500853 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997ab15-d764-4c12-a007-f1ac416cc320 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:18.510768 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997ab15-d764-4c12-a007-f1ac416cc320 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:18.512572 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997ab15-d764-4c12-a007-f1ac416cc320 service nova] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:18.524258 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 693/1371] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:47:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:47:18.541793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47824880-7770-42cb-96b6-24b2a044388f None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:18.542080 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47824880-7770-42cb-96b6-24b2a044388f None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:18.542380 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47824880-7770-42cb-96b6-24b2a044388f None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:18.543834 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 679/1372] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:47:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:47:18.550140 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98afda-1c5c-4b56-9e6a-f9c59a685088 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:18.550522 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98afda-1c5c-4b56-9e6a-f9c59a685088 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:18.550871 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98afda-1c5c-4b56-9e6a-f9c59a685088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:18.570444 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-ab98afda-1c5c-4b56-9e6a-f9c59a685088 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:18.571780 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-ab98afda-1c5c-4b56-9e6a-f9c59a685088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:18.580197 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 694/1373] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:47:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:18.872397 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d113db-b26d-4ab6-981b-ba1ebaa68299 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:18.873093 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d113db-b26d-4ab6-981b-ba1ebaa68299 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:18.873383 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d113db-b26d-4ab6-981b-ba1ebaa68299 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:18.875001 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 680/1374] 10.222.0.39 () {54 vars in 963 bytes} [Mon May 23 15:47:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:47:18.880581 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d65ff1-a00c-4f00-93b8-58f0c74d01ad None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:18.880874 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d65ff1-a00c-4f00-93b8-58f0c74d01ad None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:18.881154 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d65ff1-a00c-4f00-93b8-58f0c74d01ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:18.946314 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-f7d65ff1-a00c-4f00-93b8-58f0c74d01ad None None] MFA Rules not processed for user `3514c56baee94de39d6be4c8790ef76b`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:18.947805 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-f7d65ff1-a00c-4f00-93b8-58f0c74d01ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:18.952671 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:19.015497 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 695/1375] 10.222.0.39 () {58 vars in 1060 bytes} [Mon May 23 15:47:18 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:19.022867 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d113db-b26d-4ab6-981b-ba1ebaa68299 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:19.035306 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d113db-b26d-4ab6-981b-ba1ebaa68299 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:19.039141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc668b-3fc9-44c8-b4ac-f95d54197695 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:19.039819 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc668b-3fc9-44c8-b4ac-f95d54197695 service cinder] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:19.040103 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc668b-3fc9-44c8-b4ac-f95d54197695 service cinder] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:19.040413 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc668b-3fc9-44c8-b4ac-f95d54197695 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:19.051183 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc668b-3fc9-44c8-b4ac-f95d54197695 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:19.052665 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc668b-3fc9-44c8-b4ac-f95d54197695 service cinder] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:19.063538 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 681/1376] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:47:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:47:20.964499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29117576-6e4c-4954-9a40-3aa56b51bb16 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:20.965042 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29117576-6e4c-4954-9a40-3aa56b51bb16 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:20.965042 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29117576-6e4c-4954-9a40-3aa56b51bb16 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:20.966419 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 696/1377] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:47:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:47:20.972479 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4331b-381c-4def-9060-5879a922e486 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:20.973014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4331b-381c-4def-9060-5879a922e486 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:20.973107 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4331b-381c-4def-9060-5879a922e486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:20.992645 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-dee4331b-381c-4def-9060-5879a922e486 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:20.993874 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-dee4331b-381c-4def-9060-5879a922e486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:21.002626 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 682/1378] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:21.049206 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29117576-6e4c-4954-9a40-3aa56b51bb16 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:21.065223 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29117576-6e4c-4954-9a40-3aa56b51bb16 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:21.070830 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7500ce-2241-4498-8365-987f74d0ff01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:21.071479 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7500ce-2241-4498-8365-987f74d0ff01 service nova] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:21.071803 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7500ce-2241-4498-8365-987f74d0ff01 service nova] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:21.072244 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7500ce-2241-4498-8365-987f74d0ff01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:21.081328 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7500ce-2241-4498-8365-987f74d0ff01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:21.082963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7500ce-2241-4498-8365-987f74d0ff01 service nova] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:21.094155 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 697/1379] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:47:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:47:23.539082 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad35e4-a67c-40bb-8aa9-cf5b5d22aef2 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:23.539820 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad35e4-a67c-40bb-8aa9-cf5b5d22aef2 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:23.539820 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad35e4-a67c-40bb-8aa9-cf5b5d22aef2 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:23.541213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 683/1380] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:47:23.546461 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71201a-6d9d-43c4-84f3-3e93727aba95 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:23.546887 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71201a-6d9d-43c4-84f3-3e93727aba95 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:23.547020 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71201a-6d9d-43c4-84f3-3e93727aba95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:23.566610 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-9f71201a-6d9d-43c4-84f3-3e93727aba95 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:23.568335 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-9f71201a-6d9d-43c4-84f3-3e93727aba95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:23.577665 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 698/1381] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:23.621232 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad35e4-a67c-40bb-8aa9-cf5b5d22aef2 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:23.638032 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad35e4-a67c-40bb-8aa9-cf5b5d22aef2 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:23.644434 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce03ef6-ac2f-40ec-9f70-a9509c08bebf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:23.645273 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce03ef6-ac2f-40ec-9f70-a9509c08bebf service nova] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:23.645677 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce03ef6-ac2f-40ec-9f70-a9509c08bebf service nova] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:23.646113 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce03ef6-ac2f-40ec-9f70-a9509c08bebf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:23.656301 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce03ef6-ac2f-40ec-9f70-a9509c08bebf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:23.658136 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce03ef6-ac2f-40ec-9f70-a9509c08bebf service nova] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:23.669734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 684/1382] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:47:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:47:26.242364 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922fd35-a451-46b1-801f-8b268be2fd10 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:26.243282 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922fd35-a451-46b1-801f-8b268be2fd10 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:26.244380 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922fd35-a451-46b1-801f-8b268be2fd10 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:26.246266 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 699/1383] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:47:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:47:26.251430 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98f289-5b3b-48b0-a691-064a75d68acd None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:26.251900 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98f289-5b3b-48b0-a691-064a75d68acd None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:26.252041 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98f289-5b3b-48b0-a691-064a75d68acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:26.270135 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-0a98f289-5b3b-48b0-a691-064a75d68acd None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:26.271309 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-0a98f289-5b3b-48b0-a691-064a75d68acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:26.279675 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 685/1384] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:47:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:26.320866 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922fd35-a451-46b1-801f-8b268be2fd10 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:26.336914 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922fd35-a451-46b1-801f-8b268be2fd10 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:26.343548 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4b97c-f4da-4c23-be63-a0d022939a6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:26.344327 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4b97c-f4da-4c23-be63-a0d022939a6e service nova] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:26.344708 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4b97c-f4da-4c23-be63-a0d022939a6e service nova] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:26.345074 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4b97c-f4da-4c23-be63-a0d022939a6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:26.355811 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4b97c-f4da-4c23-be63-a0d022939a6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:26.357387 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4b97c-f4da-4c23-be63-a0d022939a6e service nova] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:26.367835 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 700/1385] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:47:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:47:28.602586 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62b503-8296-4b3c-bd65-cec2e7986c6f None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:28.603768 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62b503-8296-4b3c-bd65-cec2e7986c6f None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:28.603768 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62b503-8296-4b3c-bd65-cec2e7986c6f None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:28.605241 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 686/1386] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:47:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:47:28.610559 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1589dd-ead4-4a91-b63e-fe0ab2bc1ea3 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:28.611032 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1589dd-ead4-4a91-b63e-fe0ab2bc1ea3 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:28.611132 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1589dd-ead4-4a91-b63e-fe0ab2bc1ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:28.629397 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-ee1589dd-ead4-4a91-b63e-fe0ab2bc1ea3 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:28.630604 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-ee1589dd-ead4-4a91-b63e-fe0ab2bc1ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:28.638994 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 701/1387] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:47:28.684184 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc62b503-8296-4b3c-bd65-cec2e7986c6f None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:28.699079 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc62b503-8296-4b3c-bd65-cec2e7986c6f None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:28.704879 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b0da9-8c4a-43d3-98aa-3fd87c311c47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:28.705566 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b0da9-8c4a-43d3-98aa-3fd87c311c47 service nova] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:28.705880 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b0da9-8c4a-43d3-98aa-3fd87c311c47 service nova] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:28.706164 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b0da9-8c4a-43d3-98aa-3fd87c311c47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:28.715481 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b0da9-8c4a-43d3-98aa-3fd87c311c47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:28.717151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b0da9-8c4a-43d3-98aa-3fd87c311c47 service nova] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:28.726707 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 687/1388] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:47:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:47:31.131636 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af217eae-733f-4dd4-a4f8-4eff0033b1c1 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:31.132322 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af217eae-733f-4dd4-a4f8-4eff0033b1c1 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:31.132322 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af217eae-733f-4dd4-a4f8-4eff0033b1c1 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:31.133462 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 702/1389] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:47:31.139360 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7321d7-cf7c-4220-a29f-76b81fc7d82a None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:31.139883 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7321d7-cf7c-4220-a29f-76b81fc7d82a None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:31.140053 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7321d7-cf7c-4220-a29f-76b81fc7d82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:31.159301 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-2a7321d7-cf7c-4220-a29f-76b81fc7d82a None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:31.160527 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-2a7321d7-cf7c-4220-a29f-76b81fc7d82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:31.168662 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 688/1390] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:31.212995 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af217eae-733f-4dd4-a4f8-4eff0033b1c1 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:31.227427 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af217eae-733f-4dd4-a4f8-4eff0033b1c1 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:31.233777 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd98e1a-3992-4474-bd26-8d4098893be2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:31.234418 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd98e1a-3992-4474-bd26-8d4098893be2 service nova] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:31.234712 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd98e1a-3992-4474-bd26-8d4098893be2 service nova] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:31.234978 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd98e1a-3992-4474-bd26-8d4098893be2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:31.244095 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd98e1a-3992-4474-bd26-8d4098893be2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:31.245824 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd98e1a-3992-4474-bd26-8d4098893be2 service nova] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:31.255488 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 703/1391] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:47:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:47:33.979962 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3034d-2e08-4daf-b312-2f24c0c73682 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:33.980559 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3034d-2e08-4daf-b312-2f24c0c73682 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:33.980559 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3034d-2e08-4daf-b312-2f24c0c73682 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:33.981804 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 689/1392] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:47:33.987263 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30db52-43de-43be-929b-782fc6212f87 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:33.987812 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30db52-43de-43be-929b-782fc6212f87 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:33.987921 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30db52-43de-43be-929b-782fc6212f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:34.006162 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-7d30db52-43de-43be-929b-782fc6212f87 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:34.007366 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-7d30db52-43de-43be-929b-782fc6212f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:34.016257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 704/1393] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:47:34.061132 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3034d-2e08-4daf-b312-2f24c0c73682 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:34.076448 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3034d-2e08-4daf-b312-2f24c0c73682 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:34.081834 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759d04b-0e8e-4323-8c92-a237f62c9c35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:34.082480 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759d04b-0e8e-4323-8c92-a237f62c9c35 service nova] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:34.082764 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759d04b-0e8e-4323-8c92-a237f62c9c35 service nova] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:34.083040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759d04b-0e8e-4323-8c92-a237f62c9c35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:34.092204 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a759d04b-0e8e-4323-8c92-a237f62c9c35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:34.093796 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a759d04b-0e8e-4323-8c92-a237f62c9c35 service nova] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:34.103909 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 690/1394] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:47:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:47:35.140233 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14042ee8-405d-4114-8d5f-9ae4a3eff15a None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:35.140844 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14042ee8-405d-4114-8d5f-9ae4a3eff15a None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:35.140844 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14042ee8-405d-4114-8d5f-9ae4a3eff15a None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:35.142157 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 705/1395] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:47:35.147290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b861a-88f0-4d54-a24f-133cd116cdd8 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:35.147801 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b861a-88f0-4d54-a24f-133cd116cdd8 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:35.147914 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b861a-88f0-4d54-a24f-133cd116cdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:35.155255 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=52 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:35.167485 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-1d7b861a-88f0-4d54-a24f-133cd116cdd8 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:35.173780 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-1d7b861a-88f0-4d54-a24f-133cd116cdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:35.176595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 691/1396] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:35.235026 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f1461-c3c0-46df-b307-8e448b1b1ee6 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:35.235317 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f1461-c3c0-46df-b307-8e448b1b1ee6 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:35.235627 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f1461-c3c0-46df-b307-8e448b1b1ee6 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:35.236986 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 706/1397] 10.222.0.39 () {54 vars in 962 bytes} [Mon May 23 15:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:47:35.242161 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244c01f-6a30-44f0-a5ed-7379f0d41430 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:35.242454 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244c01f-6a30-44f0-a5ed-7379f0d41430 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:35.242737 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244c01f-6a30-44f0-a5ed-7379f0d41430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:35.292804 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-d244c01f-6a30-44f0-a5ed-7379f0d41430 None None] MFA Rules not processed for user `d003ff6cc73946da9203c69a167bbfff`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:35.294001 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-d244c01f-6a30-44f0-a5ed-7379f0d41430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:35.354606 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 692/1398] 10.222.0.39 () {58 vars in 1059 bytes} [Mon May 23 15:47:35 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:35.362806 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f1461-c3c0-46df-b307-8e448b1b1ee6 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:35.374616 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f1461-c3c0-46df-b307-8e448b1b1ee6 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:35.378272 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdfafcf-f3ac-48d1-bb4f-a5d6df85e6e8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd003ff6cc73946da9203c69a167bbfff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:35.378979 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfafcf-f3ac-48d1-bb4f-a5d6df85e6e8 service glance] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:35.379326 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfafcf-f3ac-48d1-bb4f-a5d6df85e6e8 service glance] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:35.379700 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfafcf-f3ac-48d1-bb4f-a5d6df85e6e8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:35.389844 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdfafcf-f3ac-48d1-bb4f-a5d6df85e6e8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:35.391411 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdfafcf-f3ac-48d1-bb4f-a5d6df85e6e8 service glance] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:35.401545 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 707/1399] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:47:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:47:36.116803 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7817b8-92d0-4fb0-bf5f-89f0c27d8106 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:36.117094 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7817b8-92d0-4fb0-bf5f-89f0c27d8106 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:36.117374 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7817b8-92d0-4fb0-bf5f-89f0c27d8106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:36.166012 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-cc7817b8-92d0-4fb0-bf5f-89f0c27d8106 None None] MFA Rules not processed for user `048fc48dd55a43f7b342533a9484c3ad`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:36.167359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-cc7817b8-92d0-4fb0-bf5f-89f0c27d8106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:36.237444 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 693/1400] 10.222.0.39 () {58 vars in 1009 bytes} [Mon May 23 15:47:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:47:36.287970 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef87bde-50c4-4306-bc10-62a8cc748ae0 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:36.296990 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef87bde-50c4-4306-bc10-62a8cc748ae0 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:36.296990 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef87bde-50c4-4306-bc10-62a8cc748ae0 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:36.296990 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 708/1401] 10.222.0.39 () {54 vars in 942 bytes} [Mon May 23 15:47:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:47:36.301341 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19035d37-08b2-4d0e-93df-c67a2436a00f None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:36.301745 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19035d37-08b2-4d0e-93df-c67a2436a00f None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:36.302118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19035d37-08b2-4d0e-93df-c67a2436a00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:36.356006 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-19035d37-08b2-4d0e-93df-c67a2436a00f None None] MFA Rules not processed for user `b275a110936a44ce8d54793af1a34808`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:36.357259 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-19035d37-08b2-4d0e-93df-c67a2436a00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:36.371868 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:36.433241 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 694/1402] 10.222.0.39 () {58 vars in 1039 bytes} [Mon May 23 15:47:36 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:36.442746 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef87bde-50c4-4306-bc10-62a8cc748ae0 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:36.458308 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef87bde-50c4-4306-bc10-62a8cc748ae0 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:36.464410 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2b82f-de4b-46e8-8b11-330da16f03a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b275a110936a44ce8d54793af1a34808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:36.465057 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2b82f-de4b-46e8-8b11-330da16f03a1 service swift] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:36.465337 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2b82f-de4b-46e8-8b11-330da16f03a1 service swift] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:36.465610 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2b82f-de4b-46e8-8b11-330da16f03a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:36.469440 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93eaca9-ff28-465e-ac5d-a64254e7530b None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:36.469734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93eaca9-ff28-465e-ac5d-a64254e7530b None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:36.470016 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93eaca9-ff28-465e-ac5d-a64254e7530b None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:36.471396 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 695/1403] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:47:36.474256 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2b82f-de4b-46e8-8b11-330da16f03a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:36.475847 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2b82f-de4b-46e8-8b11-330da16f03a1 service swift] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:36.476380 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12af9fb-fc87-4105-bb24-2dc014e8d33d None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:36.476734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12af9fb-fc87-4105-bb24-2dc014e8d33d None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:36.477077 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12af9fb-fc87-4105-bb24-2dc014e8d33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:36.484409 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 709/1404] 10.222.0.39 () {60 vars in 1384 bytes} [Mon May 23 15:47:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 23 15:47:36.495449 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-b12af9fb-fc87-4105-bb24-2dc014e8d33d None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:36.496670 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-b12af9fb-fc87-4105-bb24-2dc014e8d33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:36.504982 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 696/1405] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:47:36.549814 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2b82f-de4b-46e8-8b11-330da16f03a1 service swift] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:36.561743 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2b82f-de4b-46e8-8b11-330da16f03a1 service swift] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:36.567235 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01917604-7baa-41e5-bbef-cecdaa2dbf3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:36.567927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01917604-7baa-41e5-bbef-cecdaa2dbf3b service nova] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:36.568213 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01917604-7baa-41e5-bbef-cecdaa2dbf3b service nova] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:36.568488 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01917604-7baa-41e5-bbef-cecdaa2dbf3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:36.577091 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01917604-7baa-41e5-bbef-cecdaa2dbf3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:36.582937 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01917604-7baa-41e5-bbef-cecdaa2dbf3b service nova] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:36.589106 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 710/1406] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:47:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:47:39.195697 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada7a62-5bfe-4881-917a-4a432c83377e None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:39.196824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada7a62-5bfe-4881-917a-4a432c83377e None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:39.197115 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada7a62-5bfe-4881-917a-4a432c83377e None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:39.199226 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 697/1407] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:47:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:47:39.205014 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a65b07-dbca-441d-bb39-b27de44df999 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:39.205506 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a65b07-dbca-441d-bb39-b27de44df999 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:39.205706 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a65b07-dbca-441d-bb39-b27de44df999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:39.230462 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-c6a65b07-dbca-441d-bb39-b27de44df999 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:47:39.230462 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-c6a65b07-dbca-441d-bb39-b27de44df999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:39.243782 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 711/1408] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:47:39.291797 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada7a62-5bfe-4881-917a-4a432c83377e None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:39.314655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada7a62-5bfe-4881-917a-4a432c83377e None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:39.320106 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad897dd-0d21-4df8-8712-ab6524e83685 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:39.320934 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad897dd-0d21-4df8-8712-ab6524e83685 service nova] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:39.321981 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad897dd-0d21-4df8-8712-ab6524e83685 service nova] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:39.322339 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad897dd-0d21-4df8-8712-ab6524e83685 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:39.330999 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad897dd-0d21-4df8-8712-ab6524e83685 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:39.332624 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad897dd-0d21-4df8-8712-ab6524e83685 service nova] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:39.345656 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 698/1409] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:47:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:47:49.223195 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=71 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:49.338061 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=33 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:48:01.968732 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bca3fb-3ead-4d41-84a6-18ca48b1adce None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:01.969322 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bca3fb-3ead-4d41-84a6-18ca48b1adce None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:01.969322 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bca3fb-3ead-4d41-84a6-18ca48b1adce None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:01.970635 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 712/1410] 10.222.0.39 () {54 vars in 918 bytes} [Mon May 23 15:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:48:01.976100 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf34fb1-abb3-40cb-a110-65d3242e60c6 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:01.976663 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf34fb1-abb3-40cb-a110-65d3242e60c6 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:01.976774 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf34fb1-abb3-40cb-a110-65d3242e60c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:01.996271 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-caf34fb1-abb3-40cb-a110-65d3242e60c6 None None] MFA Rules not processed for user `84f06d35d7cc48658262bf79d9c72280`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:48:01.997458 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-caf34fb1-abb3-40cb-a110-65d3242e60c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:48:02.005891 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 699/1411] 10.222.0.39 () {58 vars in 1015 bytes} [Mon May 23 15:48:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:48:02.020993 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a182b-e33a-4930-9aac-ee3f48f92a5d None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:02.021284 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a182b-e33a-4930-9aac-ee3f48f92a5d None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:02.021563 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a182b-e33a-4930-9aac-ee3f48f92a5d None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:02.022916 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 713/1412] 10.222.0.39 () {54 vars in 918 bytes} [Mon May 23 15:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:48:02.027570 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9eb640-7525-4b27-bfe7-68cbec5def85 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:02.027882 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9eb640-7525-4b27-bfe7-68cbec5def85 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:02.028157 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9eb640-7525-4b27-bfe7-68cbec5def85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:02.045348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-4d9eb640-7525-4b27-bfe7-68cbec5def85 None None] MFA Rules not processed for user `76f7895b7b5748e7b4461f7fde1d558a`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:48:02.046516 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-4d9eb640-7525-4b27-bfe7-68cbec5def85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:48:02.055433 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 700/1413] 10.222.0.39 () {58 vars in 1015 bytes} [Mon May 23 15:48:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:48:04.710233 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393fc1b-3e9e-4605-ae1b-3c746f004622 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:04.710811 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393fc1b-3e9e-4605-ae1b-3c746f004622 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:04.710811 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393fc1b-3e9e-4605-ae1b-3c746f004622 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:04.712180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 714/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:48:04.717415 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624dd173-badc-40a5-b0c8-e55d7a1f9278 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:04.717874 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624dd173-badc-40a5-b0c8-e55d7a1f9278 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:04.717983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624dd173-badc-40a5-b0c8-e55d7a1f9278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:04.735936 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-624dd173-badc-40a5-b0c8-e55d7a1f9278 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:48:04.737122 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-624dd173-badc-40a5-b0c8-e55d7a1f9278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:48:04.745401 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 701/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:48:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:48:04.787495 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393fc1b-3e9e-4605-ae1b-3c746f004622 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:48:04.802160 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393fc1b-3e9e-4605-ae1b-3c746f004622 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:48:04.808026 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5437cb-b6f2-4679-ae21-5400818447fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:48:04.808653 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5437cb-b6f2-4679-ae21-5400818447fc service nova] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:04.808937 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5437cb-b6f2-4679-ae21-5400818447fc service nova] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:04.809206 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5437cb-b6f2-4679-ae21-5400818447fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:04.817410 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5437cb-b6f2-4679-ae21-5400818447fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:48:04.818979 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5437cb-b6f2-4679-ae21-5400818447fc service nova] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:48:04.828507 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 715/1416] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:48:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:48:05.794871 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabf9ec-96ed-44cb-b27f-bcad1814889a None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:05.795435 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabf9ec-96ed-44cb-b27f-bcad1814889a None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:05.795435 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabf9ec-96ed-44cb-b27f-bcad1814889a None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:05.796828 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:48:05.801841 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d74960-88fc-4ce8-bec7-b3e35ea5e961 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:05.802272 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d74960-88fc-4ce8-bec7-b3e35ea5e961 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:05.802384 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d74960-88fc-4ce8-bec7-b3e35ea5e961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:05.820422 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-d8d74960-88fc-4ce8-bec7-b3e35ea5e961 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:48:05.821627 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-d8d74960-88fc-4ce8-bec7-b3e35ea5e961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:48:05.830019 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:48:05.988477 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcabf9ec-96ed-44cb-b27f-bcad1814889a None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:48:06.003233 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcabf9ec-96ed-44cb-b27f-bcad1814889a None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:48:06.008538 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c6215-2db5-4b31-b3f1-27a3e485d07b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:48:06.009166 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c6215-2db5-4b31-b3f1-27a3e485d07b service nova] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:06.009445 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c6215-2db5-4b31-b3f1-27a3e485d07b service nova] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:06.009721 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c6215-2db5-4b31-b3f1-27a3e485d07b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:06.017846 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c6215-2db5-4b31-b3f1-27a3e485d07b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:48:06.019409 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c6215-2db5-4b31-b3f1-27a3e485d07b service nova] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:48:06.028825 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 703/1419] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:48:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:48:06.957229 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca10fe-0a67-43bf-9940-1673b7c8a0ae None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:06.957774 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca10fe-0a67-43bf-9940-1673b7c8a0ae None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:06.957774 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca10fe-0a67-43bf-9940-1673b7c8a0ae None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:06.959201 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:48:06.965094 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b19f3-9c4c-4aa0-96e9-71f188fc1f56 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:06.965490 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b19f3-9c4c-4aa0-96e9-71f188fc1f56 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:06.965665 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b19f3-9c4c-4aa0-96e9-71f188fc1f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:06.983493 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-f86b19f3-9c4c-4aa0-96e9-71f188fc1f56 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:48:06.984698 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-f86b19f3-9c4c-4aa0-96e9-71f188fc1f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:48:06.992386 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:48:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:48:07.143727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca10fe-0a67-43bf-9940-1673b7c8a0ae None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:48:07.158046 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca10fe-0a67-43bf-9940-1673b7c8a0ae None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:48:07.163591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46df42-f194-4326-bfdf-f61cf27dd0b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:48:07.164520 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46df42-f194-4326-bfdf-f61cf27dd0b8 service nova] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:07.164803 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46df42-f194-4326-bfdf-f61cf27dd0b8 service nova] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:07.165073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46df42-f194-4326-bfdf-f61cf27dd0b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:07.173276 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46df42-f194-4326-bfdf-f61cf27dd0b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:48:07.174835 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46df42-f194-4326-bfdf-f61cf27dd0b8 service nova] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:48:07.184852 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 718/1422] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:48:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:48:08.094081 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f800a53-9d46-4357-a432-934f3ba66f3b None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:08.094664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f800a53-9d46-4357-a432-934f3ba66f3b None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:08.094664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f800a53-9d46-4357-a432-934f3ba66f3b None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:08.096034 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:48:08.101219 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4eb686-68e0-486f-8dcc-cf203a2030e1 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:08.101648 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4eb686-68e0-486f-8dcc-cf203a2030e1 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:08.101787 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4eb686-68e0-486f-8dcc-cf203a2030e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:08.120185 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-7a4eb686-68e0-486f-8dcc-cf203a2030e1 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:48:08.121510 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-7a4eb686-68e0-486f-8dcc-cf203a2030e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:48:08.129196 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:48:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:48:08.285771 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f800a53-9d46-4357-a432-934f3ba66f3b None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:48:08.300475 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f800a53-9d46-4357-a432-934f3ba66f3b None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:48:08.305735 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9c8a1-eba5-45c0-8938-cbae44a361cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:48:08.306365 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9c8a1-eba5-45c0-8938-cbae44a361cf service nova] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:08.306646 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9c8a1-eba5-45c0-8938-cbae44a361cf service nova] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:08.307592 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9c8a1-eba5-45c0-8938-cbae44a361cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:08.315924 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9c8a1-eba5-45c0-8938-cbae44a361cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:48:08.317564 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9c8a1-eba5-45c0-8938-cbae44a361cf service nova] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:48:08.327448 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 706/1425] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:48:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:48:09.246649 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920d8f0-6fe9-4b4a-9bdf-0ad99283b70d None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:09.247185 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920d8f0-6fe9-4b4a-9bdf-0ad99283b70d None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:09.247299 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920d8f0-6fe9-4b4a-9bdf-0ad99283b70d None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:09.248654 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:48:09.253778 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c0147-c920-4fcb-b99f-c44f7e65fb63 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:09.254197 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c0147-c920-4fcb-b99f-c44f7e65fb63 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:09.254345 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c0147-c920-4fcb-b99f-c44f7e65fb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:09.273225 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-539c0147-c920-4fcb-b99f-c44f7e65fb63 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:48:09.274427 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-539c0147-c920-4fcb-b99f-c44f7e65fb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:48:09.283489 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:48:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:48:09.433653 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920d8f0-6fe9-4b4a-9bdf-0ad99283b70d None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:48:09.448427 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920d8f0-6fe9-4b4a-9bdf-0ad99283b70d None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:48:09.453828 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3fe80-d963-4967-a653-15c424860606 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:48:09.454463 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3fe80-d963-4967-a653-15c424860606 service nova] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:09.454751 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3fe80-d963-4967-a653-15c424860606 service nova] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:09.455037 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3fe80-d963-4967-a653-15c424860606 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:09.463333 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3fe80-d963-4967-a653-15c424860606 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:48:09.465014 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3fe80-d963-4967-a653-15c424860606 service nova] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:48:09.474350 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 721/1428] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:48:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:48:10.379279 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048aa31-637c-4fab-ae9f-6447d5899cd9 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:10.379859 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048aa31-637c-4fab-ae9f-6447d5899cd9 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:10.379859 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048aa31-637c-4fab-ae9f-6447d5899cd9 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:10.381293 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:48:10.386577 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509ea0f-44d2-4956-a753-ee7cd4e0e810 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:10.387036 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509ea0f-44d2-4956-a753-ee7cd4e0e810 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:10.387136 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509ea0f-44d2-4956-a753-ee7cd4e0e810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:10.405773 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-e509ea0f-44d2-4956-a753-ee7cd4e0e810 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:48:10.408975 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-e509ea0f-44d2-4956-a753-ee7cd4e0e810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:48:10.414728 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:48:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:48:10.563538 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048aa31-637c-4fab-ae9f-6447d5899cd9 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:48:10.578474 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048aa31-637c-4fab-ae9f-6447d5899cd9 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:48:10.583777 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d060fbc3-32fa-4025-9aa3-a068f3a64cec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:48:10.584404 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060fbc3-32fa-4025-9aa3-a068f3a64cec service nova] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:10.584954 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060fbc3-32fa-4025-9aa3-a068f3a64cec service nova] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:10.585231 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060fbc3-32fa-4025-9aa3-a068f3a64cec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:10.593931 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d060fbc3-32fa-4025-9aa3-a068f3a64cec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:48:10.595501 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d060fbc3-32fa-4025-9aa3-a068f3a64cec service nova] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:48:10.605156 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 709/1431] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:48:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:48:11.530821 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd834b9-f331-4b68-a693-5d068bf0be7e None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:11.531338 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd834b9-f331-4b68-a693-5d068bf0be7e None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:11.531338 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd834b9-f331-4b68-a693-5d068bf0be7e None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:11.532706 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:48:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:48:11.537748 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12ed96-8edc-41e9-92e3-f24fc04e5c02 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:11.538177 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12ed96-8edc-41e9-92e3-f24fc04e5c02 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:11.538307 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12ed96-8edc-41e9-92e3-f24fc04e5c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:11.556516 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-ed12ed96-8edc-41e9-92e3-f24fc04e5c02 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:48:11.558354 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-ed12ed96-8edc-41e9-92e3-f24fc04e5c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:48:11.566050 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:48:11.717976 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd834b9-f331-4b68-a693-5d068bf0be7e None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:48:11.734023 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd834b9-f331-4b68-a693-5d068bf0be7e None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:48:11.739317 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d54986-59c0-4854-adb2-04b529b8f03a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:48:11.740038 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d54986-59c0-4854-adb2-04b529b8f03a service nova] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:11.740323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d54986-59c0-4854-adb2-04b529b8f03a service nova] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:11.740597 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d54986-59c0-4854-adb2-04b529b8f03a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:11.749272 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d54986-59c0-4854-adb2-04b529b8f03a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:48:11.750844 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d54986-59c0-4854-adb2-04b529b8f03a service nova] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:48:11.760977 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 724/1434] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:48:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:48:12.738187 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903681d2-dbb0-49de-a8c3-239ca23d84ab None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:12.738771 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903681d2-dbb0-49de-a8c3-239ca23d84ab None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:12.738771 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903681d2-dbb0-49de-a8c3-239ca23d84ab None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:12.740303 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:48:12.746063 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22194b15-ad4b-4114-85fb-200ae1a21202 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:12.746502 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22194b15-ad4b-4114-85fb-200ae1a21202 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:12.746647 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22194b15-ad4b-4114-85fb-200ae1a21202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:12.765786 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-22194b15-ad4b-4114-85fb-200ae1a21202 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:48:12.766994 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-22194b15-ad4b-4114-85fb-200ae1a21202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:48:12.775062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:48:12.935391 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903681d2-dbb0-49de-a8c3-239ca23d84ab None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:48:12.951097 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903681d2-dbb0-49de-a8c3-239ca23d84ab None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:48:12.956592 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc23ec4-4808-4079-b544-85a450d5cefa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:48:12.957235 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc23ec4-4808-4079-b544-85a450d5cefa service nova] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:12.957521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc23ec4-4808-4079-b544-85a450d5cefa service nova] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:12.957797 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc23ec4-4808-4079-b544-85a450d5cefa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:12.967394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc23ec4-4808-4079-b544-85a450d5cefa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:48:12.969045 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc23ec4-4808-4079-b544-85a450d5cefa service nova] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:48:12.978482 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 712/1437] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:48:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:48:13.887025 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346d45c-b1ec-4c75-b6b3-caaf4435f863 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:13.887556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346d45c-b1ec-4c75-b6b3-caaf4435f863 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:13.887556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346d45c-b1ec-4c75-b6b3-caaf4435f863 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:13.888950 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:48:13.893879 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4175ce-ea6e-4bce-9183-22cd4a561c38 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:13.894309 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4175ce-ea6e-4bce-9183-22cd4a561c38 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:13.894429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4175ce-ea6e-4bce-9183-22cd4a561c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:13.913137 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-6c4175ce-ea6e-4bce-9183-22cd4a561c38 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:48:13.914324 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-6c4175ce-ea6e-4bce-9183-22cd4a561c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:48:13.922749 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:48:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:48:14.070880 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346d45c-b1ec-4c75-b6b3-caaf4435f863 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:48:14.085271 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346d45c-b1ec-4c75-b6b3-caaf4435f863 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:48:14.091103 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56d097-4103-420f-b32d-708db5fe1760 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:48:14.091765 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56d097-4103-420f-b32d-708db5fe1760 service nova] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:14.092048 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56d097-4103-420f-b32d-708db5fe1760 service nova] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:14.092321 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56d097-4103-420f-b32d-708db5fe1760 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:14.100373 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56d097-4103-420f-b32d-708db5fe1760 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:48:14.101985 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56d097-4103-420f-b32d-708db5fe1760 service nova] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:48:14.111841 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 727/1440] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:48:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:48:16.185352 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85563ae-2f06-462b-96b5-25f0129e32a7 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:16.185921 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85563ae-2f06-462b-96b5-25f0129e32a7 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:16.185921 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85563ae-2f06-462b-96b5-25f0129e32a7 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:16.187321 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:48:16.192714 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de1944-f86c-409a-8989-abe328e7590b None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:16.193414 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de1944-f86c-409a-8989-abe328e7590b None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:16.193414 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de1944-f86c-409a-8989-abe328e7590b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:16.214269 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-c4de1944-f86c-409a-8989-abe328e7590b None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:48:16.215539 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-c4de1944-f86c-409a-8989-abe328e7590b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:48:16.224165 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:48:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:48:16.263092 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85563ae-2f06-462b-96b5-25f0129e32a7 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:48:16.274242 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85563ae-2f06-462b-96b5-25f0129e32a7 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:48:16.278373 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479bac41-c1a2-4416-ab44-49effca5ccd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:48:16.279037 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bac41-c1a2-4416-ab44-49effca5ccd6 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:16.279325 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bac41-c1a2-4416-ab44-49effca5ccd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:16.279622 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bac41-c1a2-4416-ab44-49effca5ccd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:16.289682 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479bac41-c1a2-4416-ab44-49effca5ccd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:48:16.291779 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479bac41-c1a2-4416-ab44-49effca5ccd6 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:48:16.302686 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 715/1443] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:48:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:48:18.655440 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f82516-62ad-4aef-8afa-ab26faa3a362 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:18.656037 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f82516-62ad-4aef-8afa-ab26faa3a362 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:18.656037 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f82516-62ad-4aef-8afa-ab26faa3a362 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:18.657405 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:48:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:48:18.662714 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa64e4-9e76-4fa6-b826-20d13bdde276 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:18.663152 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa64e4-9e76-4fa6-b826-20d13bdde276 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:18.663284 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa64e4-9e76-4fa6-b826-20d13bdde276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:18.681718 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-2aaa64e4-9e76-4fa6-b826-20d13bdde276 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:48:18.683037 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-2aaa64e4-9e76-4fa6-b826-20d13bdde276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:48:18.690770 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:48:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:48:18.729363 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f82516-62ad-4aef-8afa-ab26faa3a362 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:48:18.740030 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f82516-62ad-4aef-8afa-ab26faa3a362 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:48:18.743482 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67967212-0916-40bf-ae61-435c72ae6961 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:48:18.744165 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67967212-0916-40bf-ae61-435c72ae6961 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:18.744693 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67967212-0916-40bf-ae61-435c72ae6961 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:18.744973 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67967212-0916-40bf-ae61-435c72ae6961 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:18.754079 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67967212-0916-40bf-ae61-435c72ae6961 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:48:18.755557 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67967212-0916-40bf-ae61-435c72ae6961 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:48:18.765719 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 730/1446] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:48:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:48:21.330027 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd9c0b-d213-4f88-ba83-811903b79bbf None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:21.330888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd9c0b-d213-4f88-ba83-811903b79bbf None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:21.330888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd9c0b-d213-4f88-ba83-811903b79bbf None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:21.331991 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:48:21.338747 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3ccb7-c403-4b4c-8c74-cf572a28d5ef None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:21.339203 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3ccb7-c403-4b4c-8c74-cf572a28d5ef None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:21.339344 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3ccb7-c403-4b4c-8c74-cf572a28d5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:21.358022 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-69b3ccb7-c403-4b4c-8c74-cf572a28d5ef None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:48:21.359217 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-69b3ccb7-c403-4b4c-8c74-cf572a28d5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:48:21.367748 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:48:21.406790 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd9c0b-d213-4f88-ba83-811903b79bbf None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:48:21.418287 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd9c0b-d213-4f88-ba83-811903b79bbf None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:48:21.421785 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d441fc-9d2c-4bce-95e7-d31aed4ae758 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:48:21.422409 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d441fc-9d2c-4bce-95e7-d31aed4ae758 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:21.422692 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d441fc-9d2c-4bce-95e7-d31aed4ae758 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:21.422963 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d441fc-9d2c-4bce-95e7-d31aed4ae758 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:21.431775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d441fc-9d2c-4bce-95e7-d31aed4ae758 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:48:21.433211 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d441fc-9d2c-4bce-95e7-d31aed4ae758 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:48:21.442403 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 718/1449] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:48:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:48:23.757435 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d02ba-afc2-4840-b412-4877240b0ff9 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:23.757994 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d02ba-afc2-4840-b412-4877240b0ff9 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:23.757994 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d02ba-afc2-4840-b412-4877240b0ff9 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:23.759405 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:48:23.764799 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5ce62-cc1c-44e1-aa0e-0874a2bbd4ab None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:23.765246 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5ce62-cc1c-44e1-aa0e-0874a2bbd4ab None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:23.765352 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5ce62-cc1c-44e1-aa0e-0874a2bbd4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:23.783238 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-39b5ce62-cc1c-44e1-aa0e-0874a2bbd4ab None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:48:23.784468 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-39b5ce62-cc1c-44e1-aa0e-0874a2bbd4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:48:23.792793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:48:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:48:23.829892 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d02ba-afc2-4840-b412-4877240b0ff9 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:48:23.841484 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d02ba-afc2-4840-b412-4877240b0ff9 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:48:23.845019 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331416bd-e4a4-42b3-a1f9-fc1835926ddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:48:23.845644 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331416bd-e4a4-42b3-a1f9-fc1835926ddc service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:23.845978 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331416bd-e4a4-42b3-a1f9-fc1835926ddc service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:23.846203 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331416bd-e4a4-42b3-a1f9-fc1835926ddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:23.855980 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331416bd-e4a4-42b3-a1f9-fc1835926ddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:48:23.857407 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331416bd-e4a4-42b3-a1f9-fc1835926ddc service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:48:23.866694 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 733/1452] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:48:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:48:26.151041 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a7955-f4f7-4141-a610-3e277436cf74 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:26.151645 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a7955-f4f7-4141-a610-3e277436cf74 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:26.151645 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a7955-f4f7-4141-a610-3e277436cf74 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:26.153008 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:48:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:48:26.158419 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265fa3c-5885-4444-bad1-6a426fb273a6 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:26.158851 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265fa3c-5885-4444-bad1-6a426fb273a6 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:26.158970 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265fa3c-5885-4444-bad1-6a426fb273a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:26.178094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-0265fa3c-5885-4444-bad1-6a426fb273a6 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:48:26.179315 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-0265fa3c-5885-4444-bad1-6a426fb273a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:48:26.187103 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:48:26.225308 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a7955-f4f7-4141-a610-3e277436cf74 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:48:26.235944 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a7955-f4f7-4141-a610-3e277436cf74 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:48:26.239370 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a844d-6d5b-45a9-b93e-cd261e16bc55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:48:26.240024 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a844d-6d5b-45a9-b93e-cd261e16bc55 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:26.240308 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a844d-6d5b-45a9-b93e-cd261e16bc55 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:26.240587 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a844d-6d5b-45a9-b93e-cd261e16bc55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:26.249441 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a844d-6d5b-45a9-b93e-cd261e16bc55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:48:26.250856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a844d-6d5b-45a9-b93e-cd261e16bc55 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:48:26.260734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 721/1455] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:48:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:48:28.502340 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffe948-7473-4f50-be9c-e7d1b164b7ef None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:28.502869 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffe948-7473-4f50-be9c-e7d1b164b7ef None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:28.502869 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffe948-7473-4f50-be9c-e7d1b164b7ef None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:28.504214 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:48:28.510273 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f7e91-3ed1-4217-8934-f9b2cea129a7 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:28.510661 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f7e91-3ed1-4217-8934-f9b2cea129a7 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:28.510828 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f7e91-3ed1-4217-8934-f9b2cea129a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:28.529022 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-414f7e91-3ed1-4217-8934-f9b2cea129a7 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:48:28.530265 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-414f7e91-3ed1-4217-8934-f9b2cea129a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:48:28.538080 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:48:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:48:28.576462 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffe948-7473-4f50-be9c-e7d1b164b7ef None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:48:28.587891 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffe948-7473-4f50-be9c-e7d1b164b7ef None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:48:28.591555 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f4782-dac9-438d-8ddb-e5fed37c5274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:48:28.592207 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f4782-dac9-438d-8ddb-e5fed37c5274 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:28.592487 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f4782-dac9-438d-8ddb-e5fed37c5274 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:28.592758 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f4782-dac9-438d-8ddb-e5fed37c5274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:28.601479 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f4782-dac9-438d-8ddb-e5fed37c5274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:48:28.603113 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f4782-dac9-438d-8ddb-e5fed37c5274 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:48:28.612559 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 736/1458] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:48:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:48:30.967793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40e714-e47d-4918-9837-c62c1582a834 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:30.968671 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40e714-e47d-4918-9837-c62c1582a834 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:30.968671 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40e714-e47d-4918-9837-c62c1582a834 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:30.969762 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:48:30.976233 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c5527-0902-4697-8dc5-9b1c4a47a031 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:30.976716 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c5527-0902-4697-8dc5-9b1c4a47a031 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:30.976835 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c5527-0902-4697-8dc5-9b1c4a47a031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:30.982813 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=70 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:48:30.995761 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-4b3c5527-0902-4697-8dc5-9b1c4a47a031 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:48:30.997774 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-4b3c5527-0902-4697-8dc5-9b1c4a47a031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:48:31.007281 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:48:31.046492 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40e714-e47d-4918-9837-c62c1582a834 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:48:31.051884 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=73 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:48:31.058266 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40e714-e47d-4918-9837-c62c1582a834 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:48:31.061750 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c7e83-2d63-44a3-a6ed-dcd6acb3ed62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:48:31.063880 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c7e83-2d63-44a3-a6ed-dcd6acb3ed62 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:31.063880 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c7e83-2d63-44a3-a6ed-dcd6acb3ed62 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:31.063880 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c7e83-2d63-44a3-a6ed-dcd6acb3ed62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:31.072061 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c7e83-2d63-44a3-a6ed-dcd6acb3ed62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:48:31.073490 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c7e83-2d63-44a3-a6ed-dcd6acb3ed62 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:48:31.084143 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 724/1461] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:48:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:48:33.343047 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb71f35-5227-468e-baaf-aae062784864 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:33.343643 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb71f35-5227-468e-baaf-aae062784864 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:33.343643 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb71f35-5227-468e-baaf-aae062784864 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:33.345028 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:48:33.350544 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2d094-fb0c-4397-9a3f-ff143db16090 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:33.350954 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2d094-fb0c-4397-9a3f-ff143db16090 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:33.351095 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2d094-fb0c-4397-9a3f-ff143db16090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:33.369106 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-6fa2d094-fb0c-4397-9a3f-ff143db16090 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:48:33.370276 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-6fa2d094-fb0c-4397-9a3f-ff143db16090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:48:33.377972 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:48:33.414712 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb71f35-5227-468e-baaf-aae062784864 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:48:33.425869 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb71f35-5227-468e-baaf-aae062784864 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:48:33.429370 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eddf4be-98a3-470f-bca3-d74d0482b4e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:48:33.429995 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddf4be-98a3-470f-bca3-d74d0482b4e7 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:33.430279 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddf4be-98a3-470f-bca3-d74d0482b4e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:33.430806 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddf4be-98a3-470f-bca3-d74d0482b4e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:33.439615 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eddf4be-98a3-470f-bca3-d74d0482b4e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:48:33.441046 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eddf4be-98a3-470f-bca3-d74d0482b4e7 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:48:33.450399 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 739/1464] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:48:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:48:35.647285 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73823c-5e4b-4834-8be1-7428c6b31af2 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:35.647786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73823c-5e4b-4834-8be1-7428c6b31af2 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:35.647901 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73823c-5e4b-4834-8be1-7428c6b31af2 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:35.649758 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:48:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:48:35.655084 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda8239-0179-4141-9722-b152712b25dd None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:35.655551 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda8239-0179-4141-9722-b152712b25dd None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:35.655690 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda8239-0179-4141-9722-b152712b25dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:35.673790 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-1eda8239-0179-4141-9722-b152712b25dd None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:48:35.674983 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-1eda8239-0179-4141-9722-b152712b25dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:48:35.682721 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:48:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:48:35.735228 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73823c-5e4b-4834-8be1-7428c6b31af2 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:48:35.735228 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-8c73823c-5e4b-4834-8be1-7428c6b31af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:48:35.735228 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73823c-5e4b-4834-8be1-7428c6b31af2 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:48:35.738714 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41334b5a-38ef-42f2-8899-0c3040b0b1f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:48:35.739345 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41334b5a-38ef-42f2-8899-0c3040b0b1f9 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:35.739658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41334b5a-38ef-42f2-8899-0c3040b0b1f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:35.739965 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41334b5a-38ef-42f2-8899-0c3040b0b1f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:35.749969 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41334b5a-38ef-42f2-8899-0c3040b0b1f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:48:35.751410 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41334b5a-38ef-42f2-8899-0c3040b0b1f9 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:48:35.761325 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 727/1467] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:48:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:48:38.157906 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c8fd6-1c41-4a39-81df-a00f07dd7bf2 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:38.158482 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c8fd6-1c41-4a39-81df-a00f07dd7bf2 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:38.158482 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c8fd6-1c41-4a39-81df-a00f07dd7bf2 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:38.159892 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:48:38.165834 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4fb75-550e-4db9-81d1-0cd3ff49f730 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:38.166258 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4fb75-550e-4db9-81d1-0cd3ff49f730 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:38.166389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4fb75-550e-4db9-81d1-0cd3ff49f730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:38.184276 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-19a4fb75-550e-4db9-81d1-0cd3ff49f730 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:48:38.185446 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-19a4fb75-550e-4db9-81d1-0cd3ff49f730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:48:38.193106 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:48:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:48:38.230468 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c8fd6-1c41-4a39-81df-a00f07dd7bf2 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:48:38.242541 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c8fd6-1c41-4a39-81df-a00f07dd7bf2 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:48:38.247584 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ee0a3-0b2f-49a0-b2c8-ee505a484660 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:48:38.248322 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ee0a3-0b2f-49a0-b2c8-ee505a484660 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:48:38.248646 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ee0a3-0b2f-49a0-b2c8-ee505a484660 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:48:38.248960 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ee0a3-0b2f-49a0-b2c8-ee505a484660 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:48:38.258288 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ee0a3-0b2f-49a0-b2c8-ee505a484660 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:48:38.259949 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ee0a3-0b2f-49a0-b2c8-ee505a484660 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:48:38.269256 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 742/1470] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:48:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:48:48.178521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=17 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:48:48.265076 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=17 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:49:11.686204 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bda9b8-62c0-4036-a313-df4757f7a055 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:11.690849 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bda9b8-62c0-4036-a313-df4757f7a055 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:11.690849 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bda9b8-62c0-4036-a313-df4757f7a055 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:11.690849 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 729/1471] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:49:11.693361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cc343-6999-4c5a-8247-1657922227ff None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:11.693830 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cc343-6999-4c5a-8247-1657922227ff None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:11.693944 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cc343-6999-4c5a-8247-1657922227ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:11.712616 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-5f3cc343-6999-4c5a-8247-1657922227ff None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:49:11.713940 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-5f3cc343-6999-4c5a-8247-1657922227ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:11.721932 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 743/1472] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:49:11.769705 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587adb7-32de-4f65-a330-319c6732e042 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:11.770016 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587adb7-32de-4f65-a330-319c6732e042 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:11.770295 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587adb7-32de-4f65-a330-319c6732e042 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:11.771716 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 730/1473] 10.222.0.39 () {54 vars in 962 bytes} [Mon May 23 15:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:49:11.776737 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c1066-ddff-4a4a-a5ce-67234e1d0c28 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:11.777022 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c1066-ddff-4a4a-a5ce-67234e1d0c28 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:11.777300 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c1066-ddff-4a4a-a5ce-67234e1d0c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:11.795122 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-a29c1066-ddff-4a4a-a5ce-67234e1d0c28 None None] MFA Rules not processed for user `d003ff6cc73946da9203c69a167bbfff`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:49:11.796369 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-a29c1066-ddff-4a4a-a5ce-67234e1d0c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:11.802856 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 744/1474] 10.222.0.39 () {58 vars in 1059 bytes} [Mon May 23 15:49:11 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:49:11.810938 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587adb7-32de-4f65-a330-319c6732e042 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:11.822497 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587adb7-32de-4f65-a330-319c6732e042 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:11.826090 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844aa4c-b7c8-43a7-95fa-2a185d4af194 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd003ff6cc73946da9203c69a167bbfff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:11.826719 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844aa4c-b7c8-43a7-95fa-2a185d4af194 service glance] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:11.827007 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844aa4c-b7c8-43a7-95fa-2a185d4af194 service glance] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:11.827281 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844aa4c-b7c8-43a7-95fa-2a185d4af194 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:11.836665 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844aa4c-b7c8-43a7-95fa-2a185d4af194 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:11.842191 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844aa4c-b7c8-43a7-95fa-2a185d4af194 service glance] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:11.847619 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 731/1475] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:49:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:49:14.147851 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8beba76-640e-423f-b1e9-0c4b05586be7 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:14.148420 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8beba76-640e-423f-b1e9-0c4b05586be7 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:14.148420 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8beba76-640e-423f-b1e9-0c4b05586be7 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:14.149801 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 745/1476] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:49:14.154979 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3a096-79b5-47bc-a557-79d334688a2c None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:14.155405 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3a096-79b5-47bc-a557-79d334688a2c None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:14.155530 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3a096-79b5-47bc-a557-79d334688a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:14.174466 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-9af3a096-79b5-47bc-a557-79d334688a2c None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:49:14.175700 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-9af3a096-79b5-47bc-a557-79d334688a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:14.184882 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 732/1477] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:49:14.208077 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8beba76-640e-423f-b1e9-0c4b05586be7 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:14.220583 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8beba76-640e-423f-b1e9-0c4b05586be7 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:14.225520 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94b736-0503-4f36-9c92-18874857c5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:14.226176 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94b736-0503-4f36-9c92-18874857c5ad admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:14.226458 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94b736-0503-4f36-9c92-18874857c5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:14.226733 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94b736-0503-4f36-9c92-18874857c5ad admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:14.227460 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94b736-0503-4f36-9c92-18874857c5ad admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:14.229247 dv-cinder-842119-2-smb devstack@keystone.service[87191]: WARNING py.warnings [None req-9a94b736-0503-4f36-9c92-18874857c5ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 15:49:14.229247 dv-cinder-842119-2-smb devstack@keystone.service[87191]: warnings.warn(msg) May 23 15:49:14.229247 dv-cinder-842119-2-smb devstack@keystone.service[87191]: May 23 15:49:14.230380 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94b736-0503-4f36-9c92-18874857c5ad admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:14.249770 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 746/1478] 10.222.0.39 () {56 vars in 1108 bytes} [Mon May 23 15:49:14 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:49:16.477992 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714ceca-e9cb-44f0-83e7-8cdb6473bc82 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:16.478533 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714ceca-e9cb-44f0-83e7-8cdb6473bc82 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:16.478533 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714ceca-e9cb-44f0-83e7-8cdb6473bc82 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:16.479956 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 733/1479] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:49:16.485240 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3461c80-dde6-4bdc-92fc-bff233847d88 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:16.485641 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3461c80-dde6-4bdc-92fc-bff233847d88 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:16.485814 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3461c80-dde6-4bdc-92fc-bff233847d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:16.503718 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-b3461c80-dde6-4bdc-92fc-bff233847d88 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:49:16.504909 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-b3461c80-dde6-4bdc-92fc-bff233847d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:16.513390 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 747/1480] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:49:16.556408 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714ceca-e9cb-44f0-83e7-8cdb6473bc82 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:16.571251 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714ceca-e9cb-44f0-83e7-8cdb6473bc82 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:16.576587 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95679d5-126d-487e-bc26-54a80122033d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:16.577210 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95679d5-126d-487e-bc26-54a80122033d service nova] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:16.577487 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95679d5-126d-487e-bc26-54a80122033d service nova] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:16.577760 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95679d5-126d-487e-bc26-54a80122033d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:16.586749 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95679d5-126d-487e-bc26-54a80122033d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:16.588394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95679d5-126d-487e-bc26-54a80122033d service nova] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:16.597595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 734/1481] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:49:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:49:18.985251 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89ceab-d08f-4f4e-bef0-58cfeb5fba3f None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:18.985890 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89ceab-d08f-4f4e-bef0-58cfeb5fba3f None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:18.985890 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89ceab-d08f-4f4e-bef0-58cfeb5fba3f None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:18.987159 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 748/1482] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:49:18.992966 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72487e7-d19d-4746-b19e-1d8fd4cfae91 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:18.993427 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72487e7-d19d-4746-b19e-1d8fd4cfae91 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:18.993591 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72487e7-d19d-4746-b19e-1d8fd4cfae91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:19.011044 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-b72487e7-d19d-4746-b19e-1d8fd4cfae91 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:49:19.012279 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-b72487e7-d19d-4746-b19e-1d8fd4cfae91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:19.020001 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 735/1483] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:49:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:49:19.055571 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89ceab-d08f-4f4e-bef0-58cfeb5fba3f None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:19.066113 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89ceab-d08f-4f4e-bef0-58cfeb5fba3f None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:19.069747 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f1d27-08c7-44c3-b9ab-be9917fda816 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:19.070372 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f1d27-08c7-44c3-b9ab-be9917fda816 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:19.070652 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f1d27-08c7-44c3-b9ab-be9917fda816 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:19.070927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f1d27-08c7-44c3-b9ab-be9917fda816 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:19.079620 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f1d27-08c7-44c3-b9ab-be9917fda816 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:19.081046 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f1d27-08c7-44c3-b9ab-be9917fda816 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:19.091045 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 749/1484] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:49:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:49:21.323250 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46d049-e12a-4425-804b-995c45400061 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:21.323849 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46d049-e12a-4425-804b-995c45400061 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:21.324024 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46d049-e12a-4425-804b-995c45400061 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:21.325433 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 736/1485] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:49:21.330549 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a4df6-bafa-426d-bcfb-234f21b41018 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:21.330992 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a4df6-bafa-426d-bcfb-234f21b41018 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:21.331096 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a4df6-bafa-426d-bcfb-234f21b41018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:21.348905 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-6d9a4df6-bafa-426d-bcfb-234f21b41018 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:49:21.350092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-6d9a4df6-bafa-426d-bcfb-234f21b41018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:21.357839 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 750/1486] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:49:21.398539 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46d049-e12a-4425-804b-995c45400061 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:21.408991 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46d049-e12a-4425-804b-995c45400061 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:21.412662 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ecc1d8-4823-4915-858f-f020fd5c2586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:21.413226 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecc1d8-4823-4915-858f-f020fd5c2586 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:21.413506 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecc1d8-4823-4915-858f-f020fd5c2586 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:21.413777 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecc1d8-4823-4915-858f-f020fd5c2586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:21.422548 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ecc1d8-4823-4915-858f-f020fd5c2586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:21.424005 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ecc1d8-4823-4915-858f-f020fd5c2586 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:21.434207 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 737/1487] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:49:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:49:23.800738 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be745b1-ffbd-42bd-b827-817b0d48a729 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:23.801334 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be745b1-ffbd-42bd-b827-817b0d48a729 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:23.801334 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be745b1-ffbd-42bd-b827-817b0d48a729 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:23.803157 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 751/1488] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:49:23.809012 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf6134-1740-4eb7-92c0-6d86c62ffc59 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:23.809456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf6134-1740-4eb7-92c0-6d86c62ffc59 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:23.809561 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf6134-1740-4eb7-92c0-6d86c62ffc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:23.828077 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-a9cf6134-1740-4eb7-92c0-6d86c62ffc59 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:49:23.829269 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-a9cf6134-1740-4eb7-92c0-6d86c62ffc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:23.838210 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 738/1489] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:49:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:49:23.879397 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be745b1-ffbd-42bd-b827-817b0d48a729 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:23.890719 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be745b1-ffbd-42bd-b827-817b0d48a729 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:23.894101 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99a67d-84ba-47af-9544-673c99962d48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:23.894723 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99a67d-84ba-47af-9544-673c99962d48 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:23.895003 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99a67d-84ba-47af-9544-673c99962d48 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:23.895276 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99a67d-84ba-47af-9544-673c99962d48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:23.904238 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99a67d-84ba-47af-9544-673c99962d48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:23.905653 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99a67d-84ba-47af-9544-673c99962d48 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:23.915890 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 752/1490] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:49:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:49:26.544653 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d9f56-3230-40b5-ab60-31f9b6aaf6e8 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:26.545189 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d9f56-3230-40b5-ab60-31f9b6aaf6e8 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:26.545189 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d9f56-3230-40b5-ab60-31f9b6aaf6e8 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:26.546554 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 739/1491] 10.222.0.39 () {54 vars in 926 bytes} [Mon May 23 15:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:49:26.551676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1417a-d272-44a9-892e-85dd02a6b97e None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:26.552084 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1417a-d272-44a9-892e-85dd02a6b97e None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:26.552232 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1417a-d272-44a9-892e-85dd02a6b97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:26.570596 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-3ab1417a-d272-44a9-892e-85dd02a6b97e None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:49:26.571798 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-3ab1417a-d272-44a9-892e-85dd02a6b97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:26.579380 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 753/1492] 10.222.0.39 () {58 vars in 1023 bytes} [Mon May 23 15:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:49:26.617591 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d9f56-3230-40b5-ab60-31f9b6aaf6e8 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:26.628118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d9f56-3230-40b5-ab60-31f9b6aaf6e8 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:26.632284 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d3554-0857-4b4d-9bd4-7098ebe32f4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:26.632898 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d3554-0857-4b4d-9bd4-7098ebe32f4b service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:26.633181 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d3554-0857-4b4d-9bd4-7098ebe32f4b service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:26.633458 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d3554-0857-4b4d-9bd4-7098ebe32f4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:26.642320 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d3554-0857-4b4d-9bd4-7098ebe32f4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:26.643721 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d3554-0857-4b4d-9bd4-7098ebe32f4b service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:26.654170 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 740/1493] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:49:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:49:36.564998 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=33 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:49:36.649166 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=33 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:51:22.842717 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4afe1-8105-41c8-bce5-59a5cf44263e None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:51:22.843976 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4afe1-8105-41c8-bce5-59a5cf44263e None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:51:22.843976 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4afe1-8105-41c8-bce5-59a5cf44263e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:51:22.863318 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-a9b4afe1-8105-41c8-bce5-59a5cf44263e None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:51:22.864764 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-a9b4afe1-8105-41c8-bce5-59a5cf44263e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:51:22.872671 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 754/1494] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:51:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:51:22.881994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d4d2a-8403-4f6c-93f0-489ba7dde1cb None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:51:22.882546 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d4d2a-8403-4f6c-93f0-489ba7dde1cb None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:51:22.882546 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d4d2a-8403-4f6c-93f0-489ba7dde1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:51:22.900494 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-a48d4d2a-8403-4f6c-93f0-489ba7dde1cb None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:51:22.901691 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-a48d4d2a-8403-4f6c-93f0-489ba7dde1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:51:22.910558 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 741/1495] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:51:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:51:22.915168 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4afe1-8105-41c8-bce5-59a5cf44263e None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:51:22.925674 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4afe1-8105-41c8-bce5-59a5cf44263e None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:51:22.930206 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5a927-d6c5-4984-b16a-801ee8b622cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:51:22.930866 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5a927-d6c5-4984-b16a-801ee8b622cc admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:51:22.931146 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5a927-d6c5-4984-b16a-801ee8b622cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:51:22.931450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5a927-d6c5-4984-b16a-801ee8b622cc admin admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:51:22.932201 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5a927-d6c5-4984-b16a-801ee8b622cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:51:22.932512 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5a927-d6c5-4984-b16a-801ee8b622cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:51:22.933531 dv-cinder-842119-2-smb devstack@keystone.service[87191]: WARNING py.warnings [None req-ccb5a927-d6c5-4984-b16a-801ee8b622cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 15:51:22.933531 dv-cinder-842119-2-smb devstack@keystone.service[87191]: warnings.warn(msg) May 23 15:51:22.933531 dv-cinder-842119-2-smb devstack@keystone.service[87191]: May 23 15:51:22.934409 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5a927-d6c5-4984-b16a-801ee8b622cc admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:51:22.946987 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 755/1496] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 15:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:51:22.956803 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d4d2a-8403-4f6c-93f0-489ba7dde1cb None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:51:22.966082 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d4d2a-8403-4f6c-93f0-489ba7dde1cb None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:51:22.971544 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f440c0c-c99a-4aed-a8b5-eeaf87bdf6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:51:22.972237 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f440c0c-c99a-4aed-a8b5-eeaf87bdf6da admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:51:22.972522 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f440c0c-c99a-4aed-a8b5-eeaf87bdf6da admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:51:22.972797 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f440c0c-c99a-4aed-a8b5-eeaf87bdf6da admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:51:22.973541 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f440c0c-c99a-4aed-a8b5-eeaf87bdf6da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:51:22.975349 dv-cinder-842119-2-smb devstack@keystone.service[87192]: WARNING py.warnings [None req-1f440c0c-c99a-4aed-a8b5-eeaf87bdf6da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 15:51:22.975349 dv-cinder-842119-2-smb devstack@keystone.service[87192]: warnings.warn(msg) May 23 15:51:22.975349 dv-cinder-842119-2-smb devstack@keystone.service[87192]: May 23 15:51:22.976592 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f440c0c-c99a-4aed-a8b5-eeaf87bdf6da admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:51:23.088076 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 742/1497] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:51:22 2022] POST /identity/v3/projects => generated 379 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:51:23.092579 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5a927-d6c5-4984-b16a-801ee8b622cc admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:51:23.103050 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5a927-d6c5-4984-b16a-801ee8b622cc admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:51:23.161129 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4f725-88d4-4724-8186-ce2afdea13d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:51:23.161810 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4f725-88d4-4724-8186-ce2afdea13d3 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:51:23.162095 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4f725-88d4-4724-8186-ce2afdea13d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:51:23.162375 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4f725-88d4-4724-8186-ce2afdea13d3 admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:51:23.163088 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c4f725-88d4-4724-8186-ce2afdea13d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:51:23.164149 dv-cinder-842119-2-smb devstack@keystone.service[87191]: WARNING py.warnings [None req-c9c4f725-88d4-4724-8186-ce2afdea13d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 15:51:23.164149 dv-cinder-842119-2-smb devstack@keystone.service[87191]: warnings.warn(msg) May 23 15:51:23.164149 dv-cinder-842119-2-smb devstack@keystone.service[87191]: May 23 15:51:23.165392 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c4f725-88d4-4724-8186-ce2afdea13d3 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:51:23.243426 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 756/1498] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:51:23 2022] POST /identity/v3/users => generated 290 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:51:23.247844 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f440c0c-c99a-4aed-a8b5-eeaf87bdf6da admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:51:23.259508 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f440c0c-c99a-4aed-a8b5-eeaf87bdf6da admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:51:23.264092 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a235a-49b3-4365-a256-39eee21ff550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:51:23.264756 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a235a-49b3-4365-a256-39eee21ff550 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:51:23.265043 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a235a-49b3-4365-a256-39eee21ff550 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:51:23.265318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a235a-49b3-4365-a256-39eee21ff550 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:51:23.266080 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a235a-49b3-4365-a256-39eee21ff550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:51:23.267108 dv-cinder-842119-2-smb devstack@keystone.service[87192]: WARNING py.warnings [None req-4e1a235a-49b3-4365-a256-39eee21ff550 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 15:51:23.267108 dv-cinder-842119-2-smb devstack@keystone.service[87192]: warnings.warn(msg) May 23 15:51:23.267108 dv-cinder-842119-2-smb devstack@keystone.service[87192]: May 23 15:51:23.268033 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a235a-49b3-4365-a256-39eee21ff550 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:51:23.281769 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 743/1499] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:51:23.285961 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4f725-88d4-4724-8186-ce2afdea13d3 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:51:23.296137 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4f725-88d4-4724-8186-ce2afdea13d3 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:51:23.308274 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e698d1e-14c0-41bc-9bd7-b51027dcbc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:51:23.308956 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e698d1e-14c0-41bc-9bd7-b51027dcbc52 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:51:23.309241 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e698d1e-14c0-41bc-9bd7-b51027dcbc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:51:23.309515 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e698d1e-14c0-41bc-9bd7-b51027dcbc52 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:51:23.310277 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e698d1e-14c0-41bc-9bd7-b51027dcbc52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:51:23.311421 dv-cinder-842119-2-smb devstack@keystone.service[87191]: WARNING py.warnings [None req-7e698d1e-14c0-41bc-9bd7-b51027dcbc52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 15:51:23.311421 dv-cinder-842119-2-smb devstack@keystone.service[87191]: warnings.warn(msg) May 23 15:51:23.311421 dv-cinder-842119-2-smb devstack@keystone.service[87191]: May 23 15:51:23.312928 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e698d1e-14c0-41bc-9bd7-b51027dcbc52 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:51:23.327210 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 757/1500] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:51:23.331752 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a235a-49b3-4365-a256-39eee21ff550 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:51:23.341766 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a235a-49b3-4365-a256-39eee21ff550 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:51:23.346270 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c8e32-2ed7-46a4-9d2c-ce82b168fcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:51:23.347155 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c8e32-2ed7-46a4-9d2c-ce82b168fcaf admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:51:23.347434 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c8e32-2ed7-46a4-9d2c-ce82b168fcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:51:23.347763 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c8e32-2ed7-46a4-9d2c-ce82b168fcaf admin admin] PATH_INFO: `/v3/projects/44ab5901dcc448a69b0e87fabc924ae9/users/a4c93b7e635044fe9335c8c45a4cfa86/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:51:23.363273 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c8e32-2ed7-46a4-9d2c-ce82b168fcaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=44ab5901dcc448a69b0e87fabc924ae9, user_id=a4c93b7e635044fe9335c8c45a4cfa86, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:51:23.364360 dv-cinder-842119-2-smb devstack@keystone.service[87192]: WARNING py.warnings [None req-d32c8e32-2ed7-46a4-9d2c-ce82b168fcaf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 15:51:23.364360 dv-cinder-842119-2-smb devstack@keystone.service[87192]: warnings.warn(msg) May 23 15:51:23.364360 dv-cinder-842119-2-smb devstack@keystone.service[87192]: May 23 15:51:23.366287 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c8e32-2ed7-46a4-9d2c-ce82b168fcaf admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:51:23.431389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 744/1501] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:51:23 2022] PUT /identity/v3/projects/44ab5901dcc448a69b0e87fabc924ae9/users/a4c93b7e635044fe9335c8c45a4cfa86/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:51:23.448448 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26d9f0-c02c-4bd2-9f33-6fce9ba51f65 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:51:23.448722 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26d9f0-c02c-4bd2-9f33-6fce9ba51f65 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:51:23.449001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26d9f0-c02c-4bd2-9f33-6fce9ba51f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:51:23.477416 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-ba26d9f0-c02c-4bd2-9f33-6fce9ba51f65 None None] MFA Rules not processed for user `a4c93b7e635044fe9335c8c45a4cfa86`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:51:23.478650 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-ba26d9f0-c02c-4bd2-9f33-6fce9ba51f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:51:23.552250 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 758/1502] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:51:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:51:23.567107 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b31bc-03f9-4420-8687-16cd0c5b0da4 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:51:23.567483 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b31bc-03f9-4420-8687-16cd0c5b0da4 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:51:23.567862 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b31bc-03f9-4420-8687-16cd0c5b0da4 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:51:23.569311 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 745/1503] 10.222.0.39 () {54 vars in 963 bytes} [Mon May 23 15:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:51:23.580844 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca26b4-240a-45a2-acc6-b5c84e320e68 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:51:23.581134 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca26b4-240a-45a2-acc6-b5c84e320e68 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:51:23.581412 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca26b4-240a-45a2-acc6-b5c84e320e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:51:23.600322 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-efca26b4-240a-45a2-acc6-b5c84e320e68 None None] MFA Rules not processed for user `3514c56baee94de39d6be4c8790ef76b`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:51:23.601431 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-efca26b4-240a-45a2-acc6-b5c84e320e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:51:23.645420 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:51:23.652795 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 759/1504] 10.222.0.39 () {58 vars in 1060 bytes} [Mon May 23 15:51:23 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:51:23.768173 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b31bc-03f9-4420-8687-16cd0c5b0da4 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:51:23.778685 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b31bc-03f9-4420-8687-16cd0c5b0da4 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:51:23.783045 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39471ca1-5d65-4740-b533-c835b4552370 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:51:23.783711 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39471ca1-5d65-4740-b533-c835b4552370 service cinder] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:51:23.783995 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39471ca1-5d65-4740-b533-c835b4552370 service cinder] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:51:23.784266 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39471ca1-5d65-4740-b533-c835b4552370 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:51:23.792618 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39471ca1-5d65-4740-b533-c835b4552370 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:51:23.794044 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39471ca1-5d65-4740-b533-c835b4552370 service cinder] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:51:23.803480 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 746/1505] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:51:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:51:23.846513 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7199b-dc51-4123-b78c-40a53d78793c None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:51:23.846944 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7199b-dc51-4123-b78c-40a53d78793c None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:51:23.847054 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7199b-dc51-4123-b78c-40a53d78793c None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:51:23.848373 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 760/1506] 10.222.0.39 () {52 vars in 829 bytes} [Mon May 23 15:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:51:23.851969 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39471ca1-5d65-4740-b533-c835b4552370 service cinder] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:51:23.915270 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39471ca1-5d65-4740-b533-c835b4552370 service cinder] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:51:23.920148 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e9431-4a90-4a17-9c84-6386adbdb013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:51:23.921023 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e9431-4a90-4a17-9c84-6386adbdb013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:51:23.922054 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e9431-4a90-4a17-9c84-6386adbdb013 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:51:23.922335 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e9431-4a90-4a17-9c84-6386adbdb013 admin admin] PATH_INFO: `/v3/users/a4c93b7e635044fe9335c8c45a4cfa86` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:51:23.923535 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e9431-4a90-4a17-9c84-6386adbdb013 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4c93b7e635044fe9335c8c45a4cfa86)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:51:23.924599 dv-cinder-842119-2-smb devstack@keystone.service[87192]: WARNING py.warnings [None req-a38e9431-4a90-4a17-9c84-6386adbdb013 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 15:51:23.924599 dv-cinder-842119-2-smb devstack@keystone.service[87192]: warnings.warn(msg) May 23 15:51:23.924599 dv-cinder-842119-2-smb devstack@keystone.service[87192]: May 23 15:51:23.925794 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e9431-4a90-4a17-9c84-6386adbdb013 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:51:24.129633 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-a38e9431-4a90-4a17-9c84-6386adbdb013 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4c93b7e635044fe9335c8c45a4cfa86'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:51:24.143237 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-a38e9431-4a90-4a17-9c84-6386adbdb013 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4c93b7e635044fe9335c8c45a4cfa86'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:51:24.144124 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-a38e9431-4a90-4a17-9c84-6386adbdb013 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4c93b7e635044fe9335c8c45a4cfa86'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:51:24.163040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-a38e9431-4a90-4a17-9c84-6386adbdb013 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4c93b7e635044fe9335c8c45a4cfa86'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:51:24.167024 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:51:24.267913 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-a38e9431-4a90-4a17-9c84-6386adbdb013 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4c93b7e635044fe9335c8c45a4cfa86'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:51:24.274714 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 747/1507] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:51:23 2022] DELETE /identity/v3/users/a4c93b7e635044fe9335c8c45a4cfa86 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:51:24.279239 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3585f8c-3ce4-4cba-bb52-6153e193c1e2 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:51:24.279542 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3585f8c-3ce4-4cba-bb52-6153e193c1e2 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:51:24.279844 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3585f8c-3ce4-4cba-bb52-6153e193c1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:51:24.299053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-d3585f8c-3ce4-4cba-bb52-6153e193c1e2 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:51:24.300289 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-d3585f8c-3ce4-4cba-bb52-6153e193c1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:51:24.360378 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 761/1508] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:51:24.369827 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e9431-4a90-4a17-9c84-6386adbdb013 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:51:24.371243 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-a38e9431-4a90-4a17-9c84-6386adbdb013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:51:24.432256 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e9431-4a90-4a17-9c84-6386adbdb013 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:51:24.435720 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236097c-6489-459a-8224-c35e05f2308f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:51:24.436367 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236097c-6489-459a-8224-c35e05f2308f service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:51:24.436654 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236097c-6489-459a-8224-c35e05f2308f service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:51:24.437541 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236097c-6489-459a-8224-c35e05f2308f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:51:24.446482 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236097c-6489-459a-8224-c35e05f2308f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:51:24.447961 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236097c-6489-459a-8224-c35e05f2308f service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:51:24.458180 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 748/1509] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:51:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:51:24.956965 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3585f8c-3ce4-4cba-bb52-6153e193c1e2 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:51:24.958508 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-d3585f8c-3ce4-4cba-bb52-6153e193c1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:51:24.971502 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3585f8c-3ce4-4cba-bb52-6153e193c1e2 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:51:24.976771 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41adbdc6-7d48-4099-9f1d-ec74b08704c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:51:24.977657 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adbdc6-7d48-4099-9f1d-ec74b08704c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:51:24.977936 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adbdc6-7d48-4099-9f1d-ec74b08704c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:51:24.978209 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adbdc6-7d48-4099-9f1d-ec74b08704c4 admin admin] PATH_INFO: `/v3/projects/44ab5901dcc448a69b0e87fabc924ae9` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:51:24.979566 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41adbdc6-7d48-4099-9f1d-ec74b08704c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44ab5901dcc448a69b0e87fabc924ae9)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:51:24.980546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: WARNING py.warnings [None req-41adbdc6-7d48-4099-9f1d-ec74b08704c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 15:51:24.980546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: warnings.warn(msg) May 23 15:51:24.980546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: May 23 15:51:24.981746 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41adbdc6-7d48-4099-9f1d-ec74b08704c4 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:51:25.455631 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-41adbdc6-7d48-4099-9f1d-ec74b08704c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44ab5901dcc448a69b0e87fabc924ae9', 'request_id': 'req-41adbdc6-7d48-4099-9f1d-ec74b08704c4'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:51:25.470289 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-41adbdc6-7d48-4099-9f1d-ec74b08704c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44ab5901dcc448a69b0e87fabc924ae9', 'request_id': 'req-41adbdc6-7d48-4099-9f1d-ec74b08704c4'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:51:25.570626 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-41adbdc6-7d48-4099-9f1d-ec74b08704c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44ab5901dcc448a69b0e87fabc924ae9', 'request_id': 'req-41adbdc6-7d48-4099-9f1d-ec74b08704c4'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:51:25.583555 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-41adbdc6-7d48-4099-9f1d-ec74b08704c4 admin admin] The token cache is being invalidate because project 44ab5901dcc448a69b0e87fabc924ae9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:51:25.583881 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-41adbdc6-7d48-4099-9f1d-ec74b08704c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:51:25.584646 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-41adbdc6-7d48-4099-9f1d-ec74b08704c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:51:25.586227 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 762/1510] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:51:24 2022] DELETE /identity/v3/projects/44ab5901dcc448a69b0e87fabc924ae9 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:51:34.453960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:51:35.580014 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:53:16.974442 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f1d4c-46a5-48a1-b8c9-520044fb6a2d None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:53:16.975056 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f1d4c-46a5-48a1-b8c9-520044fb6a2d None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:53:16.975056 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f1d4c-46a5-48a1-b8c9-520044fb6a2d None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:53:16.977013 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 749/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:53:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:53:16.982026 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bbce8-36ac-4e75-b93a-19a139c6945a None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:53:16.982496 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bbce8-36ac-4e75-b93a-19a139c6945a None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:53:16.982608 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bbce8-36ac-4e75-b93a-19a139c6945a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:53:17.001054 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-733bbce8-36ac-4e75-b93a-19a139c6945a None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:53:17.002259 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-733bbce8-36ac-4e75-b93a-19a139c6945a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:53:17.062294 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 763/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:53:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:53:17.234376 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f1d4c-46a5-48a1-b8c9-520044fb6a2d None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:53:17.236129 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-385f1d4c-46a5-48a1-b8c9-520044fb6a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:53:17.311424 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f1d4c-46a5-48a1-b8c9-520044fb6a2d None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:53:17.316735 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2cdb6-4e9b-4fa3-a362-3147cb73f222 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:53:17.317383 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2cdb6-4e9b-4fa3-a362-3147cb73f222 service nova] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:53:17.317666 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2cdb6-4e9b-4fa3-a362-3147cb73f222 service nova] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:53:17.317938 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2cdb6-4e9b-4fa3-a362-3147cb73f222 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:53:17.327468 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2cdb6-4e9b-4fa3-a362-3147cb73f222 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:53:17.329121 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2cdb6-4e9b-4fa3-a362-3147cb73f222 service nova] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:53:17.339297 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 750/1513] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:53:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:53:17.812715 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b2ffb-9fad-4b1d-bd20-51f1a64ac8e2 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:53:17.813105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b2ffb-9fad-4b1d-bd20-51f1a64ac8e2 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:53:17.813455 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b2ffb-9fad-4b1d-bd20-51f1a64ac8e2 None None] PATH_INFO: `/v3` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:53:17.814861 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 764/1514] 10.222.0.15 () {54 vars in 925 bytes} [Mon May 23 15:53:17 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:53:17.822037 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541aa3c-19c9-4852-97e2-edfa8da34901 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:53:17.822332 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541aa3c-19c9-4852-97e2-edfa8da34901 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:53:17.822621 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541aa3c-19c9-4852-97e2-edfa8da34901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:53:17.842294 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-d541aa3c-19c9-4852-97e2-edfa8da34901 None None] MFA Rules not processed for user `84f06d35d7cc48658262bf79d9c72280`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:53:17.843504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-d541aa3c-19c9-4852-97e2-edfa8da34901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:53:17.909459 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 751/1515] 10.222.0.15 () {58 vars in 1015 bytes} [Mon May 23 15:53:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:53:18.229360 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4107b-057e-40fe-b9b1-8924541119ae None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:53:18.229897 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4107b-057e-40fe-b9b1-8924541119ae None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:53:18.229997 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4107b-057e-40fe-b9b1-8924541119ae None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:53:18.231304 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 765/1516] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:53:18.236349 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369e885-214c-4587-81e4-6e29d14d4728 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:53:18.236792 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369e885-214c-4587-81e4-6e29d14d4728 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:53:18.236927 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369e885-214c-4587-81e4-6e29d14d4728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:53:18.255915 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-2369e885-214c-4587-81e4-6e29d14d4728 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:53:18.257117 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-2369e885-214c-4587-81e4-6e29d14d4728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:53:18.265568 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 752/1517] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:53:18.416753 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4107b-057e-40fe-b9b1-8924541119ae None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:53:18.431614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4107b-057e-40fe-b9b1-8924541119ae None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:53:18.437005 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e10aa-770f-4747-8ffc-3b2e4bb7ba38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:53:18.437638 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e10aa-770f-4747-8ffc-3b2e4bb7ba38 service nova] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:53:18.437923 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e10aa-770f-4747-8ffc-3b2e4bb7ba38 service nova] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:53:18.438201 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e10aa-770f-4747-8ffc-3b2e4bb7ba38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:53:18.447221 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e10aa-770f-4747-8ffc-3b2e4bb7ba38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:53:18.448864 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e10aa-770f-4747-8ffc-3b2e4bb7ba38 service nova] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:53:18.458142 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 766/1518] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:53:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:53:27.395382 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03ec81-2f29-4e8f-9b7d-4d6911dc2bc3 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:53:27.396063 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03ec81-2f29-4e8f-9b7d-4d6911dc2bc3 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:53:27.396063 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03ec81-2f29-4e8f-9b7d-4d6911dc2bc3 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:53:27.397328 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 753/1519] 10.222.0.39 () {54 vars in 960 bytes} [Mon May 23 15:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:53:27.403076 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb6051-853d-40c4-beda-b923b42f08f6 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:53:27.403548 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb6051-853d-40c4-beda-b923b42f08f6 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:53:27.403679 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb6051-853d-40c4-beda-b923b42f08f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:53:27.422335 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-59eb6051-853d-40c4-beda-b923b42f08f6 None None] MFA Rules not processed for user `84f06d35d7cc48658262bf79d9c72280`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:53:27.423555 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-59eb6051-853d-40c4-beda-b923b42f08f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:53:27.433115 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 767/1520] 10.222.0.39 () {58 vars in 1057 bytes} [Mon May 23 15:53:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:53:27.440626 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03ec81-2f29-4e8f-9b7d-4d6911dc2bc3 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:53:27.454826 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03ec81-2f29-4e8f-9b7d-4d6911dc2bc3 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:53:27.459744 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0193eb-ef1c-4caa-9c66-2a19b9aee1bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f06d35d7cc48658262bf79d9c72280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:53:27.460373 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0193eb-ef1c-4caa-9c66-2a19b9aee1bb service placement] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:53:27.460653 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0193eb-ef1c-4caa-9c66-2a19b9aee1bb service placement] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:53:27.460926 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0193eb-ef1c-4caa-9c66-2a19b9aee1bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:53:27.469208 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0193eb-ef1c-4caa-9c66-2a19b9aee1bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:53:27.470764 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0193eb-ef1c-4caa-9c66-2a19b9aee1bb service placement] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:53:27.480921 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 754/1521] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:53:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:53:29.737323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04732ea-0c99-40af-abe8-97740edb0cda None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:53:29.737942 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04732ea-0c99-40af-abe8-97740edb0cda None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:53:29.737942 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04732ea-0c99-40af-abe8-97740edb0cda None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:53:29.739255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 768/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:53:29.745298 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862971b3-af60-49f7-9494-07c9a19b8362 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:53:29.745828 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862971b3-af60-49f7-9494-07c9a19b8362 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:53:29.745968 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862971b3-af60-49f7-9494-07c9a19b8362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:53:29.765114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-862971b3-af60-49f7-9494-07c9a19b8362 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:53:29.766238 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-862971b3-af60-49f7-9494-07c9a19b8362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:53:29.779351 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 755/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:53:29.934012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04732ea-0c99-40af-abe8-97740edb0cda None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:53:29.949851 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04732ea-0c99-40af-abe8-97740edb0cda None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:53:29.961151 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21d221-0876-43d6-9ac1-bd47e28a7381 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:53:29.962452 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21d221-0876-43d6-9ac1-bd47e28a7381 service nova] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:53:29.962716 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21d221-0876-43d6-9ac1-bd47e28a7381 service nova] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:53:29.962986 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21d221-0876-43d6-9ac1-bd47e28a7381 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:53:29.971971 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b21d221-0876-43d6-9ac1-bd47e28a7381 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:53:29.973574 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b21d221-0876-43d6-9ac1-bd47e28a7381 service nova] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:53:29.983698 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 769/1524] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:53:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:53:30.892983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df73dbf-3277-49e1-a04a-a5dbf22dd30b None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:53:30.893569 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df73dbf-3277-49e1-a04a-a5dbf22dd30b None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:53:30.893569 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df73dbf-3277-49e1-a04a-a5dbf22dd30b None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:53:30.894901 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 756/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:53:30.900028 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733539a-d504-4f50-b9cb-d6accf650e7b None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:53:30.900493 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733539a-d504-4f50-b9cb-d6accf650e7b None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:53:30.900598 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733539a-d504-4f50-b9cb-d6accf650e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:53:30.920759 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-a733539a-d504-4f50-b9cb-d6accf650e7b None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:53:30.921955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-a733539a-d504-4f50-b9cb-d6accf650e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:53:30.929619 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 770/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:53:31.079664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df73dbf-3277-49e1-a04a-a5dbf22dd30b None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:53:31.094743 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df73dbf-3277-49e1-a04a-a5dbf22dd30b None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:53:31.099984 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfa135-141d-4192-819e-e2d0f99c286f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:53:31.100626 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfa135-141d-4192-819e-e2d0f99c286f service nova] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:53:31.100909 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfa135-141d-4192-819e-e2d0f99c286f service nova] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:53:31.101188 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfa135-141d-4192-819e-e2d0f99c286f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:53:31.110182 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bfa135-141d-4192-819e-e2d0f99c286f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:53:31.111800 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bfa135-141d-4192-819e-e2d0f99c286f service nova] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:53:31.121686 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 757/1527] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:53:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:53:35.329030 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36aa4e0-ce8f-4458-b008-188ef27a5365 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:53:35.329594 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36aa4e0-ce8f-4458-b008-188ef27a5365 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:53:35.329701 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36aa4e0-ce8f-4458-b008-188ef27a5365 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:53:35.331045 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 771/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:53:35.336357 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ef45d-a049-437d-ac19-625faa1be9a0 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:53:35.336977 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ef45d-a049-437d-ac19-625faa1be9a0 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:53:35.336977 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ef45d-a049-437d-ac19-625faa1be9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:53:35.355125 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-cd6ef45d-a049-437d-ac19-625faa1be9a0 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:53:35.356347 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-cd6ef45d-a049-437d-ac19-625faa1be9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:53:35.364273 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 758/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:53:35.403141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36aa4e0-ce8f-4458-b008-188ef27a5365 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:53:35.404887 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-a36aa4e0-ce8f-4458-b008-188ef27a5365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:53:35.601045 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36aa4e0-ce8f-4458-b008-188ef27a5365 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:53:35.605232 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc895a-9923-4f9d-a4b3-46705dc35ae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:53:35.605879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc895a-9923-4f9d-a4b3-46705dc35ae1 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:53:35.606162 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc895a-9923-4f9d-a4b3-46705dc35ae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:53:35.606440 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc895a-9923-4f9d-a4b3-46705dc35ae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:53:35.615741 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc895a-9923-4f9d-a4b3-46705dc35ae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:53:35.617184 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc895a-9923-4f9d-a4b3-46705dc35ae1 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:53:35.627212 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 772/1530] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:53:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:53:37.862165 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa91f7-268e-4b83-9587-728f2df91f38 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:53:37.862701 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa91f7-268e-4b83-9587-728f2df91f38 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:53:37.862701 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa91f7-268e-4b83-9587-728f2df91f38 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:53:37.864164 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 759/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:53:37.870255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36eefa3-3a40-4501-8e38-7729c56489c8 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:53:37.870716 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36eefa3-3a40-4501-8e38-7729c56489c8 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:53:37.870835 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36eefa3-3a40-4501-8e38-7729c56489c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:53:37.889311 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-a36eefa3-3a40-4501-8e38-7729c56489c8 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:53:37.890499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-a36eefa3-3a40-4501-8e38-7729c56489c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:53:37.898180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 773/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:53:37.934407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa91f7-268e-4b83-9587-728f2df91f38 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:53:37.946153 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa91f7-268e-4b83-9587-728f2df91f38 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:53:37.949698 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5238c9-5fa7-4a4f-a5dc-0c3796a67042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:53:37.950334 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5238c9-5fa7-4a4f-a5dc-0c3796a67042 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:53:37.950617 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5238c9-5fa7-4a4f-a5dc-0c3796a67042 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:53:37.950892 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5238c9-5fa7-4a4f-a5dc-0c3796a67042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:53:37.959832 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5238c9-5fa7-4a4f-a5dc-0c3796a67042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:53:37.961262 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5238c9-5fa7-4a4f-a5dc-0c3796a67042 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:53:37.970679 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 760/1533] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:53:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:53:41.971566 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b80cf6-29eb-4276-9723-391b3fd3689f None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:53:41.972144 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b80cf6-29eb-4276-9723-391b3fd3689f None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:53:41.972144 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b80cf6-29eb-4276-9723-391b3fd3689f None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:53:41.973510 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 774/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:53:41.978786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffbac9-84f9-45c6-a7a4-ea1c6d1cfdea None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:53:41.979257 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffbac9-84f9-45c6-a7a4-ea1c6d1cfdea None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:53:41.979364 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffbac9-84f9-45c6-a7a4-ea1c6d1cfdea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:53:41.997729 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-a0ffbac9-84f9-45c6-a7a4-ea1c6d1cfdea None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:53:41.998930 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-a0ffbac9-84f9-45c6-a7a4-ea1c6d1cfdea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:53:42.006760 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 761/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:53:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:53:42.291833 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b80cf6-29eb-4276-9723-391b3fd3689f None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:53:42.293539 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-77b80cf6-29eb-4276-9723-391b3fd3689f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:53:42.357439 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b80cf6-29eb-4276-9723-391b3fd3689f None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:53:42.361037 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adef3c-3cc8-4e3e-92da-f9bd96850f4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:53:42.361686 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adef3c-3cc8-4e3e-92da-f9bd96850f4a service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:53:42.361970 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adef3c-3cc8-4e3e-92da-f9bd96850f4a service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:53:42.362249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adef3c-3cc8-4e3e-92da-f9bd96850f4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:53:42.371884 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adef3c-3cc8-4e3e-92da-f9bd96850f4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:53:42.373322 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adef3c-3cc8-4e3e-92da-f9bd96850f4a service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:53:42.378278 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:53:42.383807 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 775/1536] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:53:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:53:44.628057 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3ebad-dfbe-4770-95ef-3f2da75fddd1 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:53:44.628696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3ebad-dfbe-4770-95ef-3f2da75fddd1 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:53:44.628696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3ebad-dfbe-4770-95ef-3f2da75fddd1 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:53:44.630057 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 762/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:53:44.635384 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba1e80-cba3-4860-85d9-6182898adebe None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:53:44.635924 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba1e80-cba3-4860-85d9-6182898adebe None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:53:44.636035 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba1e80-cba3-4860-85d9-6182898adebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:53:44.654346 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-b9ba1e80-cba3-4860-85d9-6182898adebe None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:53:44.655543 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-b9ba1e80-cba3-4860-85d9-6182898adebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:53:44.663260 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 776/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:53:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:53:44.937030 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3ebad-dfbe-4770-95ef-3f2da75fddd1 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:53:44.938694 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-fbb3ebad-dfbe-4770-95ef-3f2da75fddd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:53:44.947115 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=94 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:53:44.952974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3ebad-dfbe-4770-95ef-3f2da75fddd1 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:53:44.956492 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9e712-0c05-4719-957e-d1ceadca4970 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:53:44.961580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9e712-0c05-4719-957e-d1ceadca4970 service cinder] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:53:44.961580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9e712-0c05-4719-957e-d1ceadca4970 service cinder] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:53:44.961580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9e712-0c05-4719-957e-d1ceadca4970 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:53:44.967267 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb9e712-0c05-4719-957e-d1ceadca4970 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:53:44.968752 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb9e712-0c05-4719-957e-d1ceadca4970 service cinder] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:53:44.978777 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 763/1539] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:53:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:53:54.649722 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:53:54.980005 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=5 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:29.161567 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf023d-3d6f-49d9-85c4-9df9802e180e None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:29.163655 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf023d-3d6f-49d9-85c4-9df9802e180e None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:29.163655 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf023d-3d6f-49d9-85c4-9df9802e180e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:29.189899 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-efaf023d-3d6f-49d9-85c4-9df9802e180e None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:29.191517 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-efaf023d-3d6f-49d9-85c4-9df9802e180e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:29.204468 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 777/1540] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:29.234586 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba2f7e-d258-4d47-b032-e19b10976929 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:29.235768 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba2f7e-d258-4d47-b032-e19b10976929 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:29.236293 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba2f7e-d258-4d47-b032-e19b10976929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:29.242279 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7856ce-4356-4dce-b46c-ccf50cac32b9 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:29.249546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7856ce-4356-4dce-b46c-ccf50cac32b9 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:29.252496 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7856ce-4356-4dce-b46c-ccf50cac32b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:29.281391 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-0fba2f7e-d258-4d47-b032-e19b10976929 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:29.283436 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-0fba2f7e-d258-4d47-b032-e19b10976929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:29.293307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-0b7856ce-4356-4dce-b46c-ccf50cac32b9 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:29.294545 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-0b7856ce-4356-4dce-b46c-ccf50cac32b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:29.301412 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 764/1541] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:29.313051 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c99a41-c0eb-4a56-9525-ef90c6ed1b06 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:29.313701 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c99a41-c0eb-4a56-9525-ef90c6ed1b06 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:29.314208 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c99a41-c0eb-4a56-9525-ef90c6ed1b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:29.319631 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 778/1542] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:29.321608 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7856ce-4356-4dce-b46c-ccf50cac32b9 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:29.342834 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7856ce-4356-4dce-b46c-ccf50cac32b9 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:29.348106 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-f2c99a41-c0eb-4a56-9525-ef90c6ed1b06 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:29.349722 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-f2c99a41-c0eb-4a56-9525-ef90c6ed1b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:29.356599 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f5aa7-b04c-44e9-9013-c0a27ac9f608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:29.357290 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f5aa7-b04c-44e9-9013-c0a27ac9f608 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:29.357575 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f5aa7-b04c-44e9-9013-c0a27ac9f608 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:29.357852 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f5aa7-b04c-44e9-9013-c0a27ac9f608 admin admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:29.358712 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f5aa7-b04c-44e9-9013-c0a27ac9f608 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:55:29.359030 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f5aa7-b04c-44e9-9013-c0a27ac9f608 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:29.360714 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f5aa7-b04c-44e9-9013-c0a27ac9f608 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:29.369027 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 765/1543] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:55:29.375990 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c99a41-c0eb-4a56-9525-ef90c6ed1b06 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:29.386184 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 779/1544] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 15:55:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:55:29.395427 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c99a41-c0eb-4a56-9525-ef90c6ed1b06 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:29.395723 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f5aa7-b04c-44e9-9013-c0a27ac9f608 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:29.410641 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091656a-4fd6-4d9d-b180-d2906606846e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:29.412056 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091656a-4fd6-4d9d-b180-d2906606846e admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:29.412580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091656a-4fd6-4d9d-b180-d2906606846e admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:29.413078 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091656a-4fd6-4d9d-b180-d2906606846e admin admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:29.414076 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091656a-4fd6-4d9d-b180-d2906606846e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:55:29.414617 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091656a-4fd6-4d9d-b180-d2906606846e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:29.416390 dv-cinder-842119-2-smb devstack@keystone.service[87192]: WARNING py.warnings [None req-6091656a-4fd6-4d9d-b180-d2906606846e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 15:55:29.416390 dv-cinder-842119-2-smb devstack@keystone.service[87192]: warnings.warn(msg) May 23 15:55:29.416390 dv-cinder-842119-2-smb devstack@keystone.service[87192]: May 23 15:55:29.419625 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f5aa7-b04c-44e9-9013-c0a27ac9f608 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:29.420715 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091656a-4fd6-4d9d-b180-d2906606846e admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:29.428071 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a15976-ab91-4b1f-a032-b98b1fb22ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:29.428761 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a15976-ab91-4b1f-a032-b98b1fb22ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:29.429048 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a15976-ab91-4b1f-a032-b98b1fb22ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:29.429329 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a15976-ab91-4b1f-a032-b98b1fb22ec2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:29.430051 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a15976-ab91-4b1f-a032-b98b1fb22ec2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:29.431287 dv-cinder-842119-2-smb devstack@keystone.service[87191]: WARNING py.warnings [None req-59a15976-ab91-4b1f-a032-b98b1fb22ec2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 15:55:29.431287 dv-cinder-842119-2-smb devstack@keystone.service[87191]: warnings.warn(msg) May 23 15:55:29.431287 dv-cinder-842119-2-smb devstack@keystone.service[87191]: May 23 15:55:29.432583 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a15976-ab91-4b1f-a032-b98b1fb22ec2 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:29.444326 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 766/1545] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 15:55:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:55:29.446869 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88369e7a-a0cb-44e2-85ac-1d620babf009 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:29.447517 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88369e7a-a0cb-44e2-85ac-1d620babf009 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:29.448055 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88369e7a-a0cb-44e2-85ac-1d620babf009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:29.481841 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-88369e7a-a0cb-44e2-85ac-1d620babf009 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:29.483501 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-88369e7a-a0cb-44e2-85ac-1d620babf009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:29.498995 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 767/1546] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:29.513694 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88369e7a-a0cb-44e2-85ac-1d620babf009 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:29.514167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88369e7a-a0cb-44e2-85ac-1d620babf009 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:29.522444 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9987111-7c9b-48f4-8eb9-5e54756ca9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:29.523504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9987111-7c9b-48f4-8eb9-5e54756ca9f3 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:29.524024 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9987111-7c9b-48f4-8eb9-5e54756ca9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:29.524511 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9987111-7c9b-48f4-8eb9-5e54756ca9f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:29.525434 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9987111-7c9b-48f4-8eb9-5e54756ca9f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:29.527957 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9987111-7c9b-48f4-8eb9-5e54756ca9f3 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:29.574827 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 780/1547] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:55:29 2022] POST /identity/v3/projects => generated 391 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:55:29.576257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750620d1-e09f-4d13-a57c-0b503abdab43 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:29.576683 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750620d1-e09f-4d13-a57c-0b503abdab43 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:29.577038 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750620d1-e09f-4d13-a57c-0b503abdab43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:29.606282 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-750620d1-e09f-4d13-a57c-0b503abdab43 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:29.607530 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-750620d1-e09f-4d13-a57c-0b503abdab43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:29.651493 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 768/1548] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:55:29 2022] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:55:29.652745 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9987111-7c9b-48f4-8eb9-5e54756ca9f3 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:29.676689 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 781/1549] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:29.677993 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9819bc-bd34-4bfb-bdfd-6c059211c042 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:29.678290 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9819bc-bd34-4bfb-bdfd-6c059211c042 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:29.678577 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9819bc-bd34-4bfb-bdfd-6c059211c042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:29.704595 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-da9819bc-bd34-4bfb-bdfd-6c059211c042 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:29.706985 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-da9819bc-bd34-4bfb-bdfd-6c059211c042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:29.736116 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9987111-7c9b-48f4-8eb9-5e54756ca9f3 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:29.741287 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d328e34f-5e38-4dff-9a49-cbf61b5d269a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:29.742006 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328e34f-5e38-4dff-9a49-cbf61b5d269a admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:29.742313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328e34f-5e38-4dff-9a49-cbf61b5d269a admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:29.742586 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328e34f-5e38-4dff-9a49-cbf61b5d269a admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:29.743269 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d328e34f-5e38-4dff-9a49-cbf61b5d269a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:29.744337 dv-cinder-842119-2-smb devstack@keystone.service[87192]: WARNING py.warnings [None req-d328e34f-5e38-4dff-9a49-cbf61b5d269a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 15:55:29.744337 dv-cinder-842119-2-smb devstack@keystone.service[87192]: warnings.warn(msg) May 23 15:55:29.744337 dv-cinder-842119-2-smb devstack@keystone.service[87192]: May 23 15:55:29.745578 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d328e34f-5e38-4dff-9a49-cbf61b5d269a admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:29.773624 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 782/1550] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:29.775068 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1fea0-b550-421c-870e-9eb67415c29f None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:29.775364 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1fea0-b550-421c-870e-9eb67415c29f None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:29.775678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1fea0-b550-421c-870e-9eb67415c29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:29.794066 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-ddf1fea0-b550-421c-870e-9eb67415c29f None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:29.795257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-ddf1fea0-b550-421c-870e-9eb67415c29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:29.804155 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 783/1551] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:29.805390 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65590469-85a3-4bd1-af40-38efdf783dab None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:29.805677 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65590469-85a3-4bd1-af40-38efdf783dab None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:29.805993 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65590469-85a3-4bd1-af40-38efdf783dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:29.810378 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 769/1552] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:55:29 2022] POST /identity/v3/users => generated 296 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:55:29.810378 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d328e34f-5e38-4dff-9a49-cbf61b5d269a admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:29.822618 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d328e34f-5e38-4dff-9a49-cbf61b5d269a admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:29.828016 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757221e5-3dcf-48f9-99ca-74a83008e232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:29.829370 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757221e5-3dcf-48f9-99ca-74a83008e232 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:29.829370 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757221e5-3dcf-48f9-99ca-74a83008e232 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:29.829370 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757221e5-3dcf-48f9-99ca-74a83008e232 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:29.830093 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757221e5-3dcf-48f9-99ca-74a83008e232 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:29.831139 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-65590469-85a3-4bd1-af40-38efdf783dab None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:29.832363 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-65590469-85a3-4bd1-af40-38efdf783dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:29.832736 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757221e5-3dcf-48f9-99ca-74a83008e232 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:29.840311 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 784/1553] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:29.841112 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65590469-85a3-4bd1-af40-38efdf783dab None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:29.850519 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65590469-85a3-4bd1-af40-38efdf783dab None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:29.855101 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb662e3-ce02-41f8-a6e5-a557f5ef1707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:29.855785 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb662e3-ce02-41f8-a6e5-a557f5ef1707 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:29.856071 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb662e3-ce02-41f8-a6e5-a557f5ef1707 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:29.856348 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb662e3-ce02-41f8-a6e5-a557f5ef1707 admin admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:29.857082 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb662e3-ce02-41f8-a6e5-a557f5ef1707 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:55:29.857386 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb662e3-ce02-41f8-a6e5-a557f5ef1707 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:29.858968 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb662e3-ce02-41f8-a6e5-a557f5ef1707 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:29.870909 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 785/1554] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 15:55:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:55:29.872137 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08bf513-100b-44a5-8eac-aeca2c013dab None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:29.872423 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08bf513-100b-44a5-8eac-aeca2c013dab None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:29.872699 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08bf513-100b-44a5-8eac-aeca2c013dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:29.890532 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-f08bf513-100b-44a5-8eac-aeca2c013dab None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:29.893494 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-f08bf513-100b-44a5-8eac-aeca2c013dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:29.900081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 786/1555] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:29.902178 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b2d24-f53f-4f9b-a13c-917147f33891 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:29.902467 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b2d24-f53f-4f9b-a13c-917147f33891 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:29.902751 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b2d24-f53f-4f9b-a13c-917147f33891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:29.922183 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-7b4b2d24-f53f-4f9b-a13c-917147f33891 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:29.923355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-7b4b2d24-f53f-4f9b-a13c-917147f33891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:29.931561 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 787/1556] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:29.932582 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d05b3b-cb71-44c3-94fd-b9f9cfdcde7d None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:29.932863 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d05b3b-cb71-44c3-94fd-b9f9cfdcde7d None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:29.933150 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d05b3b-cb71-44c3-94fd-b9f9cfdcde7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:29.941940 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 770/1557] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:55:29 2022] POST /identity/v3/users => generated 286 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:55:29.942608 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757221e5-3dcf-48f9-99ca-74a83008e232 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:29.952378 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757221e5-3dcf-48f9-99ca-74a83008e232 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:29.954041 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-62d05b3b-cb71-44c3-94fd-b9f9cfdcde7d None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:29.955393 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-62d05b3b-cb71-44c3-94fd-b9f9cfdcde7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:29.957891 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3827988-4aff-40d3-a82c-0f4bdea5c539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:29.958600 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3827988-4aff-40d3-a82c-0f4bdea5c539 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:29.958881 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3827988-4aff-40d3-a82c-0f4bdea5c539 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:29.959155 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3827988-4aff-40d3-a82c-0f4bdea5c539 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:29.959908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3827988-4aff-40d3-a82c-0f4bdea5c539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:29.961512 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3827988-4aff-40d3-a82c-0f4bdea5c539 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:29.964126 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 788/1558] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:29.965666 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5f057-9444-4fe4-977c-e28a6e24e5d3 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:29.965823 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5f057-9444-4fe4-977c-e28a6e24e5d3 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:29.966094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5f057-9444-4fe4-977c-e28a6e24e5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:29.977747 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 771/1559] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:55:29.977747 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1e569-714d-422c-803d-4a7fda48cbb8 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:29.977747 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1e569-714d-422c-803d-4a7fda48cbb8 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:29.977747 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1e569-714d-422c-803d-4a7fda48cbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:29.979407 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:29.985252 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-5fa5f057-9444-4fe4-977c-e28a6e24e5d3 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:29.987103 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-5fa5f057-9444-4fe4-977c-e28a6e24e5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:29.995588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 789/1560] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:30.001169 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-c7f1e569-714d-422c-803d-4a7fda48cbb8 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:30.001305 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5f057-9444-4fe4-977c-e28a6e24e5d3 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:30.001426 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-c7f1e569-714d-422c-803d-4a7fda48cbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:30.007154 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 772/1561] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:30.007678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5f057-9444-4fe4-977c-e28a6e24e5d3 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:30.008726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1003fd6-f453-4e6b-b40b-937a12c63e34 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:30.009068 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1003fd6-f453-4e6b-b40b-937a12c63e34 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:30.009494 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1003fd6-f453-4e6b-b40b-937a12c63e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:30.012669 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4239b01-ea1b-4116-a856-752e4e32fe44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:30.013340 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4239b01-ea1b-4116-a856-752e4e32fe44 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:30.013629 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4239b01-ea1b-4116-a856-752e4e32fe44 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:30.013900 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4239b01-ea1b-4116-a856-752e4e32fe44 admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:30.014582 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4239b01-ea1b-4116-a856-752e4e32fe44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:30.017318 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4239b01-ea1b-4116-a856-752e4e32fe44 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:30.028192 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-d1003fd6-f453-4e6b-b40b-937a12c63e34 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:30.029370 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-d1003fd6-f453-4e6b-b40b-937a12c63e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:30.037359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 773/1562] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:30.038561 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc736f-a0b6-421f-98ac-ad8b99d99678 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:30.038841 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc736f-a0b6-421f-98ac-ad8b99d99678 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:30.039115 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc736f-a0b6-421f-98ac-ad8b99d99678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:30.057177 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-5afc736f-a0b6-421f-98ac-ad8b99d99678 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:30.058336 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-5afc736f-a0b6-421f-98ac-ad8b99d99678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:30.067446 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 774/1563] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:30.068542 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc736f-a0b6-421f-98ac-ad8b99d99678 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:30.077462 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc736f-a0b6-421f-98ac-ad8b99d99678 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:30.082183 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99b2ee-68bf-4418-9f31-f74851b29830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:30.082819 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99b2ee-68bf-4418-9f31-f74851b29830 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:30.083104 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99b2ee-68bf-4418-9f31-f74851b29830 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:30.083383 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99b2ee-68bf-4418-9f31-f74851b29830 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:30.084180 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99b2ee-68bf-4418-9f31-f74851b29830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:30.085833 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99b2ee-68bf-4418-9f31-f74851b29830 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:30.095681 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 775/1564] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:55:30.097318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99b2ee-68bf-4418-9f31-f74851b29830 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:30.106300 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99b2ee-68bf-4418-9f31-f74851b29830 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:30.110782 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cecd9-d489-4197-83ab-b3fa74bafecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:30.111404 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cecd9-d489-4197-83ab-b3fa74bafecb admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:30.112239 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cecd9-d489-4197-83ab-b3fa74bafecb admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:30.112511 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cecd9-d489-4197-83ab-b3fa74bafecb admin admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:30.113228 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cecd9-d489-4197-83ab-b3fa74bafecb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:55:30.113527 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cecd9-d489-4197-83ab-b3fa74bafecb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:30.115097 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cecd9-d489-4197-83ab-b3fa74bafecb admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:30.124647 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 790/1565] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:55:29 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:55:30.124647 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4239b01-ea1b-4116-a856-752e4e32fe44 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:30.138662 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 776/1566] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 15:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:55:30.138662 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cecd9-d489-4197-83ab-b3fa74bafecb admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:30.142179 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cecd9-d489-4197-83ab-b3fa74bafecb admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:30.160298 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:30.200209 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1a976-340e-4e60-b5ad-64f70c037bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:30.200794 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1a976-340e-4e60-b5ad-64f70c037bbf admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:30.200925 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4239b01-ea1b-4116-a856-752e4e32fe44 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:30.201390 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1a976-340e-4e60-b5ad-64f70c037bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:30.201390 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1a976-340e-4e60-b5ad-64f70c037bbf admin admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:30.202105 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a1a976-340e-4e60-b5ad-64f70c037bbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:55:30.202376 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a1a976-340e-4e60-b5ad-64f70c037bbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:30.204005 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a1a976-340e-4e60-b5ad-64f70c037bbf admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:30.205756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a6a20-49a7-4644-97e2-584f31974c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:30.206422 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a6a20-49a7-4644-97e2-584f31974c3a admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:30.206700 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a6a20-49a7-4644-97e2-584f31974c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:30.206972 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a6a20-49a7-4644-97e2-584f31974c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:30.207734 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a6a20-49a7-4644-97e2-584f31974c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:30.211248 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a6a20-49a7-4644-97e2-584f31974c3a admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:30.222683 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 777/1567] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 15:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:55:30.222683 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1a976-340e-4e60-b5ad-64f70c037bbf admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:30.227203 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 791/1568] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:55:30.227203 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a6a20-49a7-4644-97e2-584f31974c3a admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:30.227816 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1a976-340e-4e60-b5ad-64f70c037bbf admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:30.230588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a6a20-49a7-4644-97e2-584f31974c3a admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:30.232381 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2a022-6180-4eb6-ab8f-b25215aed97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:30.233024 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2a022-6180-4eb6-ab8f-b25215aed97c admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:30.233306 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2a022-6180-4eb6-ab8f-b25215aed97c admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:30.233624 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2a022-6180-4eb6-ab8f-b25215aed97c admin admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:30.234335 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2a022-6180-4eb6-ab8f-b25215aed97c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:55:30.234637 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2a022-6180-4eb6-ab8f-b25215aed97c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:30.235244 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e56ab-bb6d-48ed-ad3f-96ee5dfc27d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:30.235912 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e56ab-bb6d-48ed-ad3f-96ee5dfc27d4 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:30.236195 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e56ab-bb6d-48ed-ad3f-96ee5dfc27d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:30.236319 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2a022-6180-4eb6-ab8f-b25215aed97c admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:30.237065 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e56ab-bb6d-48ed-ad3f-96ee5dfc27d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:30.237904 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e56ab-bb6d-48ed-ad3f-96ee5dfc27d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:55:30.238211 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e56ab-bb6d-48ed-ad3f-96ee5dfc27d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:30.239924 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e56ab-bb6d-48ed-ad3f-96ee5dfc27d4 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:30.249418 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 778/1569] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 15:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:55:30.250320 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2a022-6180-4eb6-ab8f-b25215aed97c admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:30.253349 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 792/1570] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 15:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:55:30.254103 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e56ab-bb6d-48ed-ad3f-96ee5dfc27d4 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:30.264110 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e56ab-bb6d-48ed-ad3f-96ee5dfc27d4 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:30.268980 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d875f-2e97-4d89-b7fc-2aa1f7f30918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:30.273287 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d875f-2e97-4d89-b7fc-2aa1f7f30918 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:30.273287 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d875f-2e97-4d89-b7fc-2aa1f7f30918 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:30.273486 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2a022-6180-4eb6-ab8f-b25215aed97c admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:30.273601 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d875f-2e97-4d89-b7fc-2aa1f7f30918 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:30.273601 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d875f-2e97-4d89-b7fc-2aa1f7f30918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:30.273601 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d875f-2e97-4d89-b7fc-2aa1f7f30918 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:30.275586 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4d520-956f-4203-a119-d03ae977cffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:30.276311 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4d520-956f-4203-a119-d03ae977cffd admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:30.276599 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4d520-956f-4203-a119-d03ae977cffd admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:30.276872 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4d520-956f-4203-a119-d03ae977cffd admin admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:30.277975 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4d520-956f-4203-a119-d03ae977cffd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:55:30.277975 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4d520-956f-4203-a119-d03ae977cffd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:30.279616 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4d520-956f-4203-a119-d03ae977cffd admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:30.282711 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 793/1571] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:55:30.283548 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d875f-2e97-4d89-b7fc-2aa1f7f30918 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:30.292326 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 779/1572] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 15:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:55:30.293006 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4d520-956f-4203-a119-d03ae977cffd admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:30.293943 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d875f-2e97-4d89-b7fc-2aa1f7f30918 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:30.298574 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b252361-ba0b-4945-8f00-22e9f7d43caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:30.305796 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b252361-ba0b-4945-8f00-22e9f7d43caf admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:30.305796 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b252361-ba0b-4945-8f00-22e9f7d43caf admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:30.305796 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b252361-ba0b-4945-8f00-22e9f7d43caf admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:30.305796 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b252361-ba0b-4945-8f00-22e9f7d43caf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:30.305796 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b252361-ba0b-4945-8f00-22e9f7d43caf admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:30.306253 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4d520-956f-4203-a119-d03ae977cffd admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:30.309619 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89586c2c-6877-496e-85b7-5e90feb0e365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:30.310261 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89586c2c-6877-496e-85b7-5e90feb0e365 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:30.310550 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89586c2c-6877-496e-85b7-5e90feb0e365 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:30.310822 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89586c2c-6877-496e-85b7-5e90feb0e365 admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:30.311505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89586c2c-6877-496e-85b7-5e90feb0e365 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:30.313709 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89586c2c-6877-496e-85b7-5e90feb0e365 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:30.412203 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 794/1573] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:55:30 2022] POST /identity/v3/users => generated 287 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:55:30.413090 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b252361-ba0b-4945-8f00-22e9f7d43caf admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:30.422541 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b252361-ba0b-4945-8f00-22e9f7d43caf admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:30.428760 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63f2c4-43c6-4e48-b600-8aa8bfcc16ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:30.429413 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63f2c4-43c6-4e48-b600-8aa8bfcc16ba admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:30.429696 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63f2c4-43c6-4e48-b600-8aa8bfcc16ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:30.429971 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63f2c4-43c6-4e48-b600-8aa8bfcc16ba admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:30.430656 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63f2c4-43c6-4e48-b600-8aa8bfcc16ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:30.432663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63f2c4-43c6-4e48-b600-8aa8bfcc16ba admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:30.441686 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 780/1574] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:55:30 2022] POST /identity/v3/projects => generated 367 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:55:30.442642 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89586c2c-6877-496e-85b7-5e90feb0e365 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:30.505699 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89586c2c-6877-496e-85b7-5e90feb0e365 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:30.510227 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8cdf21-6416-402a-9d8a-05b6bea6d24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:30.511100 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cdf21-6416-402a-9d8a-05b6bea6d24a admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:30.511389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cdf21-6416-402a-9d8a-05b6bea6d24a admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:30.511682 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cdf21-6416-402a-9d8a-05b6bea6d24a admin admin] PATH_INFO: `/v3/projects/dc8e8edebd8a4ad78ef3e03407758db1/users/5c6b6d56a8b94fcb9eecc4d3167cd8a1/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:30.521042 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 795/1575] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:55:30 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:55:30.521935 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63f2c4-43c6-4e48-b600-8aa8bfcc16ba admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:30.526482 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8cdf21-6416-402a-9d8a-05b6bea6d24a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc8e8edebd8a4ad78ef3e03407758db1, user_id=5c6b6d56a8b94fcb9eecc4d3167cd8a1, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:30.529369 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8cdf21-6416-402a-9d8a-05b6bea6d24a admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:30.584719 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63f2c4-43c6-4e48-b600-8aa8bfcc16ba admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:30.589843 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1bcd31-5154-4717-aedc-65554b247b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:30.590503 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1bcd31-5154-4717-aedc-65554b247b5c admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:30.590799 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1bcd31-5154-4717-aedc-65554b247b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:30.591067 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1bcd31-5154-4717-aedc-65554b247b5c admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:30.591791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1bcd31-5154-4717-aedc-65554b247b5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:30.593709 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1bcd31-5154-4717-aedc-65554b247b5c admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:30.608002 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:30.614075 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 781/1576] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:55:30 2022] PUT /identity/v3/projects/dc8e8edebd8a4ad78ef3e03407758db1/users/5c6b6d56a8b94fcb9eecc4d3167cd8a1/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:55:30.614891 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8cdf21-6416-402a-9d8a-05b6bea6d24a admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:30.668944 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:30.680516 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8cdf21-6416-402a-9d8a-05b6bea6d24a admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:30.685090 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08facd7-1076-47f5-ae70-d0a99cc3b876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:30.685729 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08facd7-1076-47f5-ae70-d0a99cc3b876 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:30.686014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08facd7-1076-47f5-ae70-d0a99cc3b876 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:30.686293 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08facd7-1076-47f5-ae70-d0a99cc3b876 admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:30.686912 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 796/1577] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:55:30 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:55:30.687044 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08facd7-1076-47f5-ae70-d0a99cc3b876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:30.688079 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1bcd31-5154-4717-aedc-65554b247b5c admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:30.694798 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08facd7-1076-47f5-ae70-d0a99cc3b876 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:30.752535 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1bcd31-5154-4717-aedc-65554b247b5c admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:30.757156 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e88e0-febf-4998-8668-87a6463147af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:30.758039 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e88e0-febf-4998-8668-87a6463147af admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:30.758321 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e88e0-febf-4998-8668-87a6463147af admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:30.758597 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e88e0-febf-4998-8668-87a6463147af admin admin] PATH_INFO: `/v3/projects/f1fee77be16e494eaabfd9be4cc4e01e/users/45265d0bece243f68205a341da4e8d93/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:30.776184 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 782/1578] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:55:30 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:55:30.776184 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08facd7-1076-47f5-ae70-d0a99cc3b876 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:30.778770 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e88e0-febf-4998-8668-87a6463147af admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1fee77be16e494eaabfd9be4cc4e01e, user_id=45265d0bece243f68205a341da4e8d93, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:30.779582 dv-cinder-842119-2-smb devstack@keystone.service[87191]: WARNING py.warnings [None req-832e88e0-febf-4998-8668-87a6463147af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 15:55:30.779582 dv-cinder-842119-2-smb devstack@keystone.service[87191]: warnings.warn(msg) May 23 15:55:30.779582 dv-cinder-842119-2-smb devstack@keystone.service[87191]: May 23 15:55:30.781524 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e88e0-febf-4998-8668-87a6463147af admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:30.835179 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08facd7-1076-47f5-ae70-d0a99cc3b876 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:30.839743 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c09f1-9471-4eda-a0de-d66592f4c4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:30.840395 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c09f1-9471-4eda-a0de-d66592f4c4a1 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:30.840677 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c09f1-9471-4eda-a0de-d66592f4c4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:30.840953 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c09f1-9471-4eda-a0de-d66592f4c4a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:30.841632 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c09f1-9471-4eda-a0de-d66592f4c4a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:30.843521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c09f1-9471-4eda-a0de-d66592f4c4a1 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:30.856971 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 797/1579] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:55:30 2022] PUT /identity/v3/projects/f1fee77be16e494eaabfd9be4cc4e01e/users/45265d0bece243f68205a341da4e8d93/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:55:30.858016 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e88e0-febf-4998-8668-87a6463147af admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:30.920650 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e88e0-febf-4998-8668-87a6463147af admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:30.925747 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73c222-133e-43d0-9a03-4bb7bb1a2bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:30.926399 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73c222-133e-43d0-9a03-4bb7bb1a2bfe admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:30.926680 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73c222-133e-43d0-9a03-4bb7bb1a2bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:30.926953 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73c222-133e-43d0-9a03-4bb7bb1a2bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:30.927700 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e73c222-133e-43d0-9a03-4bb7bb1a2bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:30.929287 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e73c222-133e-43d0-9a03-4bb7bb1a2bfe admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:30.939206 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 798/1580] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:55:30.942530 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73c222-133e-43d0-9a03-4bb7bb1a2bfe admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:30.942687 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 783/1581] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:55:30 2022] POST /identity/v3/projects => generated 387 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:55:30.942687 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c09f1-9471-4eda-a0de-d66592f4c4a1 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:30.952199 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73c222-133e-43d0-9a03-4bb7bb1a2bfe admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:31.005884 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c09f1-9471-4eda-a0de-d66592f4c4a1 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:31.010414 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660383f9-c21e-409c-a4c9-09bd23d13cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:31.011010 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660383f9-c21e-409c-a4c9-09bd23d13cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:31.011289 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660383f9-c21e-409c-a4c9-09bd23d13cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:31.011411 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbd639-b2d4-4ebc-90f4-da9f4bfc94ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:31.011545 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660383f9-c21e-409c-a4c9-09bd23d13cb7 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:31.011986 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbd639-b2d4-4ebc-90f4-da9f4bfc94ed admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:31.012246 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660383f9-c21e-409c-a4c9-09bd23d13cb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:31.012370 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbd639-b2d4-4ebc-90f4-da9f4bfc94ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:31.012529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbd639-b2d4-4ebc-90f4-da9f4bfc94ed admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:31.013218 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbd639-b2d4-4ebc-90f4-da9f4bfc94ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:31.014141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660383f9-c21e-409c-a4c9-09bd23d13cb7 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:31.015117 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbd639-b2d4-4ebc-90f4-da9f4bfc94ed admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:31.119796 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 784/1582] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:55:30 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:55:31.121063 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7783a-04df-40c1-a688-38e6798f3cab None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:31.121347 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7783a-04df-40c1-a688-38e6798f3cab None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:31.121623 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7783a-04df-40c1-a688-38e6798f3cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:31.138901 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-fdf7783a-04df-40c1-a688-38e6798f3cab None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:31.140113 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-fdf7783a-04df-40c1-a688-38e6798f3cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:31.148426 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 785/1583] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:31.149157 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7783a-04df-40c1-a688-38e6798f3cab None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:31.159951 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 799/1584] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:55:30 2022] POST /identity/v3/users => generated 284 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:55:31.159951 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbd639-b2d4-4ebc-90f4-da9f4bfc94ed admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:31.161744 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7783a-04df-40c1-a688-38e6798f3cab None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:31.162707 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:31.166464 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbd639-b2d4-4ebc-90f4-da9f4bfc94ed admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:31.167063 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed3488-0b46-4735-8758-09e14979258d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:31.167761 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed3488-0b46-4735-8758-09e14979258d admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:31.168045 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed3488-0b46-4735-8758-09e14979258d admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:31.168324 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed3488-0b46-4735-8758-09e14979258d admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:31.169196 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed3488-0b46-4735-8758-09e14979258d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:31.171095 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed3488-0b46-4735-8758-09e14979258d admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:31.171201 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c767d-fbcf-4ecb-8346-2623ce970d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:31.171909 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c767d-fbcf-4ecb-8346-2623ce970d49 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:31.172193 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c767d-fbcf-4ecb-8346-2623ce970d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:31.172463 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c767d-fbcf-4ecb-8346-2623ce970d49 admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:31.173139 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c767d-fbcf-4ecb-8346-2623ce970d49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:31.175321 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c767d-fbcf-4ecb-8346-2623ce970d49 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:31.251103 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 786/1585] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:55:31 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:55:31.252977 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35645f00-df94-4802-9daf-81e437bf76a0 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:31.253263 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35645f00-df94-4802-9daf-81e437bf76a0 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:31.253537 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35645f00-df94-4802-9daf-81e437bf76a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:31.267796 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 800/1586] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:55:31 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:55:31.267796 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c767d-fbcf-4ecb-8346-2623ce970d49 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:31.279134 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c767d-fbcf-4ecb-8346-2623ce970d49 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:31.284320 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba4842-e4b6-4f35-ad9a-db55e5cd79b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:31.286180 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-35645f00-df94-4802-9daf-81e437bf76a0 None None] MFA Rules not processed for user `45265d0bece243f68205a341da4e8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:31.286303 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba4842-e4b6-4f35-ad9a-db55e5cd79b5 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:31.286303 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba4842-e4b6-4f35-ad9a-db55e5cd79b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:31.286303 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba4842-e4b6-4f35-ad9a-db55e5cd79b5 admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:31.286578 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-35645f00-df94-4802-9daf-81e437bf76a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:31.286689 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba4842-e4b6-4f35-ad9a-db55e5cd79b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:31.288319 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba4842-e4b6-4f35-ad9a-db55e5cd79b5 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:31.298343 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:31.350183 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 787/1587] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:31.351009 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35645f00-df94-4802-9daf-81e437bf76a0 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:31.360364 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 801/1588] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:55:31 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:55:31.361387 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba4842-e4b6-4f35-ad9a-db55e5cd79b5 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:31.370986 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35645f00-df94-4802-9daf-81e437bf76a0 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:31.376249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba4842-e4b6-4f35-ad9a-db55e5cd79b5 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:31.376578 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b765bd-070f-4b05-b5ba-b0dff14b1a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:31.377893 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b765bd-070f-4b05-b5ba-b0dff14b1a56 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:31.378381 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b765bd-070f-4b05-b5ba-b0dff14b1a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:31.378724 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b765bd-070f-4b05-b5ba-b0dff14b1a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:31.379408 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b765bd-070f-4b05-b5ba-b0dff14b1a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:31.381043 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b765bd-070f-4b05-b5ba-b0dff14b1a56 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:31.382025 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b092227-2da5-4062-99b0-3cb3e514e6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:31.382809 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b092227-2da5-4062-99b0-3cb3e514e6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:31.383124 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b092227-2da5-4062-99b0-3cb3e514e6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:31.383380 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b092227-2da5-4062-99b0-3cb3e514e6f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:31.384137 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b092227-2da5-4062-99b0-3cb3e514e6f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:31.385722 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b092227-2da5-4062-99b0-3cb3e514e6f5 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:31.392558 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 788/1589] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:55:31.394489 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b765bd-070f-4b05-b5ba-b0dff14b1a56 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:31.397318 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 802/1590] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:55:31.398079 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b092227-2da5-4062-99b0-3cb3e514e6f5 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:31.408763 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b092227-2da5-4062-99b0-3cb3e514e6f5 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:31.413026 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cf0d8-be81-4bd4-9a0f-a304d25b2691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:31.413664 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cf0d8-be81-4bd4-9a0f-a304d25b2691 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:31.413944 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cf0d8-be81-4bd4-9a0f-a304d25b2691 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:31.414213 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cf0d8-be81-4bd4-9a0f-a304d25b2691 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:31.414949 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2cf0d8-be81-4bd4-9a0f-a304d25b2691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:31.416629 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2cf0d8-be81-4bd4-9a0f-a304d25b2691 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:31.428330 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 803/1591] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:55:31.429430 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cf0d8-be81-4bd4-9a0f-a304d25b2691 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:31.439302 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cf0d8-be81-4bd4-9a0f-a304d25b2691 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:31.446406 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5941ef0-3419-417c-b5a0-ac0649e9d8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:31.447409 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5941ef0-3419-417c-b5a0-ac0649e9d8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:31.447732 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5941ef0-3419-417c-b5a0-ac0649e9d8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:31.448015 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5941ef0-3419-417c-b5a0-ac0649e9d8b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:31.448874 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5941ef0-3419-417c-b5a0-ac0649e9d8b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:31.450491 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5941ef0-3419-417c-b5a0-ac0649e9d8b0 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:31.456409 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b765bd-070f-4b05-b5ba-b0dff14b1a56 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:31.460376 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214888a-9426-4c57-b055-fa0752dcf9d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:31.461114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214888a-9426-4c57-b055-fa0752dcf9d4 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:31.461402 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214888a-9426-4c57-b055-fa0752dcf9d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:31.464564 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214888a-9426-4c57-b055-fa0752dcf9d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:31.464710 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 804/1592] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:55:31.464710 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5941ef0-3419-417c-b5a0-ac0649e9d8b0 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:31.473823 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214888a-9426-4c57-b055-fa0752dcf9d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:31.474005 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5941ef0-3419-417c-b5a0-ac0649e9d8b0 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:31.475287 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214888a-9426-4c57-b055-fa0752dcf9d4 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:31.478692 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac673e-f8e3-4a9e-ae38-e20a1a30f7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:31.483190 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac673e-f8e3-4a9e-ae38-e20a1a30f7e1 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:31.483190 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac673e-f8e3-4a9e-ae38-e20a1a30f7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:31.483190 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac673e-f8e3-4a9e-ae38-e20a1a30f7e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:31.483190 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac673e-f8e3-4a9e-ae38-e20a1a30f7e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:31.483190 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac673e-f8e3-4a9e-ae38-e20a1a30f7e1 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:31.485746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 789/1593] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:55:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:55:31.487497 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214888a-9426-4c57-b055-fa0752dcf9d4 service neutron] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:31.493952 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 805/1594] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:55:31.495356 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79481cba-0e2e-45ec-b7cc-8de4869ab6b1 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:31.495685 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79481cba-0e2e-45ec-b7cc-8de4869ab6b1 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:31.495951 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79481cba-0e2e-45ec-b7cc-8de4869ab6b1 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:31.497582 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 806/1595] 10.222.0.39 () {54 vars in 961 bytes} [Mon May 23 15:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:55:31.498288 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79481cba-0e2e-45ec-b7cc-8de4869ab6b1 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:31.498488 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214888a-9426-4c57-b055-fa0752dcf9d4 service neutron] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:31.504200 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a85ed-e3f5-42c5-a652-efe390426b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:31.505075 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a85ed-e3f5-42c5-a652-efe390426b75 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:31.505498 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a85ed-e3f5-42c5-a652-efe390426b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:31.505932 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a85ed-e3f5-42c5-a652-efe390426b75 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:31.506709 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a85ed-e3f5-42c5-a652-efe390426b75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:31.508427 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a85ed-e3f5-42c5-a652-efe390426b75 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:31.514273 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79481cba-0e2e-45ec-b7cc-8de4869ab6b1 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:31.521818 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 790/1596] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:55:31.521977 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff43ea5-0da7-4daa-8805-9f98560e7cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:31.522096 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a85ed-e3f5-42c5-a652-efe390426b75 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:31.522199 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff43ea5-0da7-4daa-8805-9f98560e7cb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:31.522199 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff43ea5-0da7-4daa-8805-9f98560e7cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:31.522199 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff43ea5-0da7-4daa-8805-9f98560e7cb1 admin admin] PATH_INFO: `/v3/projects/b66a22c0fa754c02b3652c9371e58ab3/users/a4cc23fb34774e3b87c869516f94f69d/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:31.531588 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a85ed-e3f5-42c5-a652-efe390426b75 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:31.536362 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b829a-af40-4d76-8b9d-f76f744eea22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:31.536499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff43ea5-0da7-4daa-8805-9f98560e7cb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b66a22c0fa754c02b3652c9371e58ab3, user_id=a4cc23fb34774e3b87c869516f94f69d, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:31.537140 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b829a-af40-4d76-8b9d-f76f744eea22 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:31.537429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b829a-af40-4d76-8b9d-f76f744eea22 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:31.537704 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b829a-af40-4d76-8b9d-f76f744eea22 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:31.538422 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b829a-af40-4d76-8b9d-f76f744eea22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:31.539079 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff43ea5-0da7-4daa-8805-9f98560e7cb1 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:31.540041 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b829a-af40-4d76-8b9d-f76f744eea22 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:31.550846 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 791/1597] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:55:31.551673 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b829a-af40-4d76-8b9d-f76f744eea22 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:31.561013 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b829a-af40-4d76-8b9d-f76f744eea22 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:31.566548 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0c96b-761d-4069-a710-50020f4e5416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:31.567168 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0c96b-761d-4069-a710-50020f4e5416 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:31.567450 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0c96b-761d-4069-a710-50020f4e5416 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:31.567763 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0c96b-761d-4069-a710-50020f4e5416 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:31.568465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a0c96b-761d-4069-a710-50020f4e5416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:31.570018 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a0c96b-761d-4069-a710-50020f4e5416 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:31.580324 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 792/1598] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:55:31.581167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0c96b-761d-4069-a710-50020f4e5416 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:31.590420 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0c96b-761d-4069-a710-50020f4e5416 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:31.594857 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ff893-2c31-45db-a50c-d0d6ed931965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:31.595466 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ff893-2c31-45db-a50c-d0d6ed931965 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:31.595821 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ff893-2c31-45db-a50c-d0d6ed931965 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:31.596280 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ff893-2c31-45db-a50c-d0d6ed931965 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:31.597102 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ff893-2c31-45db-a50c-d0d6ed931965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:31.598651 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ff893-2c31-45db-a50c-d0d6ed931965 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:31.608683 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 793/1599] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:55:31.609335 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ff893-2c31-45db-a50c-d0d6ed931965 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:31.619072 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ff893-2c31-45db-a50c-d0d6ed931965 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:31.624970 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fadb9-f199-4fbd-8176-a4ec98aac1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:31.624970 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fadb9-f199-4fbd-8176-a4ec98aac1cc admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:31.624970 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fadb9-f199-4fbd-8176-a4ec98aac1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:31.624970 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fadb9-f199-4fbd-8176-a4ec98aac1cc admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:31.625400 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2fadb9-f199-4fbd-8176-a4ec98aac1cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:31.626914 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2fadb9-f199-4fbd-8176-a4ec98aac1cc admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:31.637083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 794/1600] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:55:31.638280 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389ef0e-90dc-4d89-9b70-5a78789c21cd None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:31.638570 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389ef0e-90dc-4d89-9b70-5a78789c21cd None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:31.638849 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389ef0e-90dc-4d89-9b70-5a78789c21cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:31.652732 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 807/1601] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:55:31 2022] PUT /identity/v3/projects/b66a22c0fa754c02b3652c9371e58ab3/users/a4cc23fb34774e3b87c869516f94f69d/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:55:31.653687 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff43ea5-0da7-4daa-8805-9f98560e7cb1 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:31.667821 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-b389ef0e-90dc-4d89-9b70-5a78789c21cd None None] MFA Rules not processed for user `76f7895b7b5748e7b4461f7fde1d558a`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:31.669099 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-b389ef0e-90dc-4d89-9b70-5a78789c21cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:31.726460 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff43ea5-0da7-4daa-8805-9f98560e7cb1 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:31.728053 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:31.731248 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb43e5d-485e-481e-86be-928ed64293a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:31.731949 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb43e5d-485e-481e-86be-928ed64293a4 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:31.732230 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb43e5d-485e-481e-86be-928ed64293a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:31.732700 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb43e5d-485e-481e-86be-928ed64293a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:31.733282 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb43e5d-485e-481e-86be-928ed64293a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:31.734882 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb43e5d-485e-481e-86be-928ed64293a4 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:31.748029 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 808/1602] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:55:31.748785 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb43e5d-485e-481e-86be-928ed64293a4 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:31.750569 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 795/1603] 10.222.0.39 () {58 vars in 1058 bytes} [Mon May 23 15:55:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:31.751544 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389ef0e-90dc-4d89-9b70-5a78789c21cd None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:31.760080 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb43e5d-485e-481e-86be-928ed64293a4 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:31.762940 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389ef0e-90dc-4d89-9b70-5a78789c21cd None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:31.765137 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d87e1-ac26-492a-9d13-91caaa1f3ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:31.766037 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d87e1-ac26-492a-9d13-91caaa1f3ba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:31.766300 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d87e1-ac26-492a-9d13-91caaa1f3ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:31.766576 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d87e1-ac26-492a-9d13-91caaa1f3ba0 admin admin] PATH_INFO: `/v3/projects/4c8e2e9cc6684a40a8e5e669ca7b07d2/users/ce2a9dc6fbae42dfbfa4cb8b326c3de5/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:31.767878 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141424e3-3774-40f5-8956-dda30d1d67c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:31.768901 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141424e3-3774-40f5-8956-dda30d1d67c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:31.769212 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141424e3-3774-40f5-8956-dda30d1d67c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:31.769485 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141424e3-3774-40f5-8956-dda30d1d67c6 admin admin] PATH_INFO: `/v3/projects/c9a981aa2330454c92f23e6148939f34/users/0c039032f7d24f43afe0bae505b85789/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:31.785600 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d87e1-ac26-492a-9d13-91caaa1f3ba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c8e2e9cc6684a40a8e5e669ca7b07d2, user_id=ce2a9dc6fbae42dfbfa4cb8b326c3de5, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:31.785816 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141424e3-3774-40f5-8956-dda30d1d67c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9a981aa2330454c92f23e6148939f34, user_id=0c039032f7d24f43afe0bae505b85789, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:31.785946 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d87e1-ac26-492a-9d13-91caaa1f3ba0 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:31.787525 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141424e3-3774-40f5-8956-dda30d1d67c6 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:31.917081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 809/1604] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:55:31 2022] PUT /identity/v3/projects/4c8e2e9cc6684a40a8e5e669ca7b07d2/users/ce2a9dc6fbae42dfbfa4cb8b326c3de5/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:55:31.921732 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d87e1-ac26-492a-9d13-91caaa1f3ba0 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:31.946154 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 796/1605] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:55:31 2022] PUT /identity/v3/projects/c9a981aa2330454c92f23e6148939f34/users/0c039032f7d24f43afe0bae505b85789/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:55:31.947439 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141424e3-3774-40f5-8956-dda30d1d67c6 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:31.966138 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:31.996469 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d87e1-ac26-492a-9d13-91caaa1f3ba0 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:32.015842 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141424e3-3774-40f5-8956-dda30d1d67c6 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:32.020885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d70d4c-a39c-4342-98f8-1c0d129ed505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:32.021792 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d70d4c-a39c-4342-98f8-1c0d129ed505 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:32.022071 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d70d4c-a39c-4342-98f8-1c0d129ed505 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:32.022682 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d70d4c-a39c-4342-98f8-1c0d129ed505 admin admin] PATH_INFO: `/v3/projects/8d23dc4d351a49d1992c2f0eb3f05a65/users/5a57fd95e0714be6b124d5abc2422dbc/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:32.039402 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d70d4c-a39c-4342-98f8-1c0d129ed505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d23dc4d351a49d1992c2f0eb3f05a65, user_id=5a57fd95e0714be6b124d5abc2422dbc, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:32.042032 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d70d4c-a39c-4342-98f8-1c0d129ed505 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:32.054804 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2490f4-47c0-4b8a-ac67-7e4d4e616cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:32.057254 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2490f4-47c0-4b8a-ac67-7e4d4e616cf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:32.057254 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2490f4-47c0-4b8a-ac67-7e4d4e616cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:32.057254 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2490f4-47c0-4b8a-ac67-7e4d4e616cf3 admin admin] PATH_INFO: `/v3/projects/ed73c8b93b8a421cbaa26df946f147c7/users/6e82759b3a7b4ca9a38de35ae662c3eb/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:32.073601 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2490f4-47c0-4b8a-ac67-7e4d4e616cf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed73c8b93b8a421cbaa26df946f147c7, user_id=6e82759b3a7b4ca9a38de35ae662c3eb, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:32.076328 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2490f4-47c0-4b8a-ac67-7e4d4e616cf3 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:32.099550 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 797/1606] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:55:31 2022] PUT /identity/v3/projects/8d23dc4d351a49d1992c2f0eb3f05a65/users/5a57fd95e0714be6b124d5abc2422dbc/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:55:32.103207 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0515cb4-e453-4c44-8527-4f68c746d92e None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:32.103510 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0515cb4-e453-4c44-8527-4f68c746d92e None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:32.103817 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0515cb4-e453-4c44-8527-4f68c746d92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:32.131496 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-f0515cb4-e453-4c44-8527-4f68c746d92e None None] MFA Rules not processed for user `a4cc23fb34774e3b87c869516f94f69d`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:32.135873 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-f0515cb4-e453-4c44-8527-4f68c746d92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:32.164400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 810/1607] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:55:31 2022] PUT /identity/v3/projects/ed73c8b93b8a421cbaa26df946f147c7/users/6e82759b3a7b4ca9a38de35ae662c3eb/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:55:32.165277 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2490f4-47c0-4b8a-ac67-7e4d4e616cf3 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:32.213279 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 798/1608] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:32.214132 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0515cb4-e453-4c44-8527-4f68c746d92e None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:32.251421 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2490f4-47c0-4b8a-ac67-7e4d4e616cf3 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:32.256352 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025d5ed-07bc-456d-818e-87c4c9f032cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:32.257242 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025d5ed-07bc-456d-818e-87c4c9f032cb admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:32.257527 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025d5ed-07bc-456d-818e-87c4c9f032cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:32.257804 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025d5ed-07bc-456d-818e-87c4c9f032cb admin admin] PATH_INFO: `/v3/projects/bbc47b5b4ab84fb7af928ca0a2b3b64f/users/261e4ebfb0504a21b6c54e05c0b8378f/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:32.260028 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:32.274620 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5025d5ed-07bc-456d-818e-87c4c9f032cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbc47b5b4ab84fb7af928ca0a2b3b64f, user_id=261e4ebfb0504a21b6c54e05c0b8378f, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:32.277323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5025d5ed-07bc-456d-818e-87c4c9f032cb admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:32.297684 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0515cb4-e453-4c44-8527-4f68c746d92e None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:32.364669 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727fe4e-e4d5-47af-84b2-3ef02d273802 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:32.365476 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727fe4e-e4d5-47af-84b2-3ef02d273802 service nova] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:32.366212 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727fe4e-e4d5-47af-84b2-3ef02d273802 service nova] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:32.366212 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727fe4e-e4d5-47af-84b2-3ef02d273802 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:32.379208 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 811/1609] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:55:32 2022] PUT /identity/v3/projects/bbc47b5b4ab84fb7af928ca0a2b3b64f/users/261e4ebfb0504a21b6c54e05c0b8378f/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:55:32.379208 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2cf9f-62c1-48e2-b85d-c47e23dc7558 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:32.379208 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2cf9f-62c1-48e2-b85d-c47e23dc7558 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:32.379208 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2cf9f-62c1-48e2-b85d-c47e23dc7558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:32.397159 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-a7e2cf9f-62c1-48e2-b85d-c47e23dc7558 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:32.398377 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-a7e2cf9f-62c1-48e2-b85d-c47e23dc7558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:32.436619 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9727fe4e-e4d5-47af-84b2-3ef02d273802 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:32.438724 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9727fe4e-e4d5-47af-84b2-3ef02d273802 service nova] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:32.447772 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:32.448664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 799/1610] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:55:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:55:32.450202 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5164c17-1868-4dd7-8a2c-a1c748d7eb37 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:32.450333 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5164c17-1868-4dd7-8a2c-a1c748d7eb37 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:32.450614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5164c17-1868-4dd7-8a2c-a1c748d7eb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:32.478088 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 812/1611] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:32.478631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-a5164c17-1868-4dd7-8a2c-a1c748d7eb37 None None] MFA Rules not processed for user `0c039032f7d24f43afe0bae505b85789`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:32.479888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-a5164c17-1868-4dd7-8a2c-a1c748d7eb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:32.480123 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d8601-11c5-4640-a196-49efdb940c79 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:32.480598 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d8601-11c5-4640-a196-49efdb940c79 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:32.481214 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d8601-11c5-4640-a196-49efdb940c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:32.506634 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-c23d8601-11c5-4640-a196-49efdb940c79 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:32.507997 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-c23d8601-11c5-4640-a196-49efdb940c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:32.516428 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 813/1612] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:32.518091 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e1db7-fa18-4935-94e2-af2adb2dd21f None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:32.518676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e1db7-fa18-4935-94e2-af2adb2dd21f None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:32.519029 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e1db7-fa18-4935-94e2-af2adb2dd21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:32.537667 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-7e5e1db7-fa18-4935-94e2-af2adb2dd21f None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:32.538952 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-7e5e1db7-fa18-4935-94e2-af2adb2dd21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:32.547537 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 814/1613] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:32.553302 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488408f-efce-4796-9991-2522d2373f04 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:32.553595 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488408f-efce-4796-9991-2522d2373f04 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:32.554061 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488408f-efce-4796-9991-2522d2373f04 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:32.556450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 815/1614] 10.222.0.39 () {54 vars in 961 bytes} [Mon May 23 15:55:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:55:32.557493 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c47c4-0641-40c1-a8d4-755e2f6c60ab None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:32.557777 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c47c4-0641-40c1-a8d4-755e2f6c60ab None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:32.558055 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c47c4-0641-40c1-a8d4-755e2f6c60ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:32.574930 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 800/1615] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:32 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:32.576393 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5164c17-1868-4dd7-8a2c-a1c748d7eb37 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:32.588545 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-769c47c4-0641-40c1-a8d4-755e2f6c60ab None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:32.588545 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-769c47c4-0641-40c1-a8d4-755e2f6c60ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:32.595821 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 816/1616] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:32.596738 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c47c4-0641-40c1-a8d4-755e2f6c60ab None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:32.648046 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5164c17-1868-4dd7-8a2c-a1c748d7eb37 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:32.652735 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43400ac0-e0f5-4a95-b788-dd0937f44329 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:32.653593 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43400ac0-e0f5-4a95-b788-dd0937f44329 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:32.653880 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43400ac0-e0f5-4a95-b788-dd0937f44329 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:32.654162 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43400ac0-e0f5-4a95-b788-dd0937f44329 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:32.665562 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43400ac0-e0f5-4a95-b788-dd0937f44329 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:32.667547 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43400ac0-e0f5-4a95-b788-dd0937f44329 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:32.670813 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c47c4-0641-40c1-a8d4-755e2f6c60ab None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:32.674852 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92751446-38f5-426a-b147-af1070e80132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:32.675506 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92751446-38f5-426a-b147-af1070e80132 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:32.681222 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92751446-38f5-426a-b147-af1070e80132 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:32.681222 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92751446-38f5-426a-b147-af1070e80132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:32.681417 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 801/1617] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:55:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:55:32.681417 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae35df-0a55-41c7-bd86-d376d70e7654 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:32.681417 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae35df-0a55-41c7-bd86-d376d70e7654 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:32.681417 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae35df-0a55-41c7-bd86-d376d70e7654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:32.686740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92751446-38f5-426a-b147-af1070e80132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:32.688613 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92751446-38f5-426a-b147-af1070e80132 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:32.700347 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:32.702310 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-1dae35df-0a55-41c7-bd86-d376d70e7654 None None] MFA Rules not processed for user `76f7895b7b5748e7b4461f7fde1d558a`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:32.703865 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-1dae35df-0a55-41c7-bd86-d376d70e7654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:32.706815 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 817/1618] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:55:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:55:32.708824 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92751446-38f5-426a-b147-af1070e80132 service neutron] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:32.710496 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-92751446-38f5-426a-b147-af1070e80132 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:32.724914 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92751446-38f5-426a-b147-af1070e80132 service neutron] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:32.736198 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74840643-a728-4faf-8aba-a2b1661d1772 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:32.736198 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74840643-a728-4faf-8aba-a2b1661d1772 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:32.736198 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74840643-a728-4faf-8aba-a2b1661d1772 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:32.736198 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74840643-a728-4faf-8aba-a2b1661d1772 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:32.745424 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74840643-a728-4faf-8aba-a2b1661d1772 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:32.746877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74840643-a728-4faf-8aba-a2b1661d1772 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:32.757406 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 818/1619] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:55:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:55:32.758296 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74840643-a728-4faf-8aba-a2b1661d1772 service neutron] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:32.782343 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 802/1620] 10.222.0.39 () {58 vars in 1058 bytes} [Mon May 23 15:55:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:32.783353 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae35df-0a55-41c7-bd86-d376d70e7654 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:32.792404 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae35df-0a55-41c7-bd86-d376d70e7654 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:32.795990 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311508e-9322-436d-adf0-b1309d063221 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:32.796615 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311508e-9322-436d-adf0-b1309d063221 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:32.796897 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311508e-9322-436d-adf0-b1309d063221 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:32.797169 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311508e-9322-436d-adf0-b1309d063221 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:32.810088 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311508e-9322-436d-adf0-b1309d063221 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:32.810088 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311508e-9322-436d-adf0-b1309d063221 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:32.817501 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74840643-a728-4faf-8aba-a2b1661d1772 service neutron] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:32.818167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 803/1621] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:55:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:55:32.819501 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b068ab-ea89-4f95-b08d-01dbc8e3a96e None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:32.819767 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b068ab-ea89-4f95-b08d-01dbc8e3a96e None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:32.820043 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b068ab-ea89-4f95-b08d-01dbc8e3a96e None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:32.821510 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82623e5-525a-4b67-801e-2dcb412e4791 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:32.822184 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82623e5-525a-4b67-801e-2dcb412e4791 service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:32.822585 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82623e5-525a-4b67-801e-2dcb412e4791 service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:32.822877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82623e5-525a-4b67-801e-2dcb412e4791 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:32.823739 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 804/1622] 10.222.0.39 () {54 vars in 912 bytes} [Mon May 23 15:55:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:55:32.824838 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b068ab-ea89-4f95-b08d-01dbc8e3a96e None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:32.833850 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82623e5-525a-4b67-801e-2dcb412e4791 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:32.835477 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82623e5-525a-4b67-801e-2dcb412e4791 service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:32.845922 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 819/1623] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:55:32 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:55:32.847216 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54626c68-a470-417f-860e-02b716a46fdf None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:32.847582 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54626c68-a470-417f-860e-02b716a46fdf None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:32.847967 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54626c68-a470-417f-860e-02b716a46fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:32.855806 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b068ab-ea89-4f95-b08d-01dbc8e3a96e None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:32.874433 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-54626c68-a470-417f-860e-02b716a46fdf None None] MFA Rules not processed for user `76f7895b7b5748e7b4461f7fde1d558a`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:32.880940 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-54626c68-a470-417f-860e-02b716a46fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:32.887452 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfba29-ba44-414e-b6c7-6db08039e002 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:32.888223 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfba29-ba44-414e-b6c7-6db08039e002 service nova] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:32.890440 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfba29-ba44-414e-b6c7-6db08039e002 service nova] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:32.890440 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfba29-ba44-414e-b6c7-6db08039e002 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:32.895036 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 820/1624] 10.222.0.39 () {58 vars in 1009 bytes} [Mon May 23 15:55:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:32.910920 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54626c68-a470-417f-860e-02b716a46fdf None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:32.923233 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54626c68-a470-417f-860e-02b716a46fdf None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:32.927449 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862be15-4669-496e-b3aa-7a3b2743bb15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:32.928280 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862be15-4669-496e-b3aa-7a3b2743bb15 service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:32.928774 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862be15-4669-496e-b3aa-7a3b2743bb15 service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:32.928904 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862be15-4669-496e-b3aa-7a3b2743bb15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:32.943070 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862be15-4669-496e-b3aa-7a3b2743bb15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:32.945080 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862be15-4669-496e-b3aa-7a3b2743bb15 service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:32.975067 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 821/1625] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:55:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:55:33.051592 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dfba29-ba44-414e-b6c7-6db08039e002 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:33.053290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dfba29-ba44-414e-b6c7-6db08039e002 service nova] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:33.073840 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 805/1626] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:55:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:55:33.640208 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05731ca1-8cb6-4570-a2ee-76f1a83eb2db None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:33.640208 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05731ca1-8cb6-4570-a2ee-76f1a83eb2db None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:33.640896 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05731ca1-8cb6-4570-a2ee-76f1a83eb2db None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:33.642473 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 822/1627] 10.222.0.39 () {54 vars in 912 bytes} [Mon May 23 15:55:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:55:33.651433 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df33c14-eec2-45e6-9cf2-5c4f0478b459 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:33.651993 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df33c14-eec2-45e6-9cf2-5c4f0478b459 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:33.652185 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df33c14-eec2-45e6-9cf2-5c4f0478b459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:33.684621 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-5df33c14-eec2-45e6-9cf2-5c4f0478b459 None None] MFA Rules not processed for user `76f7895b7b5748e7b4461f7fde1d558a`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:33.684621 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-5df33c14-eec2-45e6-9cf2-5c4f0478b459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:33.693818 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 806/1628] 10.222.0.39 () {58 vars in 1009 bytes} [Mon May 23 15:55:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:34.257672 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05731ca1-8cb6-4570-a2ee-76f1a83eb2db None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:34.272276 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05731ca1-8cb6-4570-a2ee-76f1a83eb2db None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:34.277473 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e6520-523a-4c88-9ac2-d00d73cd1dcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:34.281445 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e6520-523a-4c88-9ac2-d00d73cd1dcc service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:34.281445 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e6520-523a-4c88-9ac2-d00d73cd1dcc service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:34.281445 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e6520-523a-4c88-9ac2-d00d73cd1dcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:34.294291 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e6520-523a-4c88-9ac2-d00d73cd1dcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:34.297397 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e6520-523a-4c88-9ac2-d00d73cd1dcc service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:34.325591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 823/1629] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:55:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:55:34.924967 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df33c14-eec2-45e6-9cf2-5c4f0478b459 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:34.924967 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df33c14-eec2-45e6-9cf2-5c4f0478b459 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:34.924967 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114656b2-2c73-4952-a929-4ed80b7bcbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:34.924967 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114656b2-2c73-4952-a929-4ed80b7bcbb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:34.927218 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114656b2-2c73-4952-a929-4ed80b7bcbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:34.927218 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114656b2-2c73-4952-a929-4ed80b7bcbb4 admin admin] PATH_INFO: `/v3/users/a4cc23fb34774e3b87c869516f94f69d` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:34.927218 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114656b2-2c73-4952-a929-4ed80b7bcbb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4cc23fb34774e3b87c869516f94f69d)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:34.927218 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114656b2-2c73-4952-a929-4ed80b7bcbb4 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:34.927218 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:35.046052 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-114656b2-2c73-4952-a929-4ed80b7bcbb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4cc23fb34774e3b87c869516f94f69d'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:35.054488 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-114656b2-2c73-4952-a929-4ed80b7bcbb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4cc23fb34774e3b87c869516f94f69d'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:35.055784 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-114656b2-2c73-4952-a929-4ed80b7bcbb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4cc23fb34774e3b87c869516f94f69d'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:35.070248 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-114656b2-2c73-4952-a929-4ed80b7bcbb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4cc23fb34774e3b87c869516f94f69d'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:35.133327 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c201fd-6ac9-4a96-8e84-31ee4c7dd237 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:35.139110 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c201fd-6ac9-4a96-8e84-31ee4c7dd237 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:35.139110 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c201fd-6ac9-4a96-8e84-31ee4c7dd237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:35.185004 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-114656b2-2c73-4952-a929-4ed80b7bcbb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4cc23fb34774e3b87c869516f94f69d'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:35.185300 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-17c201fd-6ac9-4a96-8e84-31ee4c7dd237 None None] MFA Rules not processed for user `6e82759b3a7b4ca9a38de35ae662c3eb`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:35.186766 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-17c201fd-6ac9-4a96-8e84-31ee4c7dd237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:35.198896 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 807/1630] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:55:34 2022] DELETE /identity/v3/users/a4cc23fb34774e3b87c869516f94f69d => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:55:35.203136 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ae306-a034-4156-9232-06ec7c49342a None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:35.204032 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ae306-a034-4156-9232-06ec7c49342a None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:35.204489 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ae306-a034-4156-9232-06ec7c49342a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:35.221561 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:35.235461 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-1f3ae306-a034-4156-9232-06ec7c49342a None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:35.243384 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-1f3ae306-a034-4156-9232-06ec7c49342a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:35.327689 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 824/1631] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:35.341552 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c753c-e7ec-4cac-be5d-ae7b091f41fb None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:35.342131 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c753c-e7ec-4cac-be5d-ae7b091f41fb None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:35.342775 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c753c-e7ec-4cac-be5d-ae7b091f41fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:35.373416 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 808/1632] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:35.385520 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-d85c753c-e7ec-4cac-be5d-ae7b091f41fb None None] MFA Rules not processed for user `6e82759b3a7b4ca9a38de35ae662c3eb`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:35.390532 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ae306-a034-4156-9232-06ec7c49342a None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:35.392358 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-1f3ae306-a034-4156-9232-06ec7c49342a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:35.394253 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-d85c753c-e7ec-4cac-be5d-ae7b091f41fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:35.596031 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 825/1633] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:55:35.610654 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ae306-a034-4156-9232-06ec7c49342a None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:35.611873 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c753c-e7ec-4cac-be5d-ae7b091f41fb None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:35.616106 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-d85c753c-e7ec-4cac-be5d-ae7b091f41fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:35.622635 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d211b-f355-45c3-b805-5ee54f78cd44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:35.623486 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d211b-f355-45c3-b805-5ee54f78cd44 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:35.623820 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d211b-f355-45c3-b805-5ee54f78cd44 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:35.624360 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d211b-f355-45c3-b805-5ee54f78cd44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:35.650053 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d211b-f355-45c3-b805-5ee54f78cd44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:35.650773 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d211b-f355-45c3-b805-5ee54f78cd44 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:35.678601 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 809/1634] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:55:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:55:35.794291 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c753c-e7ec-4cac-be5d-ae7b091f41fb None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:35.807278 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe01b5-ccb2-42c0-ac14-e0375b298f5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:35.808739 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe01b5-ccb2-42c0-ac14-e0375b298f5b service nova] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:35.809385 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe01b5-ccb2-42c0-ac14-e0375b298f5b service nova] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:35.810002 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe01b5-ccb2-42c0-ac14-e0375b298f5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:35.825576 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe01b5-ccb2-42c0-ac14-e0375b298f5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:35.828441 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe01b5-ccb2-42c0-ac14-e0375b298f5b service nova] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:35.890158 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 826/1635] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:55:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:55:36.907795 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f6f56-23cd-47ce-a342-e6c7dd9f25fc None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:36.908888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f6f56-23cd-47ce-a342-e6c7dd9f25fc None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:36.908989 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f6f56-23cd-47ce-a342-e6c7dd9f25fc None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:36.910871 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 810/1636] 10.222.0.39 () {54 vars in 912 bytes} [Mon May 23 15:55:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:55:36.945518 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507cb77-3fdc-4318-9432-a8bc04071bf8 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:36.963361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507cb77-3fdc-4318-9432-a8bc04071bf8 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:36.963361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507cb77-3fdc-4318-9432-a8bc04071bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:37.057541 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-d507cb77-3fdc-4318-9432-a8bc04071bf8 None None] MFA Rules not processed for user `f831a06a9cf344a2aa068c20a987b6da`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:37.061287 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-d507cb77-3fdc-4318-9432-a8bc04071bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:37.089045 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 827/1637] 10.222.0.39 () {58 vars in 1009 bytes} [Mon May 23 15:55:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:37.139579 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f6f56-23cd-47ce-a342-e6c7dd9f25fc None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:37.141655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-ac1f6f56-23cd-47ce-a342-e6c7dd9f25fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:37.166773 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f6f56-23cd-47ce-a342-e6c7dd9f25fc None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:37.173079 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7fa37-d099-4f7b-adc2-bae682ed9bfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:37.174398 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7fa37-d099-4f7b-adc2-bae682ed9bfb service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:37.174689 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7fa37-d099-4f7b-adc2-bae682ed9bfb service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:37.175060 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7fa37-d099-4f7b-adc2-bae682ed9bfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:37.188756 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d7fa37-d099-4f7b-adc2-bae682ed9bfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:37.190784 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d7fa37-d099-4f7b-adc2-bae682ed9bfb service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:37.204047 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 811/1638] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:55:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:55:37.684077 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507cb77-3fdc-4318-9432-a8bc04071bf8 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:37.685570 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-d507cb77-3fdc-4318-9432-a8bc04071bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:37.712548 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507cb77-3fdc-4318-9432-a8bc04071bf8 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:37.719913 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5bd64-e2b5-4c43-9f0e-4a933ce0e46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:37.723079 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5bd64-e2b5-4c43-9f0e-4a933ce0e46e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:37.723590 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5bd64-e2b5-4c43-9f0e-4a933ce0e46e admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:37.725141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5bd64-e2b5-4c43-9f0e-4a933ce0e46e admin admin] PATH_INFO: `/v3/projects/b66a22c0fa754c02b3652c9371e58ab3` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:37.726624 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5bd64-e2b5-4c43-9f0e-4a933ce0e46e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b66a22c0fa754c02b3652c9371e58ab3)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:37.730797 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5bd64-e2b5-4c43-9f0e-4a933ce0e46e admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:37.801246 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:38.020446 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-70a5bd64-e2b5-4c43-9f0e-4a933ce0e46e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b66a22c0fa754c02b3652c9371e58ab3', 'request_id': 'req-70a5bd64-e2b5-4c43-9f0e-4a933ce0e46e'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:38.046128 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-70a5bd64-e2b5-4c43-9f0e-4a933ce0e46e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b66a22c0fa754c02b3652c9371e58ab3', 'request_id': 'req-70a5bd64-e2b5-4c43-9f0e-4a933ce0e46e'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:38.170472 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-70a5bd64-e2b5-4c43-9f0e-4a933ce0e46e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b66a22c0fa754c02b3652c9371e58ab3', 'request_id': 'req-70a5bd64-e2b5-4c43-9f0e-4a933ce0e46e'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:38.187342 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-70a5bd64-e2b5-4c43-9f0e-4a933ce0e46e admin admin] The token cache is being invalidate because project b66a22c0fa754c02b3652c9371e58ab3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:55:38.188036 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-70a5bd64-e2b5-4c43-9f0e-4a933ce0e46e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:38.188977 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-70a5bd64-e2b5-4c43-9f0e-4a933ce0e46e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:38.196516 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 828/1639] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:55:37 2022] DELETE /identity/v3/projects/b66a22c0fa754c02b3652c9371e58ab3 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:55:38.201251 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53856a8-fece-44c8-b91a-acbf6da6b1fb None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:38.201757 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53856a8-fece-44c8-b91a-acbf6da6b1fb None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:38.201838 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53856a8-fece-44c8-b91a-acbf6da6b1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:38.229554 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-b53856a8-fece-44c8-b91a-acbf6da6b1fb None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:38.230785 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-b53856a8-fece-44c8-b91a-acbf6da6b1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:38.261318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:38.431762 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 812/1640] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:38.434055 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c648fd-f6cf-4db5-8bac-f81950269327 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:38.434584 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c648fd-f6cf-4db5-8bac-f81950269327 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:38.434696 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c648fd-f6cf-4db5-8bac-f81950269327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:38.497880 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-b2c648fd-f6cf-4db5-8bac-f81950269327 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:38.500888 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-b2c648fd-f6cf-4db5-8bac-f81950269327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:38.533738 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 829/1641] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:38.539121 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53856a8-fece-44c8-b91a-acbf6da6b1fb None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:38.552926 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53856a8-fece-44c8-b91a-acbf6da6b1fb None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:38.569928 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb1700-c27a-44fc-ae63-dc193fc0e8e8 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:38.569928 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb1700-c27a-44fc-ae63-dc193fc0e8e8 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:38.570125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb1700-c27a-44fc-ae63-dc193fc0e8e8 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:38.572099 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 830/1642] 10.222.0.39 () {54 vars in 960 bytes} [Mon May 23 15:55:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:55:38.572943 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb1700-c27a-44fc-ae63-dc193fc0e8e8 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:38.576890 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-c8bb1700-c27a-44fc-ae63-dc193fc0e8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:38.596407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518b89d-a5e0-4511-9b47-392768c59d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:38.598589 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518b89d-a5e0-4511-9b47-392768c59d8f admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:38.598589 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518b89d-a5e0-4511-9b47-392768c59d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:38.607021 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518b89d-a5e0-4511-9b47-392768c59d8f admin admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:38.608222 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518b89d-a5e0-4511-9b47-392768c59d8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:55:38.608690 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518b89d-a5e0-4511-9b47-392768c59d8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:38.610667 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518b89d-a5e0-4511-9b47-392768c59d8f admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:38.633344 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb1700-c27a-44fc-ae63-dc193fc0e8e8 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:38.640746 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535dccf-1aa9-4703-b244-d5069b14e064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:38.641907 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535dccf-1aa9-4703-b244-d5069b14e064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:38.642234 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535dccf-1aa9-4703-b244-d5069b14e064 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:38.642501 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535dccf-1aa9-4703-b244-d5069b14e064 admin admin] PATH_INFO: `/v3/users/45265d0bece243f68205a341da4e8d93` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:38.644313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 813/1643] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 15:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:55:38.644892 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535dccf-1aa9-4703-b244-d5069b14e064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45265d0bece243f68205a341da4e8d93)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:38.646029 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf82c5-bd93-4efd-a32a-cd1541b7c941 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:38.646670 dv-cinder-842119-2-smb devstack@keystone.service[87191]: WARNING py.warnings [None req-6535dccf-1aa9-4703-b244-d5069b14e064 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 15:55:38.646670 dv-cinder-842119-2-smb devstack@keystone.service[87191]: warnings.warn(msg) May 23 15:55:38.646670 dv-cinder-842119-2-smb devstack@keystone.service[87191]: May 23 15:55:38.648239 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf82c5-bd93-4efd-a32a-cd1541b7c941 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:38.649295 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf82c5-bd93-4efd-a32a-cd1541b7c941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:38.652410 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535dccf-1aa9-4703-b244-d5069b14e064 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:38.714295 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-7fcf82c5-bd93-4efd-a32a-cd1541b7c941 None None] MFA Rules not processed for user `84f06d35d7cc48658262bf79d9c72280`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:38.716239 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-7fcf82c5-bd93-4efd-a32a-cd1541b7c941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:38.873632 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 814/1644] 10.222.0.39 () {58 vars in 1057 bytes} [Mon May 23 15:55:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:38.874548 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf82c5-bd93-4efd-a32a-cd1541b7c941 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:38.898817 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf82c5-bd93-4efd-a32a-cd1541b7c941 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:38.910819 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7d9ba-d9eb-4da6-914f-80536de53fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:38.911764 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7d9ba-d9eb-4da6-914f-80536de53fa0 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:38.912135 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7d9ba-d9eb-4da6-914f-80536de53fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:38.912530 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7d9ba-d9eb-4da6-914f-80536de53fa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:38.913319 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7d9ba-d9eb-4da6-914f-80536de53fa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:38.915391 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7d9ba-d9eb-4da6-914f-80536de53fa0 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:39.011961 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-6535dccf-1aa9-4703-b244-d5069b14e064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45265d0bece243f68205a341da4e8d93'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:39.012367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-6535dccf-1aa9-4703-b244-d5069b14e064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45265d0bece243f68205a341da4e8d93'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:39.012999 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-6535dccf-1aa9-4703-b244-d5069b14e064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45265d0bece243f68205a341da4e8d93'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:39.076883 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 815/1645] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:55:38 2022] POST /identity/v3/projects => generated 385 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:55:39.077978 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7d9ba-d9eb-4da6-914f-80536de53fa0 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:39.080795 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-c7f7d9ba-d9eb-4da6-914f-80536de53fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:39.092437 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-6535dccf-1aa9-4703-b244-d5069b14e064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45265d0bece243f68205a341da4e8d93'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:39.113976 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-6535dccf-1aa9-4703-b244-d5069b14e064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45265d0bece243f68205a341da4e8d93'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:39.164723 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 831/1646] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:55:38 2022] DELETE /identity/v3/users/45265d0bece243f68205a341da4e8d93 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:55:39.172074 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535dccf-1aa9-4703-b244-d5069b14e064 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:39.173667 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-6535dccf-1aa9-4703-b244-d5069b14e064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:39.297823 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7d9ba-d9eb-4da6-914f-80536de53fa0 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:39.320098 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535dccf-1aa9-4703-b244-d5069b14e064 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:39.332884 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c08e7-a776-4a4e-b7df-c220ca96724c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:39.333587 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c08e7-a776-4a4e-b7df-c220ca96724c admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:39.333863 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c08e7-a776-4a4e-b7df-c220ca96724c admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:39.334141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c08e7-a776-4a4e-b7df-c220ca96724c admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:39.334841 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c08e7-a776-4a4e-b7df-c220ca96724c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:39.336837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c08e7-a776-4a4e-b7df-c220ca96724c admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:39.441597 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4f3bf-49bd-4612-aacd-0275ba064555 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f06d35d7cc48658262bf79d9c72280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:39.442474 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4f3bf-49bd-4612-aacd-0275ba064555 service placement] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:39.442742 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4f3bf-49bd-4612-aacd-0275ba064555 service placement] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:39.443018 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4f3bf-49bd-4612-aacd-0275ba064555 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:39.450562 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 832/1647] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:55:39 2022] POST /identity/v3/users => generated 293 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:55:39.450734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-f6d4f3bf-49bd-4612-aacd-0275ba064555 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:39.450808 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c0e95-3e94-43d4-a752-e4ac446b6775 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:39.450808 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c0e95-3e94-43d4-a752-e4ac446b6775 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:39.450808 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c0e95-3e94-43d4-a752-e4ac446b6775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:39.480553 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:DELETE=17,keystone:SELECT=78,keystone:INSERT=5 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:39.483135 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d4f3bf-49bd-4612-aacd-0275ba064555 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:39.485752 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d4f3bf-49bd-4612-aacd-0275ba064555 service placement] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:39.495781 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-670c0e95-3e94-43d4-a752-e4ac446b6775 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:39.502547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-670c0e95-3e94-43d4-a752-e4ac446b6775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:39.513372 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 816/1648] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:55:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:55:39.514568 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4f3bf-49bd-4612-aacd-0275ba064555 service placement] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:39.541204 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4f3bf-49bd-4612-aacd-0275ba064555 service placement] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:39.545865 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 833/1649] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:39.557088 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b61427-c6e0-4890-ac9e-4a8d07b8553a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:39.557088 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b61427-c6e0-4890-ac9e-4a8d07b8553a admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:39.557541 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b61427-c6e0-4890-ac9e-4a8d07b8553a admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:39.557902 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b61427-c6e0-4890-ac9e-4a8d07b8553a admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:39.559238 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b61427-c6e0-4890-ac9e-4a8d07b8553a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:39.578180 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b61427-c6e0-4890-ac9e-4a8d07b8553a admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:39.595122 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c0e95-3e94-43d4-a752-e4ac446b6775 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:39.596900 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-670c0e95-3e94-43d4-a752-e4ac446b6775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:39.617323 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 817/1650] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:55:39.621045 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b61427-c6e0-4890-ac9e-4a8d07b8553a admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:39.647504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b61427-c6e0-4890-ac9e-4a8d07b8553a admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:39.663361 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa00e7b-cfee-499d-8474-dd99a18d811f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:39.665844 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa00e7b-cfee-499d-8474-dd99a18d811f admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:39.667017 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa00e7b-cfee-499d-8474-dd99a18d811f admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:39.667494 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa00e7b-cfee-499d-8474-dd99a18d811f admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:39.673004 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa00e7b-cfee-499d-8474-dd99a18d811f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:39.677418 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa00e7b-cfee-499d-8474-dd99a18d811f admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:39.726952 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:39.731527 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 818/1651] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:55:39.732803 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa00e7b-cfee-499d-8474-dd99a18d811f admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:39.758998 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa00e7b-cfee-499d-8474-dd99a18d811f admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:39.770283 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c184ab-bcad-4ddc-8381-f91a419e839a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:39.770781 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c0e95-3e94-43d4-a752-e4ac446b6775 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:39.771375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c184ab-bcad-4ddc-8381-f91a419e839a admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:39.771797 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c184ab-bcad-4ddc-8381-f91a419e839a admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:39.772153 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c184ab-bcad-4ddc-8381-f91a419e839a admin admin] PATH_INFO: `/v3/projects/ba1e295ea00d46c3a07bdc551b912697/users/37311561700e4aa99271d19ec36e0f33/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:39.792644 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ccd46d-44a4-4424-a3fe-4bf67f902745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:39.793508 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccd46d-44a4-4424-a3fe-4bf67f902745 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:39.793760 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccd46d-44a4-4424-a3fe-4bf67f902745 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:39.793965 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccd46d-44a4-4424-a3fe-4bf67f902745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:39.818348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c184ab-bcad-4ddc-8381-f91a419e839a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba1e295ea00d46c3a07bdc551b912697, user_id=37311561700e4aa99271d19ec36e0f33, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:39.824497 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c184ab-bcad-4ddc-8381-f91a419e839a admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:39.838798 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ccd46d-44a4-4424-a3fe-4bf67f902745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:39.844490 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ccd46d-44a4-4424-a3fe-4bf67f902745 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:39.871232 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 834/1652] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:55:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:55:39.917669 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 819/1653] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:55:39 2022] PUT /identity/v3/projects/ba1e295ea00d46c3a07bdc551b912697/users/37311561700e4aa99271d19ec36e0f33/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:55:39.936491 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ab54a-96ae-4ac3-9dcb-6d04d9e39683 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:39.937480 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ab54a-96ae-4ac3-9dcb-6d04d9e39683 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:39.938002 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ab54a-96ae-4ac3-9dcb-6d04d9e39683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:40.021403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-925ab54a-96ae-4ac3-9dcb-6d04d9e39683 None None] MFA Rules not processed for user `37311561700e4aa99271d19ec36e0f33`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:40.022741 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-925ab54a-96ae-4ac3-9dcb-6d04d9e39683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:40.183546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 835/1654] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:40.188089 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c184ab-bcad-4ddc-8381-f91a419e839a admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:40.311316 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c184ab-bcad-4ddc-8381-f91a419e839a admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:40.318951 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602d0cc-0f68-48c0-aac1-79ec6a31a0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:40.320222 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602d0cc-0f68-48c0-aac1-79ec6a31a0b0 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:40.320552 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602d0cc-0f68-48c0-aac1-79ec6a31a0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:40.320843 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602d0cc-0f68-48c0-aac1-79ec6a31a0b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:40.321626 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602d0cc-0f68-48c0-aac1-79ec6a31a0b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:40.324147 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602d0cc-0f68-48c0-aac1-79ec6a31a0b0 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:40.505770 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 820/1655] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:55:40 2022] POST /identity/v3/projects => generated 385 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:55:40.509713 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ab54a-96ae-4ac3-9dcb-6d04d9e39683 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:40.523830 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ab54a-96ae-4ac3-9dcb-6d04d9e39683 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:40.669257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3238d-e894-4021-8f49-f9e63f2f7355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:40.669963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3238d-e894-4021-8f49-f9e63f2f7355 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:40.670236 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3238d-e894-4021-8f49-f9e63f2f7355 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:40.670509 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3238d-e894-4021-8f49-f9e63f2f7355 admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:40.671213 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3238d-e894-4021-8f49-f9e63f2f7355 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:40.674910 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3238d-e894-4021-8f49-f9e63f2f7355 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:40.840937 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 836/1656] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:55:40 2022] POST /identity/v3/users => generated 299 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:55:40.844556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602d0cc-0f68-48c0-aac1-79ec6a31a0b0 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:40.862419 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602d0cc-0f68-48c0-aac1-79ec6a31a0b0 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:40.887756 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc0721-47f6-4c74-bc4b-7d7ddbace426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:40.889080 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc0721-47f6-4c74-bc4b-7d7ddbace426 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:40.892027 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc0721-47f6-4c74-bc4b-7d7ddbace426 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:40.896850 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc0721-47f6-4c74-bc4b-7d7ddbace426 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:40.902172 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc0721-47f6-4c74-bc4b-7d7ddbace426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:40.903949 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc0721-47f6-4c74-bc4b-7d7ddbace426 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:40.954989 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 821/1657] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:55:40.956734 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3238d-e894-4021-8f49-f9e63f2f7355 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:40.975242 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3238d-e894-4021-8f49-f9e63f2f7355 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:41.004569 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd384617-f821-4d33-a081-84b896a4b80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:41.005668 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd384617-f821-4d33-a081-84b896a4b80d admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:41.008061 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd384617-f821-4d33-a081-84b896a4b80d admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:41.011063 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd384617-f821-4d33-a081-84b896a4b80d admin admin] PATH_INFO: `/v3/projects/0daa9482d72945a48eb84a4884b900e2/users/7e27bf5e59124c49ae947dd8eff096f9/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:41.068041 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd384617-f821-4d33-a081-84b896a4b80d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0daa9482d72945a48eb84a4884b900e2, user_id=7e27bf5e59124c49ae947dd8eff096f9, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:41.073253 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd384617-f821-4d33-a081-84b896a4b80d admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:41.083015 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:41.185520 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 837/1658] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:55:40 2022] PUT /identity/v3/projects/0daa9482d72945a48eb84a4884b900e2/users/7e27bf5e59124c49ae947dd8eff096f9/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:55:41.189988 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc0721-47f6-4c74-bc4b-7d7ddbace426 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:41.206368 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc0721-47f6-4c74-bc4b-7d7ddbace426 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:41.300682 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:41.374656 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fe6a3-49cf-4968-abc8-4f561bc0acd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:41.376605 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fe6a3-49cf-4968-abc8-4f561bc0acd1 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:41.376900 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fe6a3-49cf-4968-abc8-4f561bc0acd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:41.377184 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fe6a3-49cf-4968-abc8-4f561bc0acd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:41.378438 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7fe6a3-49cf-4968-abc8-4f561bc0acd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:41.382646 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7fe6a3-49cf-4968-abc8-4f561bc0acd1 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:41.411649 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 822/1659] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:55:41.413731 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd384617-f821-4d33-a081-84b896a4b80d admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:41.430586 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd384617-f821-4d33-a081-84b896a4b80d admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:41.444673 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32056ff0-9aa1-463f-83d5-0fcb16307d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:41.445801 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32056ff0-9aa1-463f-83d5-0fcb16307d69 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:41.446502 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32056ff0-9aa1-463f-83d5-0fcb16307d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:41.446953 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32056ff0-9aa1-463f-83d5-0fcb16307d69 admin admin] PATH_INFO: `/v3/projects/0daa9482d72945a48eb84a4884b900e2/users/7e27bf5e59124c49ae947dd8eff096f9/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:41.462308 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32056ff0-9aa1-463f-83d5-0fcb16307d69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0daa9482d72945a48eb84a4884b900e2, user_id=7e27bf5e59124c49ae947dd8eff096f9, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:41.465066 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32056ff0-9aa1-463f-83d5-0fcb16307d69 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:41.520153 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 838/1660] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:55:41 2022] PUT /identity/v3/projects/0daa9482d72945a48eb84a4884b900e2/users/7e27bf5e59124c49ae947dd8eff096f9/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:55:41.530684 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50436a80-4a54-43d4-a6b9-c26847af35b9 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:41.530978 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50436a80-4a54-43d4-a6b9-c26847af35b9 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:41.531320 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50436a80-4a54-43d4-a6b9-c26847af35b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:41.598554 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-50436a80-4a54-43d4-a6b9-c26847af35b9 None None] MFA Rules not processed for user `7e27bf5e59124c49ae947dd8eff096f9`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:41.600040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-50436a80-4a54-43d4-a6b9-c26847af35b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:41.820691 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32056ff0-9aa1-463f-83d5-0fcb16307d69 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:41.821681 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 823/1661] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:41.823100 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-32056ff0-9aa1-463f-83d5-0fcb16307d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:41.990742 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32056ff0-9aa1-463f-83d5-0fcb16307d69 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:41.995138 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fe2fc-ec57-47e8-aa58-d970b14a56fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:41.996171 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fe2fc-ec57-47e8-aa58-d970b14a56fb service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:41.996635 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fe2fc-ec57-47e8-aa58-d970b14a56fb service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:41.997086 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fe2fc-ec57-47e8-aa58-d970b14a56fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:42.011729 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531fe2fc-ec57-47e8-aa58-d970b14a56fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:42.013703 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531fe2fc-ec57-47e8-aa58-d970b14a56fb service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:42.026079 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 839/1662] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:55:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:55:42.167978 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50436a80-4a54-43d4-a6b9-c26847af35b9 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:42.344436 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50436a80-4a54-43d4-a6b9-c26847af35b9 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:42.352180 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec3923-3b46-4ba6-a245-4a8415a052c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:42.353226 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec3923-3b46-4ba6-a245-4a8415a052c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:42.357223 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec3923-3b46-4ba6-a245-4a8415a052c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:42.357223 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec3923-3b46-4ba6-a245-4a8415a052c4 admin admin] PATH_INFO: `/v3/users/37311561700e4aa99271d19ec36e0f33` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:42.357223 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec3923-3b46-4ba6-a245-4a8415a052c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37311561700e4aa99271d19ec36e0f33)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:42.361128 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec3923-3b46-4ba6-a245-4a8415a052c4 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:42.476259 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fe2fc-ec57-47e8-aa58-d970b14a56fb service cinder] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:42.478141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-531fe2fc-ec57-47e8-aa58-d970b14a56fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:42.677805 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fe2fc-ec57-47e8-aa58-d970b14a56fb service cinder] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:42.677805 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1204c82-df1d-41ba-bbbc-c726bc2af079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:42.677805 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1204c82-df1d-41ba-bbbc-c726bc2af079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:42.677805 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1204c82-df1d-41ba-bbbc-c726bc2af079 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:42.680982 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1204c82-df1d-41ba-bbbc-c726bc2af079 admin admin] PATH_INFO: `/v3/projects/f1fee77be16e494eaabfd9be4cc4e01e` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:42.680982 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1204c82-df1d-41ba-bbbc-c726bc2af079 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1fee77be16e494eaabfd9be4cc4e01e)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:42.680982 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1204c82-df1d-41ba-bbbc-c726bc2af079 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:42.976587 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-a2ec3923-3b46-4ba6-a245-4a8415a052c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37311561700e4aa99271d19ec36e0f33'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:42.990955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-f1204c82-df1d-41ba-bbbc-c726bc2af079 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1fee77be16e494eaabfd9be4cc4e01e', 'request_id': 'req-f1204c82-df1d-41ba-bbbc-c726bc2af079'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:42.991706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-a2ec3923-3b46-4ba6-a245-4a8415a052c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37311561700e4aa99271d19ec36e0f33'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:42.994226 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-a2ec3923-3b46-4ba6-a245-4a8415a052c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37311561700e4aa99271d19ec36e0f33'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:43.045152 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-a2ec3923-3b46-4ba6-a245-4a8415a052c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37311561700e4aa99271d19ec36e0f33'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:43.061237 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-f1204c82-df1d-41ba-bbbc-c726bc2af079 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1fee77be16e494eaabfd9be4cc4e01e', 'request_id': 'req-f1204c82-df1d-41ba-bbbc-c726bc2af079'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:43.132028 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-a2ec3923-3b46-4ba6-a245-4a8415a052c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37311561700e4aa99271d19ec36e0f33'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:43.153257 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 824/1663] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:55:42 2022] DELETE /identity/v3/users/37311561700e4aa99271d19ec36e0f33 => generated 0 bytes in 974 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:55:43.153257 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390fac7-7d27-4f41-b9c0-41305e4609ea None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:43.153257 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390fac7-7d27-4f41-b9c0-41305e4609ea None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:43.153257 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390fac7-7d27-4f41-b9c0-41305e4609ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:43.171466 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-d390fac7-7d27-4f41-b9c0-41305e4609ea None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:43.176994 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:43.184942 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-d390fac7-7d27-4f41-b9c0-41305e4609ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:43.234963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-f1204c82-df1d-41ba-bbbc-c726bc2af079 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1fee77be16e494eaabfd9be4cc4e01e', 'request_id': 'req-f1204c82-df1d-41ba-bbbc-c726bc2af079'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:43.262410 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-f1204c82-df1d-41ba-bbbc-c726bc2af079 admin admin] The token cache is being invalidate because project f1fee77be16e494eaabfd9be4cc4e01e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:55:43.263210 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-f1204c82-df1d-41ba-bbbc-c726bc2af079 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:43.264367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-f1204c82-df1d-41ba-bbbc-c726bc2af079 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:43.272032 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 840/1664] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:55:42 2022] DELETE /identity/v3/projects/f1fee77be16e494eaabfd9be4cc4e01e => generated 0 bytes in 791 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:55:43.273880 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc2d3b-6f0f-4abf-b4f1-5e5e2243a6f3 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:43.274376 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc2d3b-6f0f-4abf-b4f1-5e5e2243a6f3 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:43.274887 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc2d3b-6f0f-4abf-b4f1-5e5e2243a6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:43.331686 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 825/1665] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:43.343835 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390fac7-7d27-4f41-b9c0-41305e4609ea None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:43.347112 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-d390fac7-7d27-4f41-b9c0-41305e4609ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:43.368980 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-0adc2d3b-6f0f-4abf-b4f1-5e5e2243a6f3 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:43.372008 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-0adc2d3b-6f0f-4abf-b4f1-5e5e2243a6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:43.399132 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 841/1666] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:43.408535 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bfac2-b1f7-49cf-a660-ef8478654e99 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:43.408829 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bfac2-b1f7-49cf-a660-ef8478654e99 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:43.409115 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bfac2-b1f7-49cf-a660-ef8478654e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:43.433048 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-e54bfac2-b1f7-49cf-a660-ef8478654e99 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:43.434219 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-e54bfac2-b1f7-49cf-a660-ef8478654e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:43.465269 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 842/1667] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:43.467364 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bfac2-b1f7-49cf-a660-ef8478654e99 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:43.468538 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390fac7-7d27-4f41-b9c0-41305e4609ea None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:43.482495 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722845f1-3f8f-40fc-a86b-d699702002da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:43.484077 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722845f1-3f8f-40fc-a86b-d699702002da service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:43.484366 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722845f1-3f8f-40fc-a86b-d699702002da service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:43.484817 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722845f1-3f8f-40fc-a86b-d699702002da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:43.489215 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bfac2-b1f7-49cf-a660-ef8478654e99 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:43.508558 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237cfcf-07d3-42d2-9d6b-ee1c95e725a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:43.509260 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237cfcf-07d3-42d2-9d6b-ee1c95e725a9 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:43.509547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237cfcf-07d3-42d2-9d6b-ee1c95e725a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:43.509825 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237cfcf-07d3-42d2-9d6b-ee1c95e725a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:43.511745 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237cfcf-07d3-42d2-9d6b-ee1c95e725a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:55:43.511745 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237cfcf-07d3-42d2-9d6b-ee1c95e725a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:43.513420 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237cfcf-07d3-42d2-9d6b-ee1c95e725a9 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:43.540423 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722845f1-3f8f-40fc-a86b-d699702002da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:43.541913 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722845f1-3f8f-40fc-a86b-d699702002da service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:43.554302 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 843/1668] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 15:55:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:55:43.556740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237cfcf-07d3-42d2-9d6b-ee1c95e725a9 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:43.572266 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237cfcf-07d3-42d2-9d6b-ee1c95e725a9 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:43.578404 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930fa3e-1d17-4dce-9bd3-c242dc92bc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:43.579326 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930fa3e-1d17-4dce-9bd3-c242dc92bc64 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:43.580048 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930fa3e-1d17-4dce-9bd3-c242dc92bc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:43.580539 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930fa3e-1d17-4dce-9bd3-c242dc92bc64 admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:43.581464 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930fa3e-1d17-4dce-9bd3-c242dc92bc64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:43.581971 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 826/1669] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:55:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:55:43.598543 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930fa3e-1d17-4dce-9bd3-c242dc92bc64 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:43.738647 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722845f1-3f8f-40fc-a86b-d699702002da service neutron] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:43.739845 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 844/1670] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:55:43 2022] POST /identity/v3/projects => generated 381 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:55:43.757855 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722845f1-3f8f-40fc-a86b-d699702002da service neutron] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:43.917759 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e61628-52a1-4a59-92b6-a70b20c93009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:43.918809 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e61628-52a1-4a59-92b6-a70b20c93009 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:43.919335 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e61628-52a1-4a59-92b6-a70b20c93009 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:43.919846 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e61628-52a1-4a59-92b6-a70b20c93009 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:43.920844 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e61628-52a1-4a59-92b6-a70b20c93009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:43.923162 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e61628-52a1-4a59-92b6-a70b20c93009 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:44.066890 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 827/1671] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:55:43 2022] POST /identity/v3/users => generated 291 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:55:44.071826 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930fa3e-1d17-4dce-9bd3-c242dc92bc64 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:44.096839 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930fa3e-1d17-4dce-9bd3-c242dc92bc64 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:44.149603 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45316711-3347-4584-9dfd-3c5c886d0dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:44.154801 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45316711-3347-4584-9dfd-3c5c886d0dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:44.154801 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45316711-3347-4584-9dfd-3c5c886d0dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:44.154801 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45316711-3347-4584-9dfd-3c5c886d0dd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:44.156587 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45316711-3347-4584-9dfd-3c5c886d0dd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:44.166851 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45316711-3347-4584-9dfd-3c5c886d0dd3 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:44.202399 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 845/1672] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:55:44.212665 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e61628-52a1-4a59-92b6-a70b20c93009 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:44.252299 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e61628-52a1-4a59-92b6-a70b20c93009 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:44.265853 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd593ccf-6895-4b16-9572-7020ca1ce142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:44.268513 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd593ccf-6895-4b16-9572-7020ca1ce142 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:44.268951 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd593ccf-6895-4b16-9572-7020ca1ce142 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:44.269375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd593ccf-6895-4b16-9572-7020ca1ce142 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:44.270271 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd593ccf-6895-4b16-9572-7020ca1ce142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:44.275024 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd593ccf-6895-4b16-9572-7020ca1ce142 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:44.340032 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 828/1673] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:55:44.352427 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45316711-3347-4584-9dfd-3c5c886d0dd3 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:44.362161 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45316711-3347-4584-9dfd-3c5c886d0dd3 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:44.368566 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eec16f-556f-4f13-9f3d-c75b318fbace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:44.369395 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eec16f-556f-4f13-9f3d-c75b318fbace admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:44.369640 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eec16f-556f-4f13-9f3d-c75b318fbace admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:44.370090 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eec16f-556f-4f13-9f3d-c75b318fbace admin admin] PATH_INFO: `/v3/projects/bcb581434b4249d9bed808037d169189/users/45a46588ca4d4d18a1f397243d5c4928/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:44.379457 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:44.406907 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eec16f-556f-4f13-9f3d-c75b318fbace admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcb581434b4249d9bed808037d169189, user_id=45a46588ca4d4d18a1f397243d5c4928, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:44.414290 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eec16f-556f-4f13-9f3d-c75b318fbace admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:44.495029 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd593ccf-6895-4b16-9572-7020ca1ce142 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:44.497187 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-cd593ccf-6895-4b16-9572-7020ca1ce142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:44.522095 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd593ccf-6895-4b16-9572-7020ca1ce142 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:44.534725 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 846/1674] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:55:44 2022] PUT /identity/v3/projects/bcb581434b4249d9bed808037d169189/users/45a46588ca4d4d18a1f397243d5c4928/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:55:44.545890 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57422b-6e90-4843-a16b-b53875cdd229 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:44.546207 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57422b-6e90-4843-a16b-b53875cdd229 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:44.546469 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57422b-6e90-4843-a16b-b53875cdd229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:44.602854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-6e57422b-6e90-4843-a16b-b53875cdd229 None None] MFA Rules not processed for user `45a46588ca4d4d18a1f397243d5c4928`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:44.604110 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-6e57422b-6e90-4843-a16b-b53875cdd229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:44.665810 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9e507-967d-47d2-a5a8-6df7383976e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:44.666982 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9e507-967d-47d2-a5a8-6df7383976e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:44.667268 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9e507-967d-47d2-a5a8-6df7383976e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:44.669904 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9e507-967d-47d2-a5a8-6df7383976e1 admin admin] PATH_INFO: `/v3/projects/ba1e295ea00d46c3a07bdc551b912697` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:44.679655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d9e507-967d-47d2-a5a8-6df7383976e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba1e295ea00d46c3a07bdc551b912697)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:44.679655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: WARNING py.warnings [None req-f5d9e507-967d-47d2-a5a8-6df7383976e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 15:55:44.679655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: warnings.warn(msg) May 23 15:55:44.679655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: May 23 15:55:44.679655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d9e507-967d-47d2-a5a8-6df7383976e1 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:44.771179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 847/1675] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:44.787324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57422b-6e90-4843-a16b-b53875cdd229 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:44.806022 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57422b-6e90-4843-a16b-b53875cdd229 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:44.810975 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2775b64-2911-4b69-9440-28103bd7511d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:44.812001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2775b64-2911-4b69-9440-28103bd7511d admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:44.812289 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2775b64-2911-4b69-9440-28103bd7511d admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:44.812665 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2775b64-2911-4b69-9440-28103bd7511d admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:44.813275 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2775b64-2911-4b69-9440-28103bd7511d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:44.817159 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2775b64-2911-4b69-9440-28103bd7511d admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:44.934911 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-f5d9e507-967d-47d2-a5a8-6df7383976e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba1e295ea00d46c3a07bdc551b912697', 'request_id': 'req-f5d9e507-967d-47d2-a5a8-6df7383976e1'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:44.954449 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-f5d9e507-967d-47d2-a5a8-6df7383976e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba1e295ea00d46c3a07bdc551b912697', 'request_id': 'req-f5d9e507-967d-47d2-a5a8-6df7383976e1'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:44.992709 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 848/1676] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:55:44 2022] POST /identity/v3/projects => generated 381 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:55:44.995813 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2775b64-2911-4b69-9440-28103bd7511d admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:45.060301 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-f5d9e507-967d-47d2-a5a8-6df7383976e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba1e295ea00d46c3a07bdc551b912697', 'request_id': 'req-f5d9e507-967d-47d2-a5a8-6df7383976e1'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:45.094282 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:45.126373 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-f5d9e507-967d-47d2-a5a8-6df7383976e1 admin admin] The token cache is being invalidate because project ba1e295ea00d46c3a07bdc551b912697 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:55:45.126766 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-f5d9e507-967d-47d2-a5a8-6df7383976e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:45.131046 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-f5d9e507-967d-47d2-a5a8-6df7383976e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:45.134071 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 829/1677] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:55:44 2022] DELETE /identity/v3/projects/ba1e295ea00d46c3a07bdc551b912697 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:55:45.138952 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9e507-967d-47d2-a5a8-6df7383976e1 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:45.145280 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-f5d9e507-967d-47d2-a5a8-6df7383976e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:45.162960 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2775b64-2911-4b69-9440-28103bd7511d admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:45.168046 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879d582-0cbe-4a85-84c6-952716c3bd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:45.169197 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879d582-0cbe-4a85-84c6-952716c3bd96 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:45.169624 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879d582-0cbe-4a85-84c6-952716c3bd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:45.170057 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879d582-0cbe-4a85-84c6-952716c3bd96 admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:45.171464 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879d582-0cbe-4a85-84c6-952716c3bd96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:45.173650 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879d582-0cbe-4a85-84c6-952716c3bd96 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:45.320451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 849/1678] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:55:44 2022] POST /identity/v3/users => generated 297 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:55:45.325143 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879d582-0cbe-4a85-84c6-952716c3bd96 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:45.328630 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-e879d582-0cbe-4a85-84c6-952716c3bd96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:45.373249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879d582-0cbe-4a85-84c6-952716c3bd96 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:45.389076 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9afdb3-9620-46dd-b0bb-badcb4c49766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:45.389952 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9afdb3-9620-46dd-b0bb-badcb4c49766 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:45.390814 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9afdb3-9620-46dd-b0bb-badcb4c49766 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:45.391095 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9afdb3-9620-46dd-b0bb-badcb4c49766 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:45.392473 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9afdb3-9620-46dd-b0bb-badcb4c49766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:45.399965 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9afdb3-9620-46dd-b0bb-badcb4c49766 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:45.424028 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 850/1679] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:55:45.429208 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9e507-967d-47d2-a5a8-6df7383976e1 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:45.430966 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9afdb3-9620-46dd-b0bb-badcb4c49766 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:45.443786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9fb95-38c4-4741-8711-636fb18b6c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:45.444796 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9fb95-38c4-4741-8711-636fb18b6c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:45.445084 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9fb95-38c4-4741-8711-636fb18b6c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:45.445359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9fb95-38c4-4741-8711-636fb18b6c8c admin admin] PATH_INFO: `/v3/users/7e27bf5e59124c49ae947dd8eff096f9` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:45.447843 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9fb95-38c4-4741-8711-636fb18b6c8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e27bf5e59124c49ae947dd8eff096f9)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:45.449828 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9fb95-38c4-4741-8711-636fb18b6c8c admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:45.457314 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9afdb3-9620-46dd-b0bb-badcb4c49766 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:45.471057 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1fb00-1378-48a8-9465-ce4ba3ef8b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:45.472411 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1fb00-1378-48a8-9465-ce4ba3ef8b70 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:45.473250 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1fb00-1378-48a8-9465-ce4ba3ef8b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:45.473250 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1fb00-1378-48a8-9465-ce4ba3ef8b70 admin admin] PATH_INFO: `/v3/projects/c0bca2b8adaa4e918b6b4de0b195035c/users/0e6430cb144a46e2af1cde95f06f5d5b/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:45.515109 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c1fb00-1378-48a8-9465-ce4ba3ef8b70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0bca2b8adaa4e918b6b4de0b195035c, user_id=0e6430cb144a46e2af1cde95f06f5d5b, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:45.520465 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c1fb00-1378-48a8-9465-ce4ba3ef8b70 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:45.617967 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 851/1680] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:55:45 2022] PUT /identity/v3/projects/c0bca2b8adaa4e918b6b4de0b195035c/users/0e6430cb144a46e2af1cde95f06f5d5b/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:55:45.619527 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b95eaa-e800-4718-ba86-9c137fafe293 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:45.619904 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b95eaa-e800-4718-ba86-9c137fafe293 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:45.620194 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b95eaa-e800-4718-ba86-9c137fafe293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:45.643469 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-e5b95eaa-e800-4718-ba86-9c137fafe293 None None] MFA Rules not processed for user `048fc48dd55a43f7b342533a9484c3ad`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:45.645384 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-e5b95eaa-e800-4718-ba86-9c137fafe293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:45.708184 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-77f9fb95-38c4-4741-8711-636fb18b6c8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e27bf5e59124c49ae947dd8eff096f9'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:45.725191 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-77f9fb95-38c4-4741-8711-636fb18b6c8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e27bf5e59124c49ae947dd8eff096f9'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:45.727042 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-77f9fb95-38c4-4741-8711-636fb18b6c8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e27bf5e59124c49ae947dd8eff096f9'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:45.758561 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-77f9fb95-38c4-4741-8711-636fb18b6c8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e27bf5e59124c49ae947dd8eff096f9'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:45.789617 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 852/1681] 10.222.0.39 () {58 vars in 1009 bytes} [Mon May 23 15:55:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:45.790528 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b95eaa-e800-4718-ba86-9c137fafe293 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:45.892176 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-77f9fb95-38c4-4741-8711-636fb18b6c8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e27bf5e59124c49ae947dd8eff096f9'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:45.901726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 830/1682] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:55:45 2022] DELETE /identity/v3/users/7e27bf5e59124c49ae947dd8eff096f9 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:55:45.937005 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b95eaa-e800-4718-ba86-9c137fafe293 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:46.117435 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c0569-c382-47c6-8b29-c748a06e8596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:46.118465 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c0569-c382-47c6-8b29-c748a06e8596 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:46.118562 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c0569-c382-47c6-8b29-c748a06e8596 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:46.118823 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c0569-c382-47c6-8b29-c748a06e8596 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:46.119779 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500c0569-c382-47c6-8b29-c748a06e8596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:46.130108 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500c0569-c382-47c6-8b29-c748a06e8596 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:46.169074 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 853/1683] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:55:46.174662 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9fb95-38c4-4741-8711-636fb18b6c8c admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:46.176541 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-77f9fb95-38c4-4741-8711-636fb18b6c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:46.208476 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9fb95-38c4-4741-8711-636fb18b6c8c admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:46.223749 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82518fd-aab9-4049-9a67-9e3a699e3404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:46.224867 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82518fd-aab9-4049-9a67-9e3a699e3404 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:46.225166 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82518fd-aab9-4049-9a67-9e3a699e3404 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:46.225448 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82518fd-aab9-4049-9a67-9e3a699e3404 admin admin] PATH_INFO: `/v3/projects/c0bca2b8adaa4e918b6b4de0b195035c/users/0e6430cb144a46e2af1cde95f06f5d5b/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:46.227851 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82518fd-aab9-4049-9a67-9e3a699e3404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0bca2b8adaa4e918b6b4de0b195035c, user_id=0e6430cb144a46e2af1cde95f06f5d5b, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:46.234071 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82518fd-aab9-4049-9a67-9e3a699e3404 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:46.248595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 831/1684] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:55:46 2022] PUT /identity/v3/projects/c0bca2b8adaa4e918b6b4de0b195035c/users/0e6430cb144a46e2af1cde95f06f5d5b/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:55:46.260778 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fec9a0-4039-4ec7-bb75-8d89ed0b7442 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:46.278889 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fec9a0-4039-4ec7-bb75-8d89ed0b7442 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:46.279436 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fec9a0-4039-4ec7-bb75-8d89ed0b7442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:46.332493 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82518fd-aab9-4049-9a67-9e3a699e3404 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:46.335379 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-a82518fd-aab9-4049-9a67-9e3a699e3404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:46.359222 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-43fec9a0-4039-4ec7-bb75-8d89ed0b7442 None None] MFA Rules not processed for user `0e6430cb144a46e2af1cde95f06f5d5b`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:46.365070 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-43fec9a0-4039-4ec7-bb75-8d89ed0b7442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:46.502249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 854/1685] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:46.515385 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fec9a0-4039-4ec7-bb75-8d89ed0b7442 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:46.518858 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-43fec9a0-4039-4ec7-bb75-8d89ed0b7442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:46.529681 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82518fd-aab9-4049-9a67-9e3a699e3404 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:46.542081 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e218175-d74b-4360-993a-9cae6d7f20c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b275a110936a44ce8d54793af1a34808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:46.542841 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e218175-d74b-4360-993a-9cae6d7f20c9 service swift] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:46.543132 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e218175-d74b-4360-993a-9cae6d7f20c9 service swift] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:46.543444 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e218175-d74b-4360-993a-9cae6d7f20c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:46.550323 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-2e218175-d74b-4360-993a-9cae6d7f20c9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:46.636764 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:46.654845 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fec9a0-4039-4ec7-bb75-8d89ed0b7442 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:46.661361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac494d-62d0-4aa3-910f-5d2de8a5591c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:46.662343 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac494d-62d0-4aa3-910f-5d2de8a5591c service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:46.662793 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac494d-62d0-4aa3-910f-5d2de8a5591c service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:46.663859 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac494d-62d0-4aa3-910f-5d2de8a5591c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:46.676951 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac494d-62d0-4aa3-910f-5d2de8a5591c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:46.679429 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac494d-62d0-4aa3-910f-5d2de8a5591c service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:46.694397 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e218175-d74b-4360-993a-9cae6d7f20c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:46.695992 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e218175-d74b-4360-993a-9cae6d7f20c9 service swift] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:46.697232 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 855/1686] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:55:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:55:46.722681 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 832/1687] 10.222.0.39 () {60 vars in 1384 bytes} [Mon May 23 15:55:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 15:55:47.069683 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:47.079234 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac494d-62d0-4aa3-910f-5d2de8a5591c service cinder] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:47.089644 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac494d-62d0-4aa3-910f-5d2de8a5591c service cinder] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:47.105104 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f843162-44d0-4af1-beff-3b72ac68aae8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:47.107937 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f843162-44d0-4af1-beff-3b72ac68aae8 service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:47.108411 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f843162-44d0-4af1-beff-3b72ac68aae8 service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:47.108842 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f843162-44d0-4af1-beff-3b72ac68aae8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:47.116703 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-6f843162-44d0-4af1-beff-3b72ac68aae8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:47.372894 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f843162-44d0-4af1-beff-3b72ac68aae8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:47.380830 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f843162-44d0-4af1-beff-3b72ac68aae8 service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:47.417702 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 856/1688] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:55:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:55:47.452596 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:48.030018 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e218175-d74b-4360-993a-9cae6d7f20c9 service swift] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:48.036471 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-2e218175-d74b-4360-993a-9cae6d7f20c9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:48.193752 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:48.251473 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e218175-d74b-4360-993a-9cae6d7f20c9 service swift] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:48.272011 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6465fa-cd61-4823-99b3-f82e7ee46353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:48.273057 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6465fa-cd61-4823-99b3-f82e7ee46353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:48.273467 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6465fa-cd61-4823-99b3-f82e7ee46353 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:48.275086 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6465fa-cd61-4823-99b3-f82e7ee46353 admin admin] PATH_INFO: `/v3/projects/0daa9482d72945a48eb84a4884b900e2` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:48.280723 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6465fa-cd61-4823-99b3-f82e7ee46353 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0daa9482d72945a48eb84a4884b900e2)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:48.295830 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6465fa-cd61-4823-99b3-f82e7ee46353 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:48.466115 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343d65d-23b8-4057-8af9-d58885c972b4 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:48.467307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343d65d-23b8-4057-8af9-d58885c972b4 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:48.467827 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343d65d-23b8-4057-8af9-d58885c972b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:48.581427 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-5343d65d-23b8-4057-8af9-d58885c972b4 None None] MFA Rules not processed for user `5c6b6d56a8b94fcb9eecc4d3167cd8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:48.582890 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-5343d65d-23b8-4057-8af9-d58885c972b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:48.748988 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-5d6465fa-cd61-4823-99b3-f82e7ee46353 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0daa9482d72945a48eb84a4884b900e2', 'request_id': 'req-5d6465fa-cd61-4823-99b3-f82e7ee46353'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:48.771635 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 857/1689] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:48.772919 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-5d6465fa-cd61-4823-99b3-f82e7ee46353 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0daa9482d72945a48eb84a4884b900e2', 'request_id': 'req-5d6465fa-cd61-4823-99b3-f82e7ee46353'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:48.774692 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b719652-909c-4bac-8912-3048030c266f None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:48.774993 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b719652-909c-4bac-8912-3048030c266f None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:48.775309 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b719652-909c-4bac-8912-3048030c266f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:48.837745 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-0b719652-909c-4bac-8912-3048030c266f None None] MFA Rules not processed for user `5c6b6d56a8b94fcb9eecc4d3167cd8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:48.839076 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-0b719652-909c-4bac-8912-3048030c266f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:48.859478 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:48.863653 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-5d6465fa-cd61-4823-99b3-f82e7ee46353 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0daa9482d72945a48eb84a4884b900e2', 'request_id': 'req-5d6465fa-cd61-4823-99b3-f82e7ee46353'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:48.885864 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-5d6465fa-cd61-4823-99b3-f82e7ee46353 admin admin] The token cache is being invalidate because project 0daa9482d72945a48eb84a4884b900e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:55:48.888771 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-5d6465fa-cd61-4823-99b3-f82e7ee46353 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:48.890069 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-5d6465fa-cd61-4823-99b3-f82e7ee46353 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:48.895055 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 833/1690] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:55:48 2022] DELETE /identity/v3/projects/0daa9482d72945a48eb84a4884b900e2 => generated 0 bytes in 867 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:55:48.909977 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6465fa-cd61-4823-99b3-f82e7ee46353 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:48.916404 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-5d6465fa-cd61-4823-99b3-f82e7ee46353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:49.032995 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 858/1691] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:49.036262 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b739b1-0631-418c-8a5b-4be87802aff7 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:49.039005 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b739b1-0631-418c-8a5b-4be87802aff7 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:49.039910 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b739b1-0631-418c-8a5b-4be87802aff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:49.126178 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6465fa-cd61-4823-99b3-f82e7ee46353 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:49.141232 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3af84f-2f2e-4cbf-b7d1-4b4aff6a01e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:49.142596 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3af84f-2f2e-4cbf-b7d1-4b4aff6a01e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:49.143038 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3af84f-2f2e-4cbf-b7d1-4b4aff6a01e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:49.143468 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3af84f-2f2e-4cbf-b7d1-4b4aff6a01e1 admin admin] PATH_INFO: `/v3/users/0c039032f7d24f43afe0bae505b85789` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:49.145335 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3af84f-2f2e-4cbf-b7d1-4b4aff6a01e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c039032f7d24f43afe0bae505b85789)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:49.148820 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3af84f-2f2e-4cbf-b7d1-4b4aff6a01e1 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:49.183877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-b6b739b1-0631-418c-8a5b-4be87802aff7 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:49.185719 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-b6b739b1-0631-418c-8a5b-4be87802aff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:49.263804 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 859/1692] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:49.278345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b739b1-0631-418c-8a5b-4be87802aff7 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:49.298963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-b6b739b1-0631-418c-8a5b-4be87802aff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:49.489146 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-ca3af84f-2f2e-4cbf-b7d1-4b4aff6a01e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c039032f7d24f43afe0bae505b85789'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:49.533843 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-ca3af84f-2f2e-4cbf-b7d1-4b4aff6a01e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c039032f7d24f43afe0bae505b85789'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:49.536331 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-ca3af84f-2f2e-4cbf-b7d1-4b4aff6a01e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c039032f7d24f43afe0bae505b85789'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:49.597133 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-ca3af84f-2f2e-4cbf-b7d1-4b4aff6a01e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c039032f7d24f43afe0bae505b85789'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:49.660110 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b739b1-0631-418c-8a5b-4be87802aff7 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:49.689461 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede2a74-66eb-494c-a135-0d699532560e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:49.689461 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede2a74-66eb-494c-a135-0d699532560e service nova] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:49.689461 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede2a74-66eb-494c-a135-0d699532560e service nova] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:49.689461 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede2a74-66eb-494c-a135-0d699532560e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:49.701026 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-bede2a74-66eb-494c-a135-0d699532560e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:49.709023 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-ca3af84f-2f2e-4cbf-b7d1-4b4aff6a01e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c039032f7d24f43afe0bae505b85789'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:49.716379 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 834/1693] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:55:48 2022] DELETE /identity/v3/users/0c039032f7d24f43afe0bae505b85789 => generated 0 bytes in 821 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:55:49.723778 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb684e1-106a-48a9-b2d7-308a8f4c300a None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:49.723778 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb684e1-106a-48a9-b2d7-308a8f4c300a None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:49.723778 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb684e1-106a-48a9-b2d7-308a8f4c300a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:49.730169 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede2a74-66eb-494c-a135-0d699532560e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:49.731813 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede2a74-66eb-494c-a135-0d699532560e service nova] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:49.773311 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-ccb684e1-106a-48a9-b2d7-308a8f4c300a None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:49.774550 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-ccb684e1-106a-48a9-b2d7-308a8f4c300a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:49.775517 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 860/1694] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:55:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:55:49.781127 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfe992-cd4d-4d46-baaf-007105c1be5d None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:49.781127 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfe992-cd4d-4d46-baaf-007105c1be5d None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:49.781127 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfe992-cd4d-4d46-baaf-007105c1be5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:49.836217 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-97bfe992-cd4d-4d46-baaf-007105c1be5d None None] MFA Rules not processed for user `f831a06a9cf344a2aa068c20a987b6da`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:49.838695 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-97bfe992-cd4d-4d46-baaf-007105c1be5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:49.979543 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 835/1695] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:49.987436 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2b57e-e36e-4f0e-9c5b-efbe13519397 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:49.988358 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:49.989263 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2b57e-e36e-4f0e-9c5b-efbe13519397 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:49.991364 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2b57e-e36e-4f0e-9c5b-efbe13519397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:50.061071 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 861/1696] 10.222.0.15 () {58 vars in 1015 bytes} [Mon May 23 15:55:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:50.065547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bfe992-cd4d-4d46-baaf-007105c1be5d None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:50.086729 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bfe992-cd4d-4d46-baaf-007105c1be5d None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:50.088338 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-d8c2b57e-e36e-4f0e-9c5b-efbe13519397 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:50.091048 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-d8c2b57e-e36e-4f0e-9c5b-efbe13519397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:50.092359 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587faf98-fb5d-4932-abcb-a35a24b61a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:50.097664 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587faf98-fb5d-4932-abcb-a35a24b61a73 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:50.097952 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587faf98-fb5d-4932-abcb-a35a24b61a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:50.098381 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587faf98-fb5d-4932-abcb-a35a24b61a73 admin admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:50.099144 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587faf98-fb5d-4932-abcb-a35a24b61a73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:55:50.099462 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587faf98-fb5d-4932-abcb-a35a24b61a73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:50.101526 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587faf98-fb5d-4932-abcb-a35a24b61a73 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:50.135701 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 862/1697] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 15:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:55:50.136387 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 836/1698] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:50.148861 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587faf98-fb5d-4932-abcb-a35a24b61a73 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:50.182737 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587faf98-fb5d-4932-abcb-a35a24b61a73 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:50.223897 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89178a19-583f-4fe5-8535-398185dd98e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:50.224630 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89178a19-583f-4fe5-8535-398185dd98e7 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:50.224903 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89178a19-583f-4fe5-8535-398185dd98e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:50.225194 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89178a19-583f-4fe5-8535-398185dd98e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:50.227114 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89178a19-583f-4fe5-8535-398185dd98e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:50.229272 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89178a19-583f-4fe5-8535-398185dd98e7 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:50.312909 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2b57e-e36e-4f0e-9c5b-efbe13519397 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:50.315564 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-d8c2b57e-e36e-4f0e-9c5b-efbe13519397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:50.362091 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2b57e-e36e-4f0e-9c5b-efbe13519397 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:50.377409 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 863/1699] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:55:50 2022] POST /identity/v3/projects => generated 389 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:55:50.381676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89178a19-583f-4fe5-8535-398185dd98e7 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:50.416868 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:50.637961 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8f8a6-2a28-4410-ab1f-5272018f325b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:50.638637 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8f8a6-2a28-4410-ab1f-5272018f325b service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:50.638923 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8f8a6-2a28-4410-ab1f-5272018f325b service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:50.639204 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8f8a6-2a28-4410-ab1f-5272018f325b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:50.669162 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8f8a6-2a28-4410-ab1f-5272018f325b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:50.671006 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8f8a6-2a28-4410-ab1f-5272018f325b service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:50.693583 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 837/1700] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:55:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:55:50.694705 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89178a19-583f-4fe5-8535-398185dd98e7 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:50.700595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8f8a6-2a28-4410-ab1f-5272018f325b service neutron] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:50.708302 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bff11-6326-4d14-8fcf-0c83ca7ccc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:50.711951 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bff11-6326-4d14-8fcf-0c83ca7ccc28 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:50.712098 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-a1f8f8a6-2a28-4410-ab1f-5272018f325b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:50.712256 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bff11-6326-4d14-8fcf-0c83ca7ccc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:50.712637 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bff11-6326-4d14-8fcf-0c83ca7ccc28 admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:50.713622 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bff11-6326-4d14-8fcf-0c83ca7ccc28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:50.720210 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bff11-6326-4d14-8fcf-0c83ca7ccc28 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:50.760377 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8f8a6-2a28-4410-ab1f-5272018f325b service neutron] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:50.778326 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7e77e-624f-4652-9c08-b176e0b7f196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:50.779359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7e77e-624f-4652-9c08-b176e0b7f196 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:50.781789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7e77e-624f-4652-9c08-b176e0b7f196 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:50.783199 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7e77e-624f-4652-9c08-b176e0b7f196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:50.829416 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7e77e-624f-4652-9c08-b176e0b7f196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:50.843677 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7e77e-624f-4652-9c08-b176e0b7f196 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:50.852318 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 864/1701] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:55:50 2022] POST /identity/v3/users => generated 295 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:55:50.858039 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bff11-6326-4d14-8fcf-0c83ca7ccc28 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:50.875515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 838/1702] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:55:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:55:50.905529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bff11-6326-4d14-8fcf-0c83ca7ccc28 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:50.944846 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be40f4f-7f7f-4c33-8931-893d85faba4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:50.945696 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be40f4f-7f7f-4c33-8931-893d85faba4b admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:50.945992 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be40f4f-7f7f-4c33-8931-893d85faba4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:50.946271 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be40f4f-7f7f-4c33-8931-893d85faba4b admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:50.947433 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be40f4f-7f7f-4c33-8931-893d85faba4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:50.952613 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be40f4f-7f7f-4c33-8931-893d85faba4b admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:51.001949 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 865/1703] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:55:51.005820 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7e77e-624f-4652-9c08-b176e0b7f196 service neutron] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:51.024077 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7e77e-624f-4652-9c08-b176e0b7f196 service neutron] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:51.034109 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac0994-8a9d-4c44-85b8-65d5e3c93a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:51.034793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac0994-8a9d-4c44-85b8-65d5e3c93a2f admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:51.035410 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac0994-8a9d-4c44-85b8-65d5e3c93a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:51.036246 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac0994-8a9d-4c44-85b8-65d5e3c93a2f admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:51.045616 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac0994-8a9d-4c44-85b8-65d5e3c93a2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:51.047459 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac0994-8a9d-4c44-85b8-65d5e3c93a2f admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:51.073852 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 839/1704] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:55:51.080172 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be40f4f-7f7f-4c33-8931-893d85faba4b admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:51.097221 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be40f4f-7f7f-4c33-8931-893d85faba4b admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:51.105882 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd991d7-6ac3-421a-b73c-7fca8dc482c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:51.108548 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd991d7-6ac3-421a-b73c-7fca8dc482c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:51.109602 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd991d7-6ac3-421a-b73c-7fca8dc482c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:51.111792 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd991d7-6ac3-421a-b73c-7fca8dc482c5 admin admin] PATH_INFO: `/v3/projects/c5c0fa5324a24b57b1f405a9a8850126/users/070a5f8c52dd4aa6af4a0d240bca6e1b/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:51.138141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd991d7-6ac3-421a-b73c-7fca8dc482c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5c0fa5324a24b57b1f405a9a8850126, user_id=070a5f8c52dd4aa6af4a0d240bca6e1b, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:51.145861 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd991d7-6ac3-421a-b73c-7fca8dc482c5 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:51.272073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 866/1705] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:55:51 2022] PUT /identity/v3/projects/c5c0fa5324a24b57b1f405a9a8850126/users/070a5f8c52dd4aa6af4a0d240bca6e1b/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:55:51.292147 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb3c1d-c0c0-4877-93e5-3d8c935e9bc3 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:51.293793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb3c1d-c0c0-4877-93e5-3d8c935e9bc3 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:51.295319 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb3c1d-c0c0-4877-93e5-3d8c935e9bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:51.370365 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-51cb3c1d-c0c0-4877-93e5-3d8c935e9bc3 None None] MFA Rules not processed for user `070a5f8c52dd4aa6af4a0d240bca6e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:51.372056 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-51cb3c1d-c0c0-4877-93e5-3d8c935e9bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:51.542085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:51.550162 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd991d7-6ac3-421a-b73c-7fca8dc482c5 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:51.556253 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 840/1706] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:55:51.739755 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd991d7-6ac3-421a-b73c-7fca8dc482c5 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:51.748351 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3a5d5-3790-4cec-bf86-c17bd7a43290 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:51.748722 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3a5d5-3790-4cec-bf86-c17bd7a43290 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:51.749073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3a5d5-3790-4cec-bf86-c17bd7a43290 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:51.752374 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 841/1707] 10.222.0.39 () {54 vars in 912 bytes} [Mon May 23 15:55:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:55:51.763262 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7d5b8-89f9-4be1-8288-9a94a8ed67d0 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:51.763546 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7d5b8-89f9-4be1-8288-9a94a8ed67d0 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:51.764026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7d5b8-89f9-4be1-8288-9a94a8ed67d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:51.766487 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c68aea-2878-4636-afdb-e8448289e9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:51.768180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c68aea-2878-4636-afdb-e8448289e9f5 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:51.768991 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c68aea-2878-4636-afdb-e8448289e9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:51.770046 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c68aea-2878-4636-afdb-e8448289e9f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:51.771812 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c68aea-2878-4636-afdb-e8448289e9f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:51.779137 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c68aea-2878-4636-afdb-e8448289e9f5 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:51.844668 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-3ba7d5b8-89f9-4be1-8288-9a94a8ed67d0 None None] MFA Rules not processed for user `f831a06a9cf344a2aa068c20a987b6da`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:51.847477 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-3ba7d5b8-89f9-4be1-8288-9a94a8ed67d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:52.005352 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 867/1708] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:55:51 2022] POST /identity/v3/projects => generated 389 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:55:52.009553 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c68aea-2878-4636-afdb-e8448289e9f5 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:52.025393 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 842/1709] 10.222.0.39 () {58 vars in 1009 bytes} [Mon May 23 15:55:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:52.210817 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7d5b8-89f9-4be1-8288-9a94a8ed67d0 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:52.224358 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7d5b8-89f9-4be1-8288-9a94a8ed67d0 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:52.269934 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:52.355061 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c68aea-2878-4636-afdb-e8448289e9f5 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:52.389847 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736ac6a-eb4a-43dc-bb76-7104948b36b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:52.393278 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736ac6a-eb4a-43dc-bb76-7104948b36b8 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:52.394708 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736ac6a-eb4a-43dc-bb76-7104948b36b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:52.397117 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736ac6a-eb4a-43dc-bb76-7104948b36b8 admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:52.399223 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736ac6a-eb4a-43dc-bb76-7104948b36b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:52.414132 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736ac6a-eb4a-43dc-bb76-7104948b36b8 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:52.443985 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e836f-b347-4d43-b9d0-7badbdae910d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:52.446075 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e836f-b347-4d43-b9d0-7badbdae910d service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:52.446529 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e836f-b347-4d43-b9d0-7badbdae910d service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:52.446981 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e836f-b347-4d43-b9d0-7badbdae910d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:52.462250 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e836f-b347-4d43-b9d0-7badbdae910d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:52.462250 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e836f-b347-4d43-b9d0-7badbdae910d service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:52.471819 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 843/1710] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:55:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:55:52.618300 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 868/1711] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:55:52 2022] POST /identity/v3/users => generated 301 bytes in 612 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:55:52.622470 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e836f-b347-4d43-b9d0-7badbdae910d service neutron] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:52.661294 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e836f-b347-4d43-b9d0-7badbdae910d service neutron] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:52.716261 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08a8ed-f24d-4e1b-aa8f-32d8581780fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:52.717040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08a8ed-f24d-4e1b-aa8f-32d8581780fd admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:52.725922 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08a8ed-f24d-4e1b-aa8f-32d8581780fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:52.725922 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08a8ed-f24d-4e1b-aa8f-32d8581780fd admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:52.725922 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08a8ed-f24d-4e1b-aa8f-32d8581780fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:52.725922 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08a8ed-f24d-4e1b-aa8f-32d8581780fd admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:52.784971 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736ac6a-eb4a-43dc-bb76-7104948b36b8 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:52.801799 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 844/1712] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:55:52.810031 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736ac6a-eb4a-43dc-bb76-7104948b36b8 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:52.826174 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c45fc-10e6-4ef4-803c-99ff5f14824d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:52.831818 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c45fc-10e6-4ef4-803c-99ff5f14824d admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:52.831818 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c45fc-10e6-4ef4-803c-99ff5f14824d admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:52.831818 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c45fc-10e6-4ef4-803c-99ff5f14824d admin admin] PATH_INFO: `/v3/projects/d805845f2b7f467e8e7fc7e3c45a6dbe/users/331252b264d240299ded134a677af8f7/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:52.932066 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c45fc-10e6-4ef4-803c-99ff5f14824d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d805845f2b7f467e8e7fc7e3c45a6dbe, user_id=331252b264d240299ded134a677af8f7, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:52.950253 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c45fc-10e6-4ef4-803c-99ff5f14824d admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:53.052144 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 869/1713] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:55:52 2022] PUT /identity/v3/projects/d805845f2b7f467e8e7fc7e3c45a6dbe/users/331252b264d240299ded134a677af8f7/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:55:53.056322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08a8ed-f24d-4e1b-aa8f-32d8581780fd admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:53.075903 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08a8ed-f24d-4e1b-aa8f-32d8581780fd admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:53.262166 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff176e7-1a9e-44ac-bede-806cb9200815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:53.265587 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff176e7-1a9e-44ac-bede-806cb9200815 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:53.266952 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff176e7-1a9e-44ac-bede-806cb9200815 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:53.271066 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff176e7-1a9e-44ac-bede-806cb9200815 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:53.289057 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff176e7-1a9e-44ac-bede-806cb9200815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:53.295462 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff176e7-1a9e-44ac-bede-806cb9200815 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:53.367995 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 845/1714] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:55:53.377732 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c45fc-10e6-4ef4-803c-99ff5f14824d admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:53.395205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c45fc-10e6-4ef4-803c-99ff5f14824d admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:53.427425 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3873844-bd17-43e0-ab54-a0a4eab5dcc9 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:53.428693 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3873844-bd17-43e0-ab54-a0a4eab5dcc9 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:53.429048 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3873844-bd17-43e0-ab54-a0a4eab5dcc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:53.431813 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea42592-5911-4044-a57d-275bb2b60f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:53.432836 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea42592-5911-4044-a57d-275bb2b60f58 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:53.436725 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea42592-5911-4044-a57d-275bb2b60f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:53.437212 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea42592-5911-4044-a57d-275bb2b60f58 admin admin] PATH_INFO: `/v3/projects/d805845f2b7f467e8e7fc7e3c45a6dbe/users/331252b264d240299ded134a677af8f7/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:53.447818 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea42592-5911-4044-a57d-275bb2b60f58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d805845f2b7f467e8e7fc7e3c45a6dbe, user_id=331252b264d240299ded134a677af8f7, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:53.467869 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea42592-5911-4044-a57d-275bb2b60f58 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:53.523788 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 870/1715] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:55:53 2022] PUT /identity/v3/projects/d805845f2b7f467e8e7fc7e3c45a6dbe/users/331252b264d240299ded134a677af8f7/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:55:53.538211 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e059b27-c58b-4dac-b07d-19cc8d3ce2e3 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:53.538579 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e059b27-c58b-4dac-b07d-19cc8d3ce2e3 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:53.538919 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e059b27-c58b-4dac-b07d-19cc8d3ce2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:53.557697 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-d3873844-bd17-43e0-ab54-a0a4eab5dcc9 None None] MFA Rules not processed for user `261e4ebfb0504a21b6c54e05c0b8378f`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:53.562824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-d3873844-bd17-43e0-ab54-a0a4eab5dcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:53.622721 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:53.668745 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-2e059b27-c58b-4dac-b07d-19cc8d3ce2e3 None None] MFA Rules not processed for user `331252b264d240299ded134a677af8f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:53.677557 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-2e059b27-c58b-4dac-b07d-19cc8d3ce2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:53.817739 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 846/1716] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:55:53.937378 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 871/1717] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:53 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:53.950370 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3873844-bd17-43e0-ab54-a0a4eab5dcc9 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:53.955230 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-d3873844-bd17-43e0-ab54-a0a4eab5dcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:54.150431 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3873844-bd17-43e0-ab54-a0a4eab5dcc9 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:54.157497 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e704b-af1e-4ace-9465-aa9814def01c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:54.158524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e704b-af1e-4ace-9465-aa9814def01c service cinder] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:54.159116 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e704b-af1e-4ace-9465-aa9814def01c service cinder] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:54.159823 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e704b-af1e-4ace-9465-aa9814def01c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:54.209104 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e704b-af1e-4ace-9465-aa9814def01c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:54.227176 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e704b-af1e-4ace-9465-aa9814def01c service cinder] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:54.240475 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e059b27-c58b-4dac-b07d-19cc8d3ce2e3 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:54.242499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-2e059b27-c58b-4dac-b07d-19cc8d3ce2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:54.250065 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 847/1718] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:55:53 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:55:54.405404 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e704b-af1e-4ace-9465-aa9814def01c service cinder] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:54.409138 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-f87e704b-af1e-4ace-9465-aa9814def01c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:54.505925 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e059b27-c58b-4dac-b07d-19cc8d3ce2e3 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:54.541091 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1323a00-20af-4640-bf59-b27c2483059c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:54.541091 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1323a00-20af-4640-bf59-b27c2483059c service nova] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:54.541091 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1323a00-20af-4640-bf59-b27c2483059c service nova] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:54.541091 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1323a00-20af-4640-bf59-b27c2483059c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:54.570002 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1323a00-20af-4640-bf59-b27c2483059c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:54.570002 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1323a00-20af-4640-bf59-b27c2483059c service nova] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:54.630806 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 872/1719] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:55:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:55:54.631850 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1323a00-20af-4640-bf59-b27c2483059c service nova] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:54.675005 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:54.690128 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e704b-af1e-4ace-9465-aa9814def01c service cinder] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:54.706269 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a93ceb-2150-49f8-975f-78381ec221cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:54.709558 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a93ceb-2150-49f8-975f-78381ec221cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:54.710611 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a93ceb-2150-49f8-975f-78381ec221cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:54.710858 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a93ceb-2150-49f8-975f-78381ec221cf admin admin] PATH_INFO: `/v3/projects/c9a981aa2330454c92f23e6148939f34` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:54.715169 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a93ceb-2150-49f8-975f-78381ec221cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9a981aa2330454c92f23e6148939f34)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:54.723708 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a93ceb-2150-49f8-975f-78381ec221cf admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:54.922606 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1323a00-20af-4640-bf59-b27c2483059c service nova] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:54.936906 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fb25a-8401-483b-8640-04ff93c488e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:54.936906 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fb25a-8401-483b-8640-04ff93c488e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:54.936906 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fb25a-8401-483b-8640-04ff93c488e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:54.936906 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fb25a-8401-483b-8640-04ff93c488e3 admin admin] PATH_INFO: `/v3/users/070a5f8c52dd4aa6af4a0d240bca6e1b` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:54.937351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7fb25a-8401-483b-8640-04ff93c488e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=070a5f8c52dd4aa6af4a0d240bca6e1b)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:54.937351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7fb25a-8401-483b-8640-04ff93c488e3 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:55.037700 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-64a93ceb-2150-49f8-975f-78381ec221cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9a981aa2330454c92f23e6148939f34', 'request_id': 'req-64a93ceb-2150-49f8-975f-78381ec221cf'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:55.100434 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-64a93ceb-2150-49f8-975f-78381ec221cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9a981aa2330454c92f23e6148939f34', 'request_id': 'req-64a93ceb-2150-49f8-975f-78381ec221cf'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:55.106542 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:55.179520 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-64a93ceb-2150-49f8-975f-78381ec221cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9a981aa2330454c92f23e6148939f34', 'request_id': 'req-64a93ceb-2150-49f8-975f-78381ec221cf'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:55.219976 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-64a93ceb-2150-49f8-975f-78381ec221cf admin admin] The token cache is being invalidate because project c9a981aa2330454c92f23e6148939f34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:55:55.220523 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-64a93ceb-2150-49f8-975f-78381ec221cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:55.221014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-64a93ceb-2150-49f8-975f-78381ec221cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:55.244950 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 848/1720] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:55:54 2022] DELETE /identity/v3/projects/c9a981aa2330454c92f23e6148939f34 => generated 0 bytes in 834 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:55:55.246547 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983898e-ccb5-4748-85ea-8595e1991fb2 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:55.246839 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983898e-ccb5-4748-85ea-8595e1991fb2 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:55.247123 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983898e-ccb5-4748-85ea-8595e1991fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:55.322736 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-3a7fb25a-8401-483b-8640-04ff93c488e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '070a5f8c52dd4aa6af4a0d240bca6e1b'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:55.323835 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-3a7fb25a-8401-483b-8640-04ff93c488e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '070a5f8c52dd4aa6af4a0d240bca6e1b'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:55.330391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-3a7fb25a-8401-483b-8640-04ff93c488e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '070a5f8c52dd4aa6af4a0d240bca6e1b'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:55.421142 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-8983898e-ccb5-4748-85ea-8595e1991fb2 None None] MFA Rules not processed for user `ce2a9dc6fbae42dfbfa4cb8b326c3de5`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:55.423064 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-8983898e-ccb5-4748-85ea-8595e1991fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:55.442560 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-3a7fb25a-8401-483b-8640-04ff93c488e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '070a5f8c52dd4aa6af4a0d240bca6e1b'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:55.466382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-3a7fb25a-8401-483b-8640-04ff93c488e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '070a5f8c52dd4aa6af4a0d240bca6e1b'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:55.565658 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 873/1721] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:55:54 2022] DELETE /identity/v3/users/070a5f8c52dd4aa6af4a0d240bca6e1b => generated 0 bytes in 930 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:55:55.568886 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfc733-05a9-454a-8896-97cfe982aaba None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:55.569182 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfc733-05a9-454a-8896-97cfe982aaba None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:55.571759 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfc733-05a9-454a-8896-97cfe982aaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:55.639237 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-bebfc733-05a9-454a-8896-97cfe982aaba None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:55.646330 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-bebfc733-05a9-454a-8896-97cfe982aaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:55.728070 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 849/1722] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:55.730051 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb28d89-494d-49b5-b2ee-8ab38acd18e1 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:55.730514 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb28d89-494d-49b5-b2ee-8ab38acd18e1 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:55.731306 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb28d89-494d-49b5-b2ee-8ab38acd18e1 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:55.733191 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 850/1723] 10.222.0.39 () {54 vars in 921 bytes} [Mon May 23 15:55:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:55:55.734422 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ec8b9-ac66-4efa-9b8b-6ca779351f59 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:55.735384 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ec8b9-ac66-4efa-9b8b-6ca779351f59 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:55.735908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ec8b9-ac66-4efa-9b8b-6ca779351f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:55.791319 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-449ec8b9-ac66-4efa-9b8b-6ca779351f59 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:55.792592 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-449ec8b9-ac66-4efa-9b8b-6ca779351f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:55.898751 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 874/1724] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:55.909918 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfc733-05a9-454a-8896-97cfe982aaba None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:55.915495 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-bebfc733-05a9-454a-8896-97cfe982aaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:56.015917 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:56.020629 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 851/1725] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:56.028763 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540b639-bf8c-4b30-bd77-adc1660f8c4a None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:56.029004 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540b639-bf8c-4b30-bd77-adc1660f8c4a None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:56.029255 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540b639-bf8c-4b30-bd77-adc1660f8c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:56.112096 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-6540b639-bf8c-4b30-bd77-adc1660f8c4a None None] MFA Rules not processed for user `5c6b6d56a8b94fcb9eecc4d3167cd8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:56.113353 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-6540b639-bf8c-4b30-bd77-adc1660f8c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:56.116072 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfc733-05a9-454a-8896-97cfe982aaba None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:56.136742 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b800ba64-1327-456b-a6d7-e83fd9f1eaf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:56.144449 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800ba64-1327-456b-a6d7-e83fd9f1eaf0 service nova] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:56.154973 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800ba64-1327-456b-a6d7-e83fd9f1eaf0 service nova] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:56.154973 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800ba64-1327-456b-a6d7-e83fd9f1eaf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:56.363671 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 852/1726] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:56.372529 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d62f9c-ca19-4879-9d0b-72975e0b48e6 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:56.372906 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d62f9c-ca19-4879-9d0b-72975e0b48e6 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:56.373184 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d62f9c-ca19-4879-9d0b-72975e0b48e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:56.417271 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b800ba64-1327-456b-a6d7-e83fd9f1eaf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:56.421128 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b800ba64-1327-456b-a6d7-e83fd9f1eaf0 service nova] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:56.460351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 875/1727] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:55:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:55:56.464879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a421dc-b702-4663-a9ac-40c4b75c39d2 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:56.465430 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a421dc-b702-4663-a9ac-40c4b75c39d2 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:56.467720 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a421dc-b702-4663-a9ac-40c4b75c39d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:56.483016 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-09d62f9c-ca19-4879-9d0b-72975e0b48e6 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:56.498890 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-09d62f9c-ca19-4879-9d0b-72975e0b48e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:56.513838 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-23a421dc-b702-4663-a9ac-40c4b75c39d2 None None] MFA Rules not processed for user `76f7895b7b5748e7b4461f7fde1d558a`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:56.513838 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-23a421dc-b702-4663-a9ac-40c4b75c39d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:56.534559 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 876/1728] 10.222.0.39 () {58 vars in 1018 bytes} [Mon May 23 15:55:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:56.536501 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a421dc-b702-4663-a9ac-40c4b75c39d2 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:56.538205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-23a421dc-b702-4663-a9ac-40c4b75c39d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:56.553731 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 853/1729] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:56.554816 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d62f9c-ca19-4879-9d0b-72975e0b48e6 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:56.610860 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d62f9c-ca19-4879-9d0b-72975e0b48e6 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:56.638253 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf9908-cf59-4c69-b7d7-9209d4c3a7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:56.641116 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf9908-cf59-4c69-b7d7-9209d4c3a7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:56.642483 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf9908-cf59-4c69-b7d7-9209d4c3a7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:56.642775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf9908-cf59-4c69-b7d7-9209d4c3a7a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:56.645426 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf9908-cf59-4c69-b7d7-9209d4c3a7a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:55:56.645795 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf9908-cf59-4c69-b7d7-9209d4c3a7a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:56.657912 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf9908-cf59-4c69-b7d7-9209d4c3a7a1 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:56.730226 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 854/1730] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 15:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:55:56.734426 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf9908-cf59-4c69-b7d7-9209d4c3a7a1 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:56.755989 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:56.777909 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf9908-cf59-4c69-b7d7-9209d4c3a7a1 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:56.799013 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a421dc-b702-4663-a9ac-40c4b75c39d2 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:56.800602 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159a6e0-4844-4db0-8439-cd50dbf40aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:56.810167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159a6e0-4844-4db0-8439-cd50dbf40aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:56.810553 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159a6e0-4844-4db0-8439-cd50dbf40aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:56.811796 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159a6e0-4844-4db0-8439-cd50dbf40aa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:56.812564 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c159a6e0-4844-4db0-8439-cd50dbf40aa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:56.822844 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c159a6e0-4844-4db0-8439-cd50dbf40aa9 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:56.825669 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23161b7f-8ea5-4ba7-8318-70c1e041d580 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:56.826519 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23161b7f-8ea5-4ba7-8318-70c1e041d580 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:56.826609 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23161b7f-8ea5-4ba7-8318-70c1e041d580 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:56.846598 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23161b7f-8ea5-4ba7-8318-70c1e041d580 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:56.867190 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23161b7f-8ea5-4ba7-8318-70c1e041d580 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:56.874038 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23161b7f-8ea5-4ba7-8318-70c1e041d580 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:56.931746 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 877/1731] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:55:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:55:56.932711 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23161b7f-8ea5-4ba7-8318-70c1e041d580 service neutron] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:56.969658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 855/1732] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:55:56 2022] POST /identity/v3/projects => generated 405 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:55:56.970509 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159a6e0-4844-4db0-8439-cd50dbf40aa9 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:56.988450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23161b7f-8ea5-4ba7-8318-70c1e041d580 service neutron] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:57.224480 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159a6e0-4844-4db0-8439-cd50dbf40aa9 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:57.246389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555f504-4ddf-464a-8e1d-6ab8106de63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:57.263097 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555f504-4ddf-464a-8e1d-6ab8106de63f admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:57.266760 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555f504-4ddf-464a-8e1d-6ab8106de63f admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:57.266760 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555f504-4ddf-464a-8e1d-6ab8106de63f admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:57.267774 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555f504-4ddf-464a-8e1d-6ab8106de63f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:57.271231 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555f504-4ddf-464a-8e1d-6ab8106de63f admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:57.279907 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:57.307794 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8d803-c968-4fb2-b1f6-33417b55a0a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:57.308696 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8d803-c968-4fb2-b1f6-33417b55a0a9 service nova] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:57.308814 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8d803-c968-4fb2-b1f6-33417b55a0a9 service nova] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:57.311898 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8d803-c968-4fb2-b1f6-33417b55a0a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:57.327093 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8d803-c968-4fb2-b1f6-33417b55a0a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:57.330035 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8d803-c968-4fb2-b1f6-33417b55a0a9 service nova] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:57.358094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 878/1733] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:55:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:55:57.360461 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c240a-5bbc-4ff3-90df-965cbdfea92e None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:57.360763 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c240a-5bbc-4ff3-90df-965cbdfea92e None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:57.361044 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c240a-5bbc-4ff3-90df-965cbdfea92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:57.398393 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 856/1734] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:55:56 2022] POST /identity/v3/users => generated 303 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:55:57.404388 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555f504-4ddf-464a-8e1d-6ab8106de63f admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:57.424737 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555f504-4ddf-464a-8e1d-6ab8106de63f admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:57.434587 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6aeec-5805-4199-b267-5848b2bc4c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:57.436761 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6aeec-5805-4199-b267-5848b2bc4c02 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:57.439982 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6aeec-5805-4199-b267-5848b2bc4c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:57.440451 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6aeec-5805-4199-b267-5848b2bc4c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:57.442643 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c6aeec-5805-4199-b267-5848b2bc4c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:57.448679 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c6aeec-5805-4199-b267-5848b2bc4c02 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:57.485544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-276c240a-5bbc-4ff3-90df-965cbdfea92e None None] MFA Rules not processed for user `5a57fd95e0714be6b124d5abc2422dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:57.490388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-276c240a-5bbc-4ff3-90df-965cbdfea92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:57.501688 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 857/1735] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:55:57.506411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6aeec-5805-4199-b267-5848b2bc4c02 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:57.541067 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6aeec-5805-4199-b267-5848b2bc4c02 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:57.554803 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d548bb-76a3-4414-be0f-afc2e6c0daae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:57.555509 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d548bb-76a3-4414-be0f-afc2e6c0daae admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:57.555874 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d548bb-76a3-4414-be0f-afc2e6c0daae admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:57.556297 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d548bb-76a3-4414-be0f-afc2e6c0daae admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:57.559644 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d548bb-76a3-4414-be0f-afc2e6c0daae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:57.561839 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d548bb-76a3-4414-be0f-afc2e6c0daae admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:57.589217 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 858/1736] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:55:57.593007 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d548bb-76a3-4414-be0f-afc2e6c0daae admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:57.631513 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d548bb-76a3-4414-be0f-afc2e6c0daae admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:57.647837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672b70c-cf0c-4dc9-a479-65c9adbb899b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:57.649761 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672b70c-cf0c-4dc9-a479-65c9adbb899b admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:57.650041 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672b70c-cf0c-4dc9-a479-65c9adbb899b admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:57.652260 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672b70c-cf0c-4dc9-a479-65c9adbb899b admin admin] PATH_INFO: `/v3/projects/a95fe645fb3d478bb64700f99a1d81f9/users/f88ee971ce9447ce93f00ad0f2a4d47d/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:57.695794 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672b70c-cf0c-4dc9-a479-65c9adbb899b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a95fe645fb3d478bb64700f99a1d81f9, user_id=f88ee971ce9447ce93f00ad0f2a4d47d, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:57.703227 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672b70c-cf0c-4dc9-a479-65c9adbb899b admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:57.748445 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 879/1737] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:57.821802 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 859/1738] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:55:57 2022] PUT /identity/v3/projects/a95fe645fb3d478bb64700f99a1d81f9/users/f88ee971ce9447ce93f00ad0f2a4d47d/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:55:57.833822 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfbbc9-e920-4634-a19c-9bf77d583ca5 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:57.834388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfbbc9-e920-4634-a19c-9bf77d583ca5 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:57.834907 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfbbc9-e920-4634-a19c-9bf77d583ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:57.932137 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-90cfbbc9-e920-4634-a19c-9bf77d583ca5 None None] MFA Rules not processed for user `f88ee971ce9447ce93f00ad0f2a4d47d`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:55:57.933486 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-90cfbbc9-e920-4634-a19c-9bf77d583ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:58.158532 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 880/1739] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:55:57 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:55:58.160118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672b70c-cf0c-4dc9-a479-65c9adbb899b admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:58.466959 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672b70c-cf0c-4dc9-a479-65c9adbb899b admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:58.480417 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604aea6-5d11-4079-a3b8-e147e06d35cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:58.482704 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604aea6-5d11-4079-a3b8-e147e06d35cd admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:58.483244 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604aea6-5d11-4079-a3b8-e147e06d35cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:58.483757 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604aea6-5d11-4079-a3b8-e147e06d35cd admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:58.510279 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604aea6-5d11-4079-a3b8-e147e06d35cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:58.517323 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604aea6-5d11-4079-a3b8-e147e06d35cd admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:58.560792 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cfbbc9-e920-4634-a19c-9bf77d583ca5 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:58.644858 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 860/1740] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:55:58 2022] POST /identity/v3/projects => generated 405 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:55:58.649649 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604aea6-5d11-4079-a3b8-e147e06d35cd admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:58.708691 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:58.935501 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cfbbc9-e920-4634-a19c-9bf77d583ca5 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:58.939934 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:55:58.956491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604aea6-5d11-4079-a3b8-e147e06d35cd admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:58.989056 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329dd67-8059-4c8f-bc9b-928d925e324a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:58.989056 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329dd67-8059-4c8f-bc9b-928d925e324a admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:58.989056 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329dd67-8059-4c8f-bc9b-928d925e324a admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:58.989056 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329dd67-8059-4c8f-bc9b-928d925e324a admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:58.989378 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329dd67-8059-4c8f-bc9b-928d925e324a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:59.003312 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329dd67-8059-4c8f-bc9b-928d925e324a admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:59.131492 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 861/1741] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:55:58 2022] POST /identity/v3/users => generated 309 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:55:59.132529 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329dd67-8059-4c8f-bc9b-928d925e324a admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:59.136090 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-1329dd67-8059-4c8f-bc9b-928d925e324a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:59.174811 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329dd67-8059-4c8f-bc9b-928d925e324a admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:59.180865 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1375fc-32b9-4586-95af-94b4db7e0dec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:59.191928 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1375fc-32b9-4586-95af-94b4db7e0dec service nova] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:59.192226 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1375fc-32b9-4586-95af-94b4db7e0dec service nova] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:59.192658 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1375fc-32b9-4586-95af-94b4db7e0dec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:59.196405 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb5339-bf38-4fb9-91ad-fb3f28227cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:59.197802 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb5339-bf38-4fb9-91ad-fb3f28227cf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:59.198158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb5339-bf38-4fb9-91ad-fb3f28227cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:59.198443 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb5339-bf38-4fb9-91ad-fb3f28227cf8 admin admin] PATH_INFO: `/v3/projects/c5c0fa5324a24b57b1f405a9a8850126` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:59.201596 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb5339-bf38-4fb9-91ad-fb3f28227cf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5c0fa5324a24b57b1f405a9a8850126)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:59.205796 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb5339-bf38-4fb9-91ad-fb3f28227cf8 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:59.401293 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-fbfb5339-bf38-4fb9-91ad-fb3f28227cf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5c0fa5324a24b57b1f405a9a8850126', 'request_id': 'req-fbfb5339-bf38-4fb9-91ad-fb3f28227cf8'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:59.401503 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1375fc-32b9-4586-95af-94b4db7e0dec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:59.403202 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1375fc-32b9-4586-95af-94b4db7e0dec service nova] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:59.428012 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-fbfb5339-bf38-4fb9-91ad-fb3f28227cf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5c0fa5324a24b57b1f405a9a8850126', 'request_id': 'req-fbfb5339-bf38-4fb9-91ad-fb3f28227cf8'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:59.434518 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 881/1742] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:55:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 880 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:55:59.446693 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1375fc-32b9-4586-95af-94b4db7e0dec service nova] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:59.481128 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1375fc-32b9-4586-95af-94b4db7e0dec service nova] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:59.529492 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-fbfb5339-bf38-4fb9-91ad-fb3f28227cf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5c0fa5324a24b57b1f405a9a8850126', 'request_id': 'req-fbfb5339-bf38-4fb9-91ad-fb3f28227cf8'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:59.580032 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-fbfb5339-bf38-4fb9-91ad-fb3f28227cf8 admin admin] The token cache is being invalidate because project c5c0fa5324a24b57b1f405a9a8850126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:55:59.580324 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-fbfb5339-bf38-4fb9-91ad-fb3f28227cf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:59.582877 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-fbfb5339-bf38-4fb9-91ad-fb3f28227cf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:55:59.587110 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 862/1743] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:55:59 2022] DELETE /identity/v3/projects/c5c0fa5324a24b57b1f405a9a8850126 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:55:59.591088 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb5339-bf38-4fb9-91ad-fb3f28227cf8 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:59.593502 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-fbfb5339-bf38-4fb9-91ad-fb3f28227cf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:59.712464 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd6daa-0d88-49ab-a156-740817016aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:59.715018 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd6daa-0d88-49ab-a156-740817016aac admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:59.715333 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd6daa-0d88-49ab-a156-740817016aac admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:59.715642 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd6daa-0d88-49ab-a156-740817016aac admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:59.716403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd6daa-0d88-49ab-a156-740817016aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:59.723963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd6daa-0d88-49ab-a156-740817016aac admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:59.769676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 882/1744] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:55:59.770629 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd6daa-0d88-49ab-a156-740817016aac admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:55:59.781300 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-b8bd6daa-0d88-49ab-a156-740817016aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:55:59.846880 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd6daa-0d88-49ab-a156-740817016aac admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:59.868486 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86df70-eeda-4fdf-812f-28f7e2a6b06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:59.872233 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86df70-eeda-4fdf-812f-28f7e2a6b06a admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:59.872233 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86df70-eeda-4fdf-812f-28f7e2a6b06a admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:59.878353 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86df70-eeda-4fdf-812f-28f7e2a6b06a admin admin] PATH_INFO: `/v3/projects/124a680ec7154c908d9fce1cd52d2763/users/ef1c04d193cb4284828a6029282ea841/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:59.930236 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb5339-bf38-4fb9-91ad-fb3f28227cf8 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:55:59.945668 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86df70-eeda-4fdf-812f-28f7e2a6b06a admin admin] RBAC: Authorizing `identity:create_grant(project_id=124a680ec7154c908d9fce1cd52d2763, user_id=ef1c04d193cb4284828a6029282ea841, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:59.960915 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f474179-0afb-407b-bc1a-aa68475bae59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:55:59.964565 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f474179-0afb-407b-bc1a-aa68475bae59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:55:59.964983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f474179-0afb-407b-bc1a-aa68475bae59 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:55:59.965646 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86df70-eeda-4fdf-812f-28f7e2a6b06a admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:55:59.966796 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f474179-0afb-407b-bc1a-aa68475bae59 admin admin] PATH_INFO: `/v3/users/331252b264d240299ded134a677af8f7` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:55:59.972916 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f474179-0afb-407b-bc1a-aa68475bae59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=331252b264d240299ded134a677af8f7)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:55:59.980854 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f474179-0afb-407b-bc1a-aa68475bae59 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:00.012099 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=85,keystone:INSERT=4,keystone:DELETE=11 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:00.088320 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 883/1745] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:55:59 2022] PUT /identity/v3/projects/124a680ec7154c908d9fce1cd52d2763/users/ef1c04d193cb4284828a6029282ea841/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:00.092265 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86df70-eeda-4fdf-812f-28f7e2a6b06a admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:00.152083 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:00.255469 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-3f474179-0afb-407b-bc1a-aa68475bae59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '331252b264d240299ded134a677af8f7'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:00.262876 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86df70-eeda-4fdf-812f-28f7e2a6b06a admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:00.281627 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a73e09-e376-46fa-9b83-ee020f791dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:00.284423 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a73e09-e376-46fa-9b83-ee020f791dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:00.284857 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-3f474179-0afb-407b-bc1a-aa68475bae59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '331252b264d240299ded134a677af8f7'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:00.286415 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-3f474179-0afb-407b-bc1a-aa68475bae59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '331252b264d240299ded134a677af8f7'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:00.286674 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a73e09-e376-46fa-9b83-ee020f791dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:00.287130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a73e09-e376-46fa-9b83-ee020f791dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:00.288093 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a73e09-e376-46fa-9b83-ee020f791dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:00.291442 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a73e09-e376-46fa-9b83-ee020f791dc7 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:00.326227 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 884/1746] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:56:00.330701 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a73e09-e376-46fa-9b83-ee020f791dc7 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:00.336268 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-3f474179-0afb-407b-bc1a-aa68475bae59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '331252b264d240299ded134a677af8f7'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:00.359750 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a73e09-e376-46fa-9b83-ee020f791dc7 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:00.389703 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879c8c2-fc86-48ab-ba4b-1acf91979757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:00.390699 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879c8c2-fc86-48ab-ba4b-1acf91979757 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:00.391499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879c8c2-fc86-48ab-ba4b-1acf91979757 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:00.391944 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879c8c2-fc86-48ab-ba4b-1acf91979757 admin admin] PATH_INFO: `/v3/projects/124a680ec7154c908d9fce1cd52d2763/users/ef1c04d193cb4284828a6029282ea841/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:00.408699 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879c8c2-fc86-48ab-ba4b-1acf91979757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=124a680ec7154c908d9fce1cd52d2763, user_id=ef1c04d193cb4284828a6029282ea841, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:00.411479 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879c8c2-fc86-48ab-ba4b-1acf91979757 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:00.429906 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-3f474179-0afb-407b-bc1a-aa68475bae59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '331252b264d240299ded134a677af8f7'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:00.441805 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 863/1747] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:55:59 2022] DELETE /identity/v3/users/331252b264d240299ded134a677af8f7 => generated 0 bytes in 851 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:00.450000 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 885/1748] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:56:00 2022] PUT /identity/v3/projects/124a680ec7154c908d9fce1cd52d2763/users/ef1c04d193cb4284828a6029282ea841/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:56:00.462536 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb5c95-5e51-47dd-a795-5419ecff6b19 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:00.463183 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb5c95-5e51-47dd-a795-5419ecff6b19 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:00.463573 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb5c95-5e51-47dd-a795-5419ecff6b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:00.528483 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-a7bb5c95-5e51-47dd-a795-5419ecff6b19 None None] MFA Rules not processed for user `ef1c04d193cb4284828a6029282ea841`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:00.530737 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-a7bb5c95-5e51-47dd-a795-5419ecff6b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:00.654460 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879c8c2-fc86-48ab-ba4b-1acf91979757 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:00.662140 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-d879c8c2-fc86-48ab-ba4b-1acf91979757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:00.726493 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 864/1749] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:00 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:00.752108 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb5c95-5e51-47dd-a795-5419ecff6b19 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:00.754069 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-a7bb5c95-5e51-47dd-a795-5419ecff6b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:00.836886 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879c8c2-fc86-48ab-ba4b-1acf91979757 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:01.007108 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb5c95-5e51-47dd-a795-5419ecff6b19 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:01.030928 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a0c9d-6733-4cad-8202-12a02e45ba0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:01.031660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a0c9d-6733-4cad-8202-12a02e45ba0b service cinder] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:01.031962 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a0c9d-6733-4cad-8202-12a02e45ba0b service cinder] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:01.032387 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a0c9d-6733-4cad-8202-12a02e45ba0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:01.056588 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a0c9d-6733-4cad-8202-12a02e45ba0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:01.058117 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a0c9d-6733-4cad-8202-12a02e45ba0b service cinder] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:01.074936 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005f71d-052c-495b-85d4-cdadb2b1f9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:01.078967 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005f71d-052c-495b-85d4-cdadb2b1f9d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:01.079300 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005f71d-052c-495b-85d4-cdadb2b1f9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:01.079575 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005f71d-052c-495b-85d4-cdadb2b1f9d1 admin admin] PATH_INFO: `/v3/users/45a46588ca4d4d18a1f397243d5c4928` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:01.085330 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005f71d-052c-495b-85d4-cdadb2b1f9d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45a46588ca4d4d18a1f397243d5c4928)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:01.087308 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005f71d-052c-495b-85d4-cdadb2b1f9d1 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:01.121425 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 865/1750] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:56:00 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:56:01.332547 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a0c9d-6733-4cad-8202-12a02e45ba0b service cinder] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:01.334347 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-7c4a0c9d-6733-4cad-8202-12a02e45ba0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:01.357873 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a0c9d-6733-4cad-8202-12a02e45ba0b service cinder] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:01.368297 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9ee8f-934c-42b7-be9d-b82dd622bca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:01.369538 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9ee8f-934c-42b7-be9d-b82dd622bca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:01.370051 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9ee8f-934c-42b7-be9d-b82dd622bca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:01.370533 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9ee8f-934c-42b7-be9d-b82dd622bca0 admin admin] PATH_INFO: `/v3/users/f88ee971ce9447ce93f00ad0f2a4d47d` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:01.372293 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c9ee8f-934c-42b7-be9d-b82dd622bca0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f88ee971ce9447ce93f00ad0f2a4d47d)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:01.374497 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c9ee8f-934c-42b7-be9d-b82dd622bca0 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:01.376641 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-5005f71d-052c-495b-85d4-cdadb2b1f9d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45a46588ca4d4d18a1f397243d5c4928'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:01.378915 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-5005f71d-052c-495b-85d4-cdadb2b1f9d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45a46588ca4d4d18a1f397243d5c4928'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:01.379569 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-5005f71d-052c-495b-85d4-cdadb2b1f9d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45a46588ca4d4d18a1f397243d5c4928'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:01.381818 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:01.466225 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-5005f71d-052c-495b-85d4-cdadb2b1f9d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45a46588ca4d4d18a1f397243d5c4928'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:01.479901 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-5005f71d-052c-495b-85d4-cdadb2b1f9d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45a46588ca4d4d18a1f397243d5c4928'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:01.480795 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:01.522926 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 886/1751] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:56:00 2022] DELETE /identity/v3/users/45a46588ca4d4d18a1f397243d5c4928 => generated 0 bytes in 869 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:01.527383 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929dcbf-24a5-484d-ba41-228dc41daf2f None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:01.527711 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929dcbf-24a5-484d-ba41-228dc41daf2f None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:01.527972 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929dcbf-24a5-484d-ba41-228dc41daf2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:01.576683 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-b929dcbf-24a5-484d-ba41-228dc41daf2f None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:01.587022 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-b929dcbf-24a5-484d-ba41-228dc41daf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:01.685138 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-38c9ee8f-934c-42b7-be9d-b82dd622bca0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f88ee971ce9447ce93f00ad0f2a4d47d'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:01.712765 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-38c9ee8f-934c-42b7-be9d-b82dd622bca0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f88ee971ce9447ce93f00ad0f2a4d47d'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:01.732132 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-38c9ee8f-934c-42b7-be9d-b82dd622bca0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f88ee971ce9447ce93f00ad0f2a4d47d'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:01.769881 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-38c9ee8f-934c-42b7-be9d-b82dd622bca0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f88ee971ce9447ce93f00ad0f2a4d47d'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:01.849234 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-38c9ee8f-934c-42b7-be9d-b82dd622bca0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f88ee971ce9447ce93f00ad0f2a4d47d'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:01.856249 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 866/1752] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:56:01 2022] DELETE /identity/v3/users/f88ee971ce9447ce93f00ad0f2a4d47d => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:56:01.861130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 887/1753] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:01.864905 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a3542-81e9-4447-8bdc-352f1c7d6122 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:01.864905 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a3542-81e9-4447-8bdc-352f1c7d6122 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:01.864905 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a3542-81e9-4447-8bdc-352f1c7d6122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:01.893715 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-d85a3542-81e9-4447-8bdc-352f1c7d6122 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:01.895338 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-d85a3542-81e9-4447-8bdc-352f1c7d6122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:02.004150 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 867/1754] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:02.054242 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929dcbf-24a5-484d-ba41-228dc41daf2f None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:02.056360 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-b929dcbf-24a5-484d-ba41-228dc41daf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:02.085945 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a3542-81e9-4447-8bdc-352f1c7d6122 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:02.088047 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-d85a3542-81e9-4447-8bdc-352f1c7d6122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:02.242917 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929dcbf-24a5-484d-ba41-228dc41daf2f None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:02.253027 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900520c-e74c-40a7-8caa-b8efd2fc9900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:02.255927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900520c-e74c-40a7-8caa-b8efd2fc9900 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:02.256501 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900520c-e74c-40a7-8caa-b8efd2fc9900 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:02.258125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900520c-e74c-40a7-8caa-b8efd2fc9900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:02.262827 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a3542-81e9-4447-8bdc-352f1c7d6122 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:02.279108 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d61ae7-054d-4707-91b8-6629e14e92a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:02.283302 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d61ae7-054d-4707-91b8-6629e14e92a4 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:02.283740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d61ae7-054d-4707-91b8-6629e14e92a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:02.284123 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d61ae7-054d-4707-91b8-6629e14e92a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:02.289077 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-d3d61ae7-054d-4707-91b8-6629e14e92a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:02.293922 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900520c-e74c-40a7-8caa-b8efd2fc9900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:02.298795 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900520c-e74c-40a7-8caa-b8efd2fc9900 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:02.325854 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d61ae7-054d-4707-91b8-6629e14e92a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:02.330243 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d61ae7-054d-4707-91b8-6629e14e92a4 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:02.330774 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 888/1755] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:56:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:56:02.343183 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 868/1756] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:56:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:56:03.073274 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900520c-e74c-40a7-8caa-b8efd2fc9900 service neutron] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:03.074732 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-e900520c-e74c-40a7-8caa-b8efd2fc9900 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:03.106364 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900520c-e74c-40a7-8caa-b8efd2fc9900 service neutron] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:03.114266 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19aa58-a788-41e8-baa8-878e1c48e000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:03.115563 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19aa58-a788-41e8-baa8-878e1c48e000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:03.115867 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19aa58-a788-41e8-baa8-878e1c48e000 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:03.116164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19aa58-a788-41e8-baa8-878e1c48e000 admin admin] PATH_INFO: `/v3/projects/d805845f2b7f467e8e7fc7e3c45a6dbe` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:03.119000 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19aa58-a788-41e8-baa8-878e1c48e000 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d805845f2b7f467e8e7fc7e3c45a6dbe)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:03.121240 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19aa58-a788-41e8-baa8-878e1c48e000 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:03.343893 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7c19aa58-a788-41e8-baa8-878e1c48e000 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd805845f2b7f467e8e7fc7e3c45a6dbe', 'request_id': 'req-7c19aa58-a788-41e8-baa8-878e1c48e000'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:03.356784 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7c19aa58-a788-41e8-baa8-878e1c48e000 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd805845f2b7f467e8e7fc7e3c45a6dbe', 'request_id': 'req-7c19aa58-a788-41e8-baa8-878e1c48e000'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:03.491584 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7c19aa58-a788-41e8-baa8-878e1c48e000 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd805845f2b7f467e8e7fc7e3c45a6dbe', 'request_id': 'req-7c19aa58-a788-41e8-baa8-878e1c48e000'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:03.494343 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:INSERT=2,keystone:DELETE=9,keystone:SELECT=89 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:03.509124 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7c19aa58-a788-41e8-baa8-878e1c48e000 admin admin] The token cache is being invalidate because project d805845f2b7f467e8e7fc7e3c45a6dbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:56:03.509469 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7c19aa58-a788-41e8-baa8-878e1c48e000 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:03.513134 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7c19aa58-a788-41e8-baa8-878e1c48e000 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:03.521016 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 889/1757] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:56:03 2022] DELETE /identity/v3/projects/d805845f2b7f467e8e7fc7e3c45a6dbe => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:03.526264 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a10503-cf87-4cff-8324-4389944e824e None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:03.527292 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a10503-cf87-4cff-8324-4389944e824e None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:03.527872 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a10503-cf87-4cff-8324-4389944e824e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:03.564172 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-f8a10503-cf87-4cff-8324-4389944e824e None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:03.587177 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-f8a10503-cf87-4cff-8324-4389944e824e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:03.695587 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:03.765474 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 869/1758] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:03.776247 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e54576-964c-4182-af11-6cef3c6493f7 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:03.776650 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e54576-964c-4182-af11-6cef3c6493f7 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:03.777031 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e54576-964c-4182-af11-6cef3c6493f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:03.854671 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-f4e54576-964c-4182-af11-6cef3c6493f7 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:03.858401 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-f4e54576-964c-4182-af11-6cef3c6493f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:03.873757 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 890/1759] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:03.879342 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a10503-cf87-4cff-8324-4389944e824e None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:03.891750 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a10503-cf87-4cff-8324-4389944e824e None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:03.929524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867ea9f-8b5c-48de-bd7e-d254e7a693f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:03.930272 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867ea9f-8b5c-48de-bd7e-d254e7a693f6 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:03.930553 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867ea9f-8b5c-48de-bd7e-d254e7a693f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:03.932578 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867ea9f-8b5c-48de-bd7e-d254e7a693f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:03.932578 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0867ea9f-8b5c-48de-bd7e-d254e7a693f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:56:03.932578 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0867ea9f-8b5c-48de-bd7e-d254e7a693f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:03.944171 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0867ea9f-8b5c-48de-bd7e-d254e7a693f6 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:03.972213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 870/1760] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 15:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:56:03.985297 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e54576-964c-4182-af11-6cef3c6493f7 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:04.002205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e54576-964c-4182-af11-6cef3c6493f7 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:04.018883 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3543d3-7757-4b98-bae9-58dacd5fe365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:04.018883 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3543d3-7757-4b98-bae9-58dacd5fe365 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:04.021538 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3543d3-7757-4b98-bae9-58dacd5fe365 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:04.022573 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3543d3-7757-4b98-bae9-58dacd5fe365 admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:04.022878 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3543d3-7757-4b98-bae9-58dacd5fe365 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:04.024946 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3543d3-7757-4b98-bae9-58dacd5fe365 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:04.072245 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867ea9f-8b5c-48de-bd7e-d254e7a693f6 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:04.080076 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-0867ea9f-8b5c-48de-bd7e-d254e7a693f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:04.116007 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 891/1761] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:56:03 2022] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:56:04.120010 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867ea9f-8b5c-48de-bd7e-d254e7a693f6 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:04.121149 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3543d3-7757-4b98-bae9-58dacd5fe365 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:04.344886 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943898c6-73ac-4373-8ea8-d790450fe18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:04.345795 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943898c6-73ac-4373-8ea8-d790450fe18f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:04.346085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943898c6-73ac-4373-8ea8-d790450fe18f admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:04.346366 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943898c6-73ac-4373-8ea8-d790450fe18f admin admin] PATH_INFO: `/v3/projects/bcb581434b4249d9bed808037d169189` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:04.348978 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943898c6-73ac-4373-8ea8-d790450fe18f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcb581434b4249d9bed808037d169189)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:04.350910 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943898c6-73ac-4373-8ea8-d790450fe18f admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:04.356917 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3543d3-7757-4b98-bae9-58dacd5fe365 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:04.374597 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3edab2-54a1-49ed-b36f-1995c38cc7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:04.375878 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3edab2-54a1-49ed-b36f-1995c38cc7c8 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:04.376169 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3edab2-54a1-49ed-b36f-1995c38cc7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:04.376449 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3edab2-54a1-49ed-b36f-1995c38cc7c8 admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:04.377157 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3edab2-54a1-49ed-b36f-1995c38cc7c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:04.379180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3edab2-54a1-49ed-b36f-1995c38cc7c8 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:04.873948 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 892/1762] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:56:04 2022] POST /identity/v3/users => generated 291 bytes in 751 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:56:04.877847 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3edab2-54a1-49ed-b36f-1995c38cc7c8 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:04.914640 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3edab2-54a1-49ed-b36f-1995c38cc7c8 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:04.949100 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2ad5c-2137-4d31-a3fd-6b9af19cd74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:04.949815 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2ad5c-2137-4d31-a3fd-6b9af19cd74e admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:04.950106 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2ad5c-2137-4d31-a3fd-6b9af19cd74e admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:04.950389 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2ad5c-2137-4d31-a3fd-6b9af19cd74e admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:04.951312 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2ad5c-2137-4d31-a3fd-6b9af19cd74e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:04.956983 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2ad5c-2137-4d31-a3fd-6b9af19cd74e admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:04.985122 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 893/1763] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:56:04.989270 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2ad5c-2137-4d31-a3fd-6b9af19cd74e admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:04.990971 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-943898c6-73ac-4373-8ea8-d790450fe18f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcb581434b4249d9bed808037d169189', 'request_id': 'req-943898c6-73ac-4373-8ea8-d790450fe18f'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:05.006263 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-943898c6-73ac-4373-8ea8-d790450fe18f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcb581434b4249d9bed808037d169189', 'request_id': 'req-943898c6-73ac-4373-8ea8-d790450fe18f'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:05.009602 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2ad5c-2137-4d31-a3fd-6b9af19cd74e admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:05.136107 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187289a0-faa2-44ef-95f1-96706cbeafe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:05.136955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187289a0-faa2-44ef-95f1-96706cbeafe2 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:05.137404 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187289a0-faa2-44ef-95f1-96706cbeafe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:05.137837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187289a0-faa2-44ef-95f1-96706cbeafe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:05.138738 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187289a0-faa2-44ef-95f1-96706cbeafe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:05.140621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187289a0-faa2-44ef-95f1-96706cbeafe2 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:05.159799 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-943898c6-73ac-4373-8ea8-d790450fe18f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcb581434b4249d9bed808037d169189', 'request_id': 'req-943898c6-73ac-4373-8ea8-d790450fe18f'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:05.164993 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 894/1764] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:56:05.173759 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187289a0-faa2-44ef-95f1-96706cbeafe2 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:05.178390 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-943898c6-73ac-4373-8ea8-d790450fe18f admin admin] The token cache is being invalidate because project bcb581434b4249d9bed808037d169189 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:56:05.179312 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-943898c6-73ac-4373-8ea8-d790450fe18f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:05.183181 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-943898c6-73ac-4373-8ea8-d790450fe18f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:05.190609 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 871/1765] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:56:04 2022] DELETE /identity/v3/projects/bcb581434b4249d9bed808037d169189 => generated 0 bytes in 1119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:05.195940 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943898c6-73ac-4373-8ea8-d790450fe18f admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:05.199964 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-943898c6-73ac-4373-8ea8-d790450fe18f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:05.230191 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187289a0-faa2-44ef-95f1-96706cbeafe2 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:05.248167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943898c6-73ac-4373-8ea8-d790450fe18f admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:05.257944 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b49a4e-0cec-46c4-9b86-d1c70b127d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:05.259116 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b49a4e-0cec-46c4-9b86-d1c70b127d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:05.259562 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b49a4e-0cec-46c4-9b86-d1c70b127d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:05.265591 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b49a4e-0cec-46c4-9b86-d1c70b127d87 admin admin] PATH_INFO: `/v3/users/0e6430cb144a46e2af1cde95f06f5d5b` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:05.265868 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123e970-6275-457e-b1b5-d6ff59da4020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:05.265868 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123e970-6275-457e-b1b5-d6ff59da4020 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:05.266052 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b49a4e-0cec-46c4-9b86-d1c70b127d87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e6430cb144a46e2af1cde95f06f5d5b)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:05.266128 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123e970-6275-457e-b1b5-d6ff59da4020 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:05.266128 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123e970-6275-457e-b1b5-d6ff59da4020 admin admin] PATH_INFO: `/v3/projects/0b3bab9300e2436795ba2c53e1e673e6/users/ad9a4998a9304327bea0f47962ac5fe5/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:05.266287 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b49a4e-0cec-46c4-9b86-d1c70b127d87 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:05.317667 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c123e970-6275-457e-b1b5-d6ff59da4020 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b3bab9300e2436795ba2c53e1e673e6, user_id=ad9a4998a9304327bea0f47962ac5fe5, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:05.324195 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c123e970-6275-457e-b1b5-d6ff59da4020 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:05.430038 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 895/1766] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:56:05 2022] PUT /identity/v3/projects/0b3bab9300e2436795ba2c53e1e673e6/users/ad9a4998a9304327bea0f47962ac5fe5/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:05.445158 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078c52a-f7aa-41cc-9ab4-c89d35bdb1e0 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:05.446940 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078c52a-f7aa-41cc-9ab4-c89d35bdb1e0 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:05.450203 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078c52a-f7aa-41cc-9ab4-c89d35bdb1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:05.508397 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-9078c52a-f7aa-41cc-9ab4-c89d35bdb1e0 None None] MFA Rules not processed for user `ad9a4998a9304327bea0f47962ac5fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:05.510234 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-9078c52a-f7aa-41cc-9ab4-c89d35bdb1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:05.514554 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=94,keystone:DELETE=1,keystone:INSERT=5 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:05.568687 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-28b49a4e-0cec-46c4-9b86-d1c70b127d87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e6430cb144a46e2af1cde95f06f5d5b'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:05.619543 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-28b49a4e-0cec-46c4-9b86-d1c70b127d87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e6430cb144a46e2af1cde95f06f5d5b'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:05.622665 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-28b49a4e-0cec-46c4-9b86-d1c70b127d87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e6430cb144a46e2af1cde95f06f5d5b'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:05.664947 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-28b49a4e-0cec-46c4-9b86-d1c70b127d87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e6430cb144a46e2af1cde95f06f5d5b'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:05.727034 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 896/1767] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:05.738443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078c52a-f7aa-41cc-9ab4-c89d35bdb1e0 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:05.740369 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-9078c52a-f7aa-41cc-9ab4-c89d35bdb1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:05.778306 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-28b49a4e-0cec-46c4-9b86-d1c70b127d87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e6430cb144a46e2af1cde95f06f5d5b'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:05.806977 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 872/1768] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:56:05 2022] DELETE /identity/v3/users/0e6430cb144a46e2af1cde95f06f5d5b => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:05.806977 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b49a4e-0cec-46c4-9b86-d1c70b127d87 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:05.811983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-28b49a4e-0cec-46c4-9b86-d1c70b127d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:05.869040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:05.980664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b49a4e-0cec-46c4-9b86-d1c70b127d87 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:05.994184 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078c52a-f7aa-41cc-9ab4-c89d35bdb1e0 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:06.001144 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace062a-254f-429b-ae25-0def114a58ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:06.002219 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace062a-254f-429b-ae25-0def114a58ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:06.006096 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace062a-254f-429b-ae25-0def114a58ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:06.011397 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace062a-254f-429b-ae25-0def114a58ca admin admin] PATH_INFO: `/v3/projects/a95fe645fb3d478bb64700f99a1d81f9` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:06.011397 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace062a-254f-429b-ae25-0def114a58ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=a95fe645fb3d478bb64700f99a1d81f9)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:06.020562 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d01148-f674-4a3c-9a9f-a027f0037c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:06.030005 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d01148-f674-4a3c-9a9f-a027f0037c7e admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:06.031578 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d01148-f674-4a3c-9a9f-a027f0037c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:06.032771 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d01148-f674-4a3c-9a9f-a027f0037c7e admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:06.034117 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d01148-f674-4a3c-9a9f-a027f0037c7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:06.036118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d01148-f674-4a3c-9a9f-a027f0037c7e admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:06.041118 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace062a-254f-429b-ae25-0def114a58ca admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:06.162314 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 873/1769] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:56:05 2022] POST /identity/v3/projects => generated 381 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:56:06.171465 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-cace062a-254f-429b-ae25-0def114a58ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a95fe645fb3d478bb64700f99a1d81f9', 'request_id': 'req-cace062a-254f-429b-ae25-0def114a58ca'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:06.172555 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d01148-f674-4a3c-9a9f-a027f0037c7e admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:06.180519 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-cace062a-254f-429b-ae25-0def114a58ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a95fe645fb3d478bb64700f99a1d81f9', 'request_id': 'req-cace062a-254f-429b-ae25-0def114a58ca'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:06.285861 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d01148-f674-4a3c-9a9f-a027f0037c7e admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:06.290756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-cace062a-254f-429b-ae25-0def114a58ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a95fe645fb3d478bb64700f99a1d81f9', 'request_id': 'req-cace062a-254f-429b-ae25-0def114a58ca'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:06.315213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a389cbc-eaee-4f28-807d-144af004a641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:06.317448 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a389cbc-eaee-4f28-807d-144af004a641 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:06.317448 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a389cbc-eaee-4f28-807d-144af004a641 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:06.319884 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-cace062a-254f-429b-ae25-0def114a58ca admin admin] The token cache is being invalidate because project a95fe645fb3d478bb64700f99a1d81f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:56:06.320441 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-cace062a-254f-429b-ae25-0def114a58ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:06.321258 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a389cbc-eaee-4f28-807d-144af004a641 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:06.322187 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a389cbc-eaee-4f28-807d-144af004a641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:06.322652 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-cace062a-254f-429b-ae25-0def114a58ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:06.325321 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a389cbc-eaee-4f28-807d-144af004a641 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:06.326815 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 897/1770] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:56:05 2022] DELETE /identity/v3/projects/a95fe645fb3d478bb64700f99a1d81f9 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:06.330962 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace062a-254f-429b-ae25-0def114a58ca admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:06.332540 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-cace062a-254f-429b-ae25-0def114a58ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:06.424587 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace062a-254f-429b-ae25-0def114a58ca admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:06.435792 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 874/1771] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:56:06 2022] POST /identity/v3/users => generated 297 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:56:06.439771 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a389cbc-eaee-4f28-807d-144af004a641 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:06.440871 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bfd83c-371f-4ba0-b375-79f7a254d736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:06.441822 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfd83c-371f-4ba0-b375-79f7a254d736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:06.441967 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-5a389cbc-eaee-4f28-807d-144af004a641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:06.442096 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfd83c-371f-4ba0-b375-79f7a254d736 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:06.442586 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfd83c-371f-4ba0-b375-79f7a254d736 admin admin] PATH_INFO: `/v3/users/ef1c04d193cb4284828a6029282ea841` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:06.445315 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bfd83c-371f-4ba0-b375-79f7a254d736 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef1c04d193cb4284828a6029282ea841)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:06.447266 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bfd83c-371f-4ba0-b375-79f7a254d736 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:06.460970 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a389cbc-eaee-4f28-807d-144af004a641 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:06.469952 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff0c28-435f-439a-bc68-51bafd3a80f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:06.469952 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff0c28-435f-439a-bc68-51bafd3a80f8 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:06.469952 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff0c28-435f-439a-bc68-51bafd3a80f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:06.469952 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff0c28-435f-439a-bc68-51bafd3a80f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:06.470546 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ff0c28-435f-439a-bc68-51bafd3a80f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:06.472723 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ff0c28-435f-439a-bc68-51bafd3a80f8 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:06.492013 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 875/1772] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:56:06.497434 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff0c28-435f-439a-bc68-51bafd3a80f8 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:06.506863 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff0c28-435f-439a-bc68-51bafd3a80f8 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:06.513503 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045c403-99f6-4597-b5c3-819bb565a51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:06.515169 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045c403-99f6-4597-b5c3-819bb565a51a admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:06.516659 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045c403-99f6-4597-b5c3-819bb565a51a admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:06.517252 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045c403-99f6-4597-b5c3-819bb565a51a admin admin] PATH_INFO: `/v3/projects/80f33ad243594fc08297826684b22c37/users/c7e9b7457a5d473299b74915e7d96230/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:06.539960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9045c403-99f6-4597-b5c3-819bb565a51a admin admin] RBAC: Authorizing `identity:create_grant(project_id=80f33ad243594fc08297826684b22c37, user_id=c7e9b7457a5d473299b74915e7d96230, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:06.542710 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9045c403-99f6-4597-b5c3-819bb565a51a admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:06.630785 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 876/1773] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:56:06 2022] PUT /identity/v3/projects/80f33ad243594fc08297826684b22c37/users/c7e9b7457a5d473299b74915e7d96230/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:06.634957 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045c403-99f6-4597-b5c3-819bb565a51a admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:06.726566 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045c403-99f6-4597-b5c3-819bb565a51a admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:06.735209 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-27bfd83c-371f-4ba0-b375-79f7a254d736 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef1c04d193cb4284828a6029282ea841'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:06.736420 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-27bfd83c-371f-4ba0-b375-79f7a254d736 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef1c04d193cb4284828a6029282ea841'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:06.737317 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a8369-dcd2-49de-9fdc-3f0cbe9fdc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:06.738001 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a8369-dcd2-49de-9fdc-3f0cbe9fdc10 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:06.738282 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a8369-dcd2-49de-9fdc-3f0cbe9fdc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:06.738554 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a8369-dcd2-49de-9fdc-3f0cbe9fdc10 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:06.739304 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a8369-dcd2-49de-9fdc-3f0cbe9fdc10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:06.740206 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-27bfd83c-371f-4ba0-b375-79f7a254d736 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef1c04d193cb4284828a6029282ea841'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:06.741172 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a8369-dcd2-49de-9fdc-3f0cbe9fdc10 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:06.755707 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 877/1774] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:56:06.756873 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a8369-dcd2-49de-9fdc-3f0cbe9fdc10 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:06.758778 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-369a8369-dcd2-49de-9fdc-3f0cbe9fdc10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:06.774309 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a8369-dcd2-49de-9fdc-3f0cbe9fdc10 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:06.780111 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d3ca5-799e-4408-8420-450950503814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:06.780653 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d3ca5-799e-4408-8420-450950503814 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:06.781197 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d3ca5-799e-4408-8420-450950503814 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:06.781848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d3ca5-799e-4408-8420-450950503814 admin admin] PATH_INFO: `/v3/projects/80f33ad243594fc08297826684b22c37/users/c7e9b7457a5d473299b74915e7d96230/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:06.784922 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d3ca5-799e-4408-8420-450950503814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80f33ad243594fc08297826684b22c37, user_id=c7e9b7457a5d473299b74915e7d96230, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:06.788043 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d3ca5-799e-4408-8420-450950503814 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:06.815100 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 878/1775] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:56:06 2022] PUT /identity/v3/projects/80f33ad243594fc08297826684b22c37/users/c7e9b7457a5d473299b74915e7d96230/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:06.820366 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cccb039-0586-4a9a-91f7-d5ba6fb246db None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:06.820899 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cccb039-0586-4a9a-91f7-d5ba6fb246db None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:06.821367 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cccb039-0586-4a9a-91f7-d5ba6fb246db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:06.828387 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-27bfd83c-371f-4ba0-b375-79f7a254d736 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef1c04d193cb4284828a6029282ea841'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:06.841696 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-27bfd83c-371f-4ba0-b375-79f7a254d736 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef1c04d193cb4284828a6029282ea841'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:06.871525 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-9cccb039-0586-4a9a-91f7-d5ba6fb246db None None] MFA Rules not processed for user `c7e9b7457a5d473299b74915e7d96230`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:06.873517 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-9cccb039-0586-4a9a-91f7-d5ba6fb246db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:06.874773 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 898/1776] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:56:06 2022] DELETE /identity/v3/users/ef1c04d193cb4284828a6029282ea841 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:56:06.979728 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 879/1777] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:06 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:06.992356 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bfd83c-371f-4ba0-b375-79f7a254d736 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:06.994874 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-27bfd83c-371f-4ba0-b375-79f7a254d736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:07.077019 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bfd83c-371f-4ba0-b375-79f7a254d736 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:07.081726 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e4d29-bdd3-4920-a832-b8c79cc941bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:07.082974 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e4d29-bdd3-4920-a832-b8c79cc941bf service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:07.082974 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e4d29-bdd3-4920-a832-b8c79cc941bf service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:07.082974 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e4d29-bdd3-4920-a832-b8c79cc941bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:07.098549 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e4d29-bdd3-4920-a832-b8c79cc941bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:07.100493 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e4d29-bdd3-4920-a832-b8c79cc941bf service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:07.118269 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 899/1778] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:56:06 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:56:07.142813 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:07.380447 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cccb039-0586-4a9a-91f7-d5ba6fb246db None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:07.404450 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cccb039-0586-4a9a-91f7-d5ba6fb246db None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:07.411167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c780cb-e0d5-4b2c-8cda-6a52aefb7903 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:07.411825 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c780cb-e0d5-4b2c-8cda-6a52aefb7903 service cinder] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:07.412143 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c780cb-e0d5-4b2c-8cda-6a52aefb7903 service cinder] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:07.412440 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c780cb-e0d5-4b2c-8cda-6a52aefb7903 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:07.414838 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-c3c780cb-e0d5-4b2c-8cda-6a52aefb7903 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:07.457998 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=91,keystone:DELETE=3,keystone:INSERT=6 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:07.498263 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c780cb-e0d5-4b2c-8cda-6a52aefb7903 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:07.500061 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c780cb-e0d5-4b2c-8cda-6a52aefb7903 service cinder] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:07.514565 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 880/1779] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:56:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:56:07.719916 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e4d29-bdd3-4920-a832-b8c79cc941bf service cinder] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:07.721864 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-393e4d29-bdd3-4920-a832-b8c79cc941bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:07.846770 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e4d29-bdd3-4920-a832-b8c79cc941bf service cinder] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:07.852959 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b48d2-5330-47d5-b876-e3b132053e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:07.853838 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b48d2-5330-47d5-b876-e3b132053e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:07.854184 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b48d2-5330-47d5-b876-e3b132053e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:07.854468 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b48d2-5330-47d5-b876-e3b132053e03 admin admin] PATH_INFO: `/v3/projects/c0bca2b8adaa4e918b6b4de0b195035c` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:07.856335 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b48d2-5330-47d5-b876-e3b132053e03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0bca2b8adaa4e918b6b4de0b195035c)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:07.868049 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b48d2-5330-47d5-b876-e3b132053e03 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:07.870914 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a3bbe-5153-46b7-99c1-ae661b83d841 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:07.871643 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a3bbe-5153-46b7-99c1-ae661b83d841 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:07.872072 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a3bbe-5153-46b7-99c1-ae661b83d841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:07.896697 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-9f9a3bbe-5153-46b7-99c1-ae661b83d841 None None] MFA Rules not processed for user `ce2a9dc6fbae42dfbfa4cb8b326c3de5`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:07.897924 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-9f9a3bbe-5153-46b7-99c1-ae661b83d841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:07.980906 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 881/1780] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:56:08.025423 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-0d2b48d2-5330-47d5-b876-e3b132053e03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0bca2b8adaa4e918b6b4de0b195035c', 'request_id': 'req-0d2b48d2-5330-47d5-b876-e3b132053e03'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:08.032806 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-0d2b48d2-5330-47d5-b876-e3b132053e03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0bca2b8adaa4e918b6b4de0b195035c', 'request_id': 'req-0d2b48d2-5330-47d5-b876-e3b132053e03'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:08.105949 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a3bbe-5153-46b7-99c1-ae661b83d841 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:08.113187 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-0d2b48d2-5330-47d5-b876-e3b132053e03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0bca2b8adaa4e918b6b4de0b195035c', 'request_id': 'req-0d2b48d2-5330-47d5-b876-e3b132053e03'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:08.130835 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a3bbe-5153-46b7-99c1-ae661b83d841 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:08.131278 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-0d2b48d2-5330-47d5-b876-e3b132053e03 admin admin] The token cache is being invalidate because project c0bca2b8adaa4e918b6b4de0b195035c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:56:08.131782 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-0d2b48d2-5330-47d5-b876-e3b132053e03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:08.132611 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-0d2b48d2-5330-47d5-b876-e3b132053e03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:08.135336 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 900/1781] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:56:07 2022] DELETE /identity/v3/projects/c0bca2b8adaa4e918b6b4de0b195035c => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:08.149383 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceaedce-66ea-40f9-a3e3-f9c14f4330bf None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:08.149383 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceaedce-66ea-40f9-a3e3-f9c14f4330bf None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:08.149383 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceaedce-66ea-40f9-a3e3-f9c14f4330bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:08.183120 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-1ceaedce-66ea-40f9-a3e3-f9c14f4330bf None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:08.184727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-1ceaedce-66ea-40f9-a3e3-f9c14f4330bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:08.242459 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0498f-1b51-4b64-b9c5-3843aea26e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:08.244306 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0498f-1b51-4b64-b9c5-3843aea26e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:08.244765 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0498f-1b51-4b64-b9c5-3843aea26e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:08.245556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0498f-1b51-4b64-b9c5-3843aea26e7c admin admin] PATH_INFO: `/v3/users/ad9a4998a9304327bea0f47962ac5fe5` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:08.248066 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0498f-1b51-4b64-b9c5-3843aea26e7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad9a4998a9304327bea0f47962ac5fe5)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:08.250715 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0498f-1b51-4b64-b9c5-3843aea26e7c admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:08.317375 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 901/1782] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:08.321332 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb1f12-7c4f-474d-a3b4-f32a5f66c2ad None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:08.322951 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb1f12-7c4f-474d-a3b4-f32a5f66c2ad None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:08.323576 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb1f12-7c4f-474d-a3b4-f32a5f66c2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:08.353470 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-8ddb1f12-7c4f-474d-a3b4-f32a5f66c2ad None None] MFA Rules not processed for user `261e4ebfb0504a21b6c54e05c0b8378f`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:08.354822 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-8ddb1f12-7c4f-474d-a3b4-f32a5f66c2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:08.429257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 902/1783] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:08.430908 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575bb5f-37e2-4eab-ba0a-2c744b314b63 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:08.431261 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575bb5f-37e2-4eab-ba0a-2c744b314b63 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:08.431751 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575bb5f-37e2-4eab-ba0a-2c744b314b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:08.465483 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-6575bb5f-37e2-4eab-ba0a-2c744b314b63 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:08.465483 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-6575bb5f-37e2-4eab-ba0a-2c744b314b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:08.473820 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 903/1784] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:08.474560 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575bb5f-37e2-4eab-ba0a-2c744b314b63 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:08.475885 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-6575bb5f-37e2-4eab-ba0a-2c744b314b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:08.488510 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575bb5f-37e2-4eab-ba0a-2c744b314b63 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:08.493698 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb91ab6-8413-4f7f-b030-5c9786129537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:08.494815 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb91ab6-8413-4f7f-b030-5c9786129537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:08.495580 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb91ab6-8413-4f7f-b030-5c9786129537 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:08.495898 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb91ab6-8413-4f7f-b030-5c9786129537 admin admin] PATH_INFO: `/v3/projects/124a680ec7154c908d9fce1cd52d2763` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:08.497237 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb91ab6-8413-4f7f-b030-5c9786129537 admin admin] RBAC: Authorizing `identity:delete_project(project_id=124a680ec7154c908d9fce1cd52d2763)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:08.501309 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb91ab6-8413-4f7f-b030-5c9786129537 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:08.531738 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-5ab0498f-1b51-4b64-b9c5-3843aea26e7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad9a4998a9304327bea0f47962ac5fe5'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:08.546383 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-5ab0498f-1b51-4b64-b9c5-3843aea26e7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad9a4998a9304327bea0f47962ac5fe5'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:08.548104 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-5ab0498f-1b51-4b64-b9c5-3843aea26e7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad9a4998a9304327bea0f47962ac5fe5'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:08.561741 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-5ab0498f-1b51-4b64-b9c5-3843aea26e7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad9a4998a9304327bea0f47962ac5fe5'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:08.635668 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-5ab0498f-1b51-4b64-b9c5-3843aea26e7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad9a4998a9304327bea0f47962ac5fe5'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:08.648593 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 882/1785] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:56:08 2022] DELETE /identity/v3/users/ad9a4998a9304327bea0f47962ac5fe5 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:56:08.655658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5ff9d-60f8-432d-af59-e5553e8abdb9 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:08.655658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5ff9d-60f8-432d-af59-e5553e8abdb9 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:08.655658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5ff9d-60f8-432d-af59-e5553e8abdb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:08.668316 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7eb91ab6-8413-4f7f-b030-5c9786129537 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '124a680ec7154c908d9fce1cd52d2763', 'request_id': 'req-7eb91ab6-8413-4f7f-b030-5c9786129537'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:08.673330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-3fb5ff9d-60f8-432d-af59-e5553e8abdb9 None None] MFA Rules not processed for user `5a57fd95e0714be6b124d5abc2422dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:08.674600 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-3fb5ff9d-60f8-432d-af59-e5553e8abdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:08.678196 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7eb91ab6-8413-4f7f-b030-5c9786129537 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '124a680ec7154c908d9fce1cd52d2763', 'request_id': 'req-7eb91ab6-8413-4f7f-b030-5c9786129537'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:08.744204 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 883/1786] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:08.745271 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5ff9d-60f8-432d-af59-e5553e8abdb9 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:08.752808 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-3fb5ff9d-60f8-432d-af59-e5553e8abdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:08.794540 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7eb91ab6-8413-4f7f-b030-5c9786129537 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '124a680ec7154c908d9fce1cd52d2763', 'request_id': 'req-7eb91ab6-8413-4f7f-b030-5c9786129537'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:08.810800 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7eb91ab6-8413-4f7f-b030-5c9786129537 admin admin] The token cache is being invalidate because project 124a680ec7154c908d9fce1cd52d2763 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:56:08.811752 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7eb91ab6-8413-4f7f-b030-5c9786129537 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:08.812967 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7eb91ab6-8413-4f7f-b030-5c9786129537 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:08.815148 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 904/1787] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:56:08 2022] DELETE /identity/v3/projects/124a680ec7154c908d9fce1cd52d2763 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:08.816766 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fa53b-b8e2-4c43-b357-89cd75e3a6e7 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:08.817153 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fa53b-b8e2-4c43-b357-89cd75e3a6e7 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:08.817528 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fa53b-b8e2-4c43-b357-89cd75e3a6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:08.839818 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5ff9d-60f8-432d-af59-e5553e8abdb9 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:08.841305 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-996fa53b-b8e2-4c43-b357-89cd75e3a6e7 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:08.843285 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-996fa53b-b8e2-4c43-b357-89cd75e3a6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:08.845691 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61276c90-e524-42b6-bd32-56326df72791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:08.846608 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61276c90-e524-42b6-bd32-56326df72791 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:08.846885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61276c90-e524-42b6-bd32-56326df72791 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:08.847174 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61276c90-e524-42b6-bd32-56326df72791 admin admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:08.848099 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61276c90-e524-42b6-bd32-56326df72791 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:56:08.848385 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61276c90-e524-42b6-bd32-56326df72791 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:08.850378 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61276c90-e524-42b6-bd32-56326df72791 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:08.855751 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 905/1788] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:08.857593 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b49bd-2854-46fe-b61e-ffeb40d32a00 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:08.857819 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b49bd-2854-46fe-b61e-ffeb40d32a00 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:08.857972 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b49bd-2854-46fe-b61e-ffeb40d32a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:08.867768 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 884/1789] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 15:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:56:08.868684 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61276c90-e524-42b6-bd32-56326df72791 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:08.870376 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-61276c90-e524-42b6-bd32-56326df72791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:08.888167 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-902b49bd-2854-46fe-b61e-ffeb40d32a00 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:08.892554 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-902b49bd-2854-46fe-b61e-ffeb40d32a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:08.900650 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 906/1790] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:08.901992 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b49bd-2854-46fe-b61e-ffeb40d32a00 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:08.903976 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-902b49bd-2854-46fe-b61e-ffeb40d32a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:08.919977 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b49bd-2854-46fe-b61e-ffeb40d32a00 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:08.925996 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce238d2c-0e2c-4905-b70e-83cf6496ff63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:08.927106 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce238d2c-0e2c-4905-b70e-83cf6496ff63 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:08.927491 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce238d2c-0e2c-4905-b70e-83cf6496ff63 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:08.927906 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce238d2c-0e2c-4905-b70e-83cf6496ff63 admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:08.928727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce238d2c-0e2c-4905-b70e-83cf6496ff63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:08.930906 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce238d2c-0e2c-4905-b70e-83cf6496ff63 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:08.936945 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61276c90-e524-42b6-bd32-56326df72791 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:08.944699 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40beca06-f48f-48ef-8f99-bf613f017031 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:08.946221 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40beca06-f48f-48ef-8f99-bf613f017031 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:08.946451 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40beca06-f48f-48ef-8f99-bf613f017031 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:08.947035 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40beca06-f48f-48ef-8f99-bf613f017031 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:08.961010 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40beca06-f48f-48ef-8f99-bf613f017031 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:08.962699 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40beca06-f48f-48ef-8f99-bf613f017031 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:08.978518 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 885/1791] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:56:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:56:08.980072 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958580b-4cbb-4ad0-ae91-7c8ebd976d5c None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:08.980367 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958580b-4cbb-4ad0-ae91-7c8ebd976d5c None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:08.980776 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958580b-4cbb-4ad0-ae91-7c8ebd976d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:09.001500 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-f958580b-4cbb-4ad0-ae91-7c8ebd976d5c None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:09.002883 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-f958580b-4cbb-4ad0-ae91-7c8ebd976d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:09.013494 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 886/1792] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:09.018672 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958580b-4cbb-4ad0-ae91-7c8ebd976d5c None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:09.028808 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958580b-4cbb-4ad0-ae91-7c8ebd976d5c None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:09.034241 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b2f09-6d05-43c1-bcff-62595ee9cf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:09.034919 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b2f09-6d05-43c1-bcff-62595ee9cf47 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:09.035203 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b2f09-6d05-43c1-bcff-62595ee9cf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:09.035509 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b2f09-6d05-43c1-bcff-62595ee9cf47 admin admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:09.036278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b2f09-6d05-43c1-bcff-62595ee9cf47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:56:09.036585 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b2f09-6d05-43c1-bcff-62595ee9cf47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:09.041793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b2f09-6d05-43c1-bcff-62595ee9cf47 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:09.052777 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 887/1793] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 15:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:56:09.057208 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b2f09-6d05-43c1-bcff-62595ee9cf47 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:09.069183 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b2f09-6d05-43c1-bcff-62595ee9cf47 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:09.075199 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b66eb6-f4ba-41cb-8d11-6b4dabcbd1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:09.075896 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b66eb6-f4ba-41cb-8d11-6b4dabcbd1ae admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:09.076197 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b66eb6-f4ba-41cb-8d11-6b4dabcbd1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:09.076461 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b66eb6-f4ba-41cb-8d11-6b4dabcbd1ae admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:09.077159 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b66eb6-f4ba-41cb-8d11-6b4dabcbd1ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:09.079226 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b66eb6-f4ba-41cb-8d11-6b4dabcbd1ae admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:09.095384 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 907/1794] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:56:08 2022] POST /identity/v3/projects => generated 373 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:56:09.100204 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce238d2c-0e2c-4905-b70e-83cf6496ff63 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:09.143298 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:09.233588 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 888/1795] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:56:09 2022] POST /identity/v3/projects => generated 365 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:56:09.233754 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce238d2c-0e2c-4905-b70e-83cf6496ff63 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:09.235718 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b66eb6-f4ba-41cb-8d11-6b4dabcbd1ae admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:09.356632 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b66eb6-f4ba-41cb-8d11-6b4dabcbd1ae admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:09.361503 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55aac3c-d52b-4751-876b-f37fef15157a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:09.362216 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55aac3c-d52b-4751-876b-f37fef15157a admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:09.362499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55aac3c-d52b-4751-876b-f37fef15157a admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:09.362746 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55aac3c-d52b-4751-876b-f37fef15157a admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:09.369793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208642d-2558-4744-8746-492cf7a32d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:09.369793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208642d-2558-4744-8746-492cf7a32d52 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:09.369793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208642d-2558-4744-8746-492cf7a32d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:09.370353 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55aac3c-d52b-4751-876b-f37fef15157a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:09.370452 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208642d-2558-4744-8746-492cf7a32d52 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:09.370452 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208642d-2558-4744-8746-492cf7a32d52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:09.370571 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55aac3c-d52b-4751-876b-f37fef15157a admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:09.372359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208642d-2558-4744-8746-492cf7a32d52 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:09.480610 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 908/1796] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:56:09 2022] POST /identity/v3/users => generated 287 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:56:09.485238 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55aac3c-d52b-4751-876b-f37fef15157a admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:09.499414 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:09.501456 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55aac3c-d52b-4751-876b-f37fef15157a admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:09.506562 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9ff08-a8cb-4257-89a9-477a0b813ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:09.508409 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 889/1797] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:56:09 2022] POST /identity/v3/users => generated 283 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:56:09.508692 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9ff08-a8cb-4257-89a9-477a0b813ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:09.509063 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9ff08-a8cb-4257-89a9-477a0b813ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:09.509404 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9ff08-a8cb-4257-89a9-477a0b813ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:09.510244 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e9ff08-a8cb-4257-89a9-477a0b813ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:09.512134 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e9ff08-a8cb-4257-89a9-477a0b813ae2 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:09.512528 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208642d-2558-4744-8746-492cf7a32d52 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:09.525893 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 909/1798] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:56:09.533585 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9ff08-a8cb-4257-89a9-477a0b813ae2 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:09.544223 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208642d-2558-4744-8746-492cf7a32d52 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:09.548512 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9ff08-a8cb-4257-89a9-477a0b813ae2 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:09.563267 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20749e06-122f-4bf2-9972-cc43f27f708a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:09.563267 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20749e06-122f-4bf2-9972-cc43f27f708a admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:09.563267 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20749e06-122f-4bf2-9972-cc43f27f708a admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:09.563267 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20749e06-122f-4bf2-9972-cc43f27f708a admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:09.568471 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20749e06-122f-4bf2-9972-cc43f27f708a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:09.576877 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44512cad-9e71-4163-90e6-6050ca9a4e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:09.577568 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44512cad-9e71-4163-90e6-6050ca9a4e53 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:09.577919 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44512cad-9e71-4163-90e6-6050ca9a4e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:09.579468 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44512cad-9e71-4163-90e6-6050ca9a4e53 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:09.580279 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44512cad-9e71-4163-90e6-6050ca9a4e53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:09.583323 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44512cad-9e71-4163-90e6-6050ca9a4e53 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:09.589671 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20749e06-122f-4bf2-9972-cc43f27f708a admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:09.603715 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 910/1799] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:56:09.603715 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20749e06-122f-4bf2-9972-cc43f27f708a admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:09.604307 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 890/1800] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:56:09.620430 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-20749e06-122f-4bf2-9972-cc43f27f708a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:09.622150 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44512cad-9e71-4163-90e6-6050ca9a4e53 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:09.644764 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44512cad-9e71-4163-90e6-6050ca9a4e53 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:09.653291 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8693c-111c-4ed8-afe2-5205605f7e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:09.655018 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8693c-111c-4ed8-afe2-5205605f7e4a admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:09.655411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8693c-111c-4ed8-afe2-5205605f7e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:09.655805 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8693c-111c-4ed8-afe2-5205605f7e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:09.658562 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8693c-111c-4ed8-afe2-5205605f7e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:09.658707 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20749e06-122f-4bf2-9972-cc43f27f708a admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:09.662145 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8693c-111c-4ed8-afe2-5205605f7e4a admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:09.686368 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 891/1801] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:56:09.686559 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdfe4f9-261a-4a14-9a26-1087506cc16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:09.687562 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8693c-111c-4ed8-afe2-5205605f7e4a admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:09.688242 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfe4f9-261a-4a14-9a26-1087506cc16b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:09.689985 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfe4f9-261a-4a14-9a26-1087506cc16b admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:09.690555 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfe4f9-261a-4a14-9a26-1087506cc16b admin admin] PATH_INFO: `/v3/projects/0b3bab9300e2436795ba2c53e1e673e6` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:09.693972 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdfe4f9-261a-4a14-9a26-1087506cc16b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b3bab9300e2436795ba2c53e1e673e6)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:09.698019 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdfe4f9-261a-4a14-9a26-1087506cc16b admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:09.707459 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8693c-111c-4ed8-afe2-5205605f7e4a admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:09.715961 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3ab1c-f396-4222-8ef4-fe4d3cf23579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:09.719026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3ab1c-f396-4222-8ef4-fe4d3cf23579 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:09.719616 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3ab1c-f396-4222-8ef4-fe4d3cf23579 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:09.721504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3ab1c-f396-4222-8ef4-fe4d3cf23579 admin admin] PATH_INFO: `/v3/projects/c5da98e3d89f4eaca203505e1de5629b/users/2471bb24bc8a4aaf803ffbcaef69dd8f/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:09.830364 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3ab1c-f396-4222-8ef4-fe4d3cf23579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5da98e3d89f4eaca203505e1de5629b, user_id=2471bb24bc8a4aaf803ffbcaef69dd8f, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:09.830364 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3ab1c-f396-4222-8ef4-fe4d3cf23579 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:10.983412 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 892/1802] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:56:09 2022] PUT /identity/v3/projects/c5da98e3d89f4eaca203505e1de5629b/users/2471bb24bc8a4aaf803ffbcaef69dd8f/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 1296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:10.986883 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3ab1c-f396-4222-8ef4-fe4d3cf23579 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:11.002445 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-5bdfe4f9-261a-4a14-9a26-1087506cc16b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b3bab9300e2436795ba2c53e1e673e6', 'request_id': 'req-5bdfe4f9-261a-4a14-9a26-1087506cc16b'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:11.010734 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-5bdfe4f9-261a-4a14-9a26-1087506cc16b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b3bab9300e2436795ba2c53e1e673e6', 'request_id': 'req-5bdfe4f9-261a-4a14-9a26-1087506cc16b'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:11.099444 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3ab1c-f396-4222-8ef4-fe4d3cf23579 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:11.142477 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-5bdfe4f9-261a-4a14-9a26-1087506cc16b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b3bab9300e2436795ba2c53e1e673e6', 'request_id': 'req-5bdfe4f9-261a-4a14-9a26-1087506cc16b'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:11.169636 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-5bdfe4f9-261a-4a14-9a26-1087506cc16b admin admin] The token cache is being invalidate because project 0b3bab9300e2436795ba2c53e1e673e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:56:11.181587 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-5bdfe4f9-261a-4a14-9a26-1087506cc16b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:11.182543 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-5bdfe4f9-261a-4a14-9a26-1087506cc16b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:11.184750 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 911/1803] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:56:09 2022] DELETE /identity/v3/projects/0b3bab9300e2436795ba2c53e1e673e6 => generated 0 bytes in 1582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:11.185908 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d2baa-1378-453f-94f4-f7f522080109 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:11.186862 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d2baa-1378-453f-94f4-f7f522080109 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:11.186862 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d2baa-1378-453f-94f4-f7f522080109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:11.226030 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5effa7d4-9b26-4d27-a2e2-d5ddff4971a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:11.228590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effa7d4-9b26-4d27-a2e2-d5ddff4971a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:11.229310 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effa7d4-9b26-4d27-a2e2-d5ddff4971a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:11.229960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effa7d4-9b26-4d27-a2e2-d5ddff4971a3 admin admin] PATH_INFO: `/v3/projects/e43169c661c64871bd021c9adacae008/users/57856abec0aa4eb7ba9a5629f1fbbfa4/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:11.249446 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-f19d2baa-1378-453f-94f4-f7f522080109 None None] MFA Rules not processed for user `2471bb24bc8a4aaf803ffbcaef69dd8f`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:11.254914 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-f19d2baa-1378-453f-94f4-f7f522080109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:11.275530 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5effa7d4-9b26-4d27-a2e2-d5ddff4971a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e43169c661c64871bd021c9adacae008, user_id=57856abec0aa4eb7ba9a5629f1fbbfa4, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:11.279615 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5effa7d4-9b26-4d27-a2e2-d5ddff4971a3 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:11.394952 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 893/1804] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:56:10 2022] PUT /identity/v3/projects/e43169c661c64871bd021c9adacae008/users/57856abec0aa4eb7ba9a5629f1fbbfa4/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:11.396157 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5effa7d4-9b26-4d27-a2e2-d5ddff4971a3 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:11.417750 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 912/1805] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:11.419552 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f74f5-462b-4b9b-bdfd-856c17dffd43 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:11.419552 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f74f5-462b-4b9b-bdfd-856c17dffd43 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:11.419812 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f74f5-462b-4b9b-bdfd-856c17dffd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:11.427516 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-5effa7d4-9b26-4d27-a2e2-d5ddff4971a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:11.493034 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-b21f74f5-462b-4b9b-bdfd-856c17dffd43 None None] MFA Rules not processed for user `57856abec0aa4eb7ba9a5629f1fbbfa4`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:11.495734 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-b21f74f5-462b-4b9b-bdfd-856c17dffd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:11.533464 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5effa7d4-9b26-4d27-a2e2-d5ddff4971a3 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:11.563626 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a03081-2e16-452a-82af-1cad514dfe0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:11.564834 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a03081-2e16-452a-82af-1cad514dfe0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:11.565224 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a03081-2e16-452a-82af-1cad514dfe0b admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:11.565944 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a03081-2e16-452a-82af-1cad514dfe0b admin admin] PATH_INFO: `/v3/users/c7e9b7457a5d473299b74915e7d96230` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:11.568106 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a03081-2e16-452a-82af-1cad514dfe0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7e9b7457a5d473299b74915e7d96230)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:11.571881 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a03081-2e16-452a-82af-1cad514dfe0b admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:11.613462 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 913/1806] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:11.614466 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f74f5-462b-4b9b-bdfd-856c17dffd43 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:11.615928 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-b21f74f5-462b-4b9b-bdfd-856c17dffd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:11.631421 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f74f5-462b-4b9b-bdfd-856c17dffd43 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:11.639273 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ab64f-54d3-485c-bd7e-3b7ca4d6bf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:11.640115 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ab64f-54d3-485c-bd7e-3b7ca4d6bf82 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:11.640384 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ab64f-54d3-485c-bd7e-3b7ca4d6bf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:11.640670 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ab64f-54d3-485c-bd7e-3b7ca4d6bf82 admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:11.641371 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ab64f-54d3-485c-bd7e-3b7ca4d6bf82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:11.643293 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ab64f-54d3-485c-bd7e-3b7ca4d6bf82 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:11.791356 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-86a03081-2e16-452a-82af-1cad514dfe0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7e9b7457a5d473299b74915e7d96230'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:11.796722 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 914/1807] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:56:11 2022] POST /identity/v3/projects => generated 373 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:56:11.797712 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ab64f-54d3-485c-bd7e-3b7ca4d6bf82 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:11.802546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-ba3ab64f-54d3-485c-bd7e-3b7ca4d6bf82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:11.810784 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-86a03081-2e16-452a-82af-1cad514dfe0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7e9b7457a5d473299b74915e7d96230'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:11.813820 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-86a03081-2e16-452a-82af-1cad514dfe0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7e9b7457a5d473299b74915e7d96230'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:11.846948 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-86a03081-2e16-452a-82af-1cad514dfe0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7e9b7457a5d473299b74915e7d96230'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:11.933003 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ab64f-54d3-485c-bd7e-3b7ca4d6bf82 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:11.942262 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-86a03081-2e16-452a-82af-1cad514dfe0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7e9b7457a5d473299b74915e7d96230'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:11.962704 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 894/1808] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:56:11 2022] DELETE /identity/v3/users/c7e9b7457a5d473299b74915e7d96230 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:11.971522 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a03081-2e16-452a-82af-1cad514dfe0b admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:11.978886 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-86a03081-2e16-452a-82af-1cad514dfe0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:11.994179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763a9a0-1be0-4a63-a73c-53ae5a5416d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:11.996139 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763a9a0-1be0-4a63-a73c-53ae5a5416d0 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:11.996426 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763a9a0-1be0-4a63-a73c-53ae5a5416d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:12.000781 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763a9a0-1be0-4a63-a73c-53ae5a5416d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:12.000781 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763a9a0-1be0-4a63-a73c-53ae5a5416d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:12.007430 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763a9a0-1be0-4a63-a73c-53ae5a5416d0 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:12.097252 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a03081-2e16-452a-82af-1cad514dfe0b admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:12.102822 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c111ab1-bbbe-4a63-a890-559252ec991f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:12.103677 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c111ab1-bbbe-4a63-a890-559252ec991f admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:12.104500 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c111ab1-bbbe-4a63-a890-559252ec991f admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:12.104500 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c111ab1-bbbe-4a63-a890-559252ec991f admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:12.105203 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c111ab1-bbbe-4a63-a890-559252ec991f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:12.107373 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c111ab1-bbbe-4a63-a890-559252ec991f admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:12.126324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 915/1809] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:56:11 2022] POST /identity/v3/projects => generated 363 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:56:12.129048 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f3a27-add6-4969-942a-2e94c049de6d None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:12.129048 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f3a27-add6-4969-942a-2e94c049de6d None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:12.129255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f3a27-add6-4969-942a-2e94c049de6d None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:12.133060 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 916/1810] 10.222.0.39 () {54 vars in 921 bytes} [Mon May 23 15:56:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:56:12.133818 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f3a27-add6-4969-942a-2e94c049de6d None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:12.135581 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-f74f3a27-add6-4969-942a-2e94c049de6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:12.215260 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f3a27-add6-4969-942a-2e94c049de6d None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:12.221494 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a79b0-7f0f-4887-9967-e458df150e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:12.222206 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a79b0-7f0f-4887-9967-e458df150e4c admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:12.222513 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a79b0-7f0f-4887-9967-e458df150e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:12.222817 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a79b0-7f0f-4887-9967-e458df150e4c admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:12.223550 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a79b0-7f0f-4887-9967-e458df150e4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:12.225658 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a79b0-7f0f-4887-9967-e458df150e4c admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:12.239964 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 895/1811] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:56:11 2022] POST /identity/v3/users => generated 293 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:56:12.241932 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402c592-88a4-40b1-8304-46c21a6fc779 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:12.241932 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402c592-88a4-40b1-8304-46c21a6fc779 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:12.242124 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402c592-88a4-40b1-8304-46c21a6fc779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:12.261151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-8402c592-88a4-40b1-8304-46c21a6fc779 None None] MFA Rules not processed for user `76f7895b7b5748e7b4461f7fde1d558a`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:12.262404 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-8402c592-88a4-40b1-8304-46c21a6fc779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:12.331204 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 917/1812] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:56:12 2022] POST /identity/v3/users => generated 288 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:56:12.335972 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a79b0-7f0f-4887-9967-e458df150e4c admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:12.352412 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a79b0-7f0f-4887-9967-e458df150e4c admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:12.354958 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 896/1813] 10.222.0.39 () {58 vars in 1018 bytes} [Mon May 23 15:56:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:12.356763 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402c592-88a4-40b1-8304-46c21a6fc779 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:12.359713 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ca251-4c51-47c3-84d5-2ee6605fac1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:12.360975 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ca251-4c51-47c3-84d5-2ee6605fac1f admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:12.361367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ca251-4c51-47c3-84d5-2ee6605fac1f admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:12.369746 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ca251-4c51-47c3-84d5-2ee6605fac1f admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:12.370746 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ca251-4c51-47c3-84d5-2ee6605fac1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:12.374192 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ca251-4c51-47c3-84d5-2ee6605fac1f admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:12.379835 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402c592-88a4-40b1-8304-46c21a6fc779 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:12.384722 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f41e6-da5b-4d85-aeb0-ec26793ebaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:12.385570 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 918/1814] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:56:12.386583 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ca251-4c51-47c3-84d5-2ee6605fac1f admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:12.388316 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-c62ca251-4c51-47c3-84d5-2ee6605fac1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:12.389195 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f41e6-da5b-4d85-aeb0-ec26793ebaca admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:12.389540 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f41e6-da5b-4d85-aeb0-ec26793ebaca admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:12.389827 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f41e6-da5b-4d85-aeb0-ec26793ebaca admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:12.391058 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f41e6-da5b-4d85-aeb0-ec26793ebaca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:12.394027 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f41e6-da5b-4d85-aeb0-ec26793ebaca admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:12.404409 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ca251-4c51-47c3-84d5-2ee6605fac1f admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:12.405542 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 897/1815] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:56:12.407175 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f41e6-da5b-4d85-aeb0-ec26793ebaca admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:12.415036 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6d91e-60f1-46aa-9b50-ab5df3d82a32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:12.415953 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6d91e-60f1-46aa-9b50-ab5df3d82a32 service nova] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:12.416371 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6d91e-60f1-46aa-9b50-ab5df3d82a32 service nova] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:12.416802 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6d91e-60f1-46aa-9b50-ab5df3d82a32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:12.418362 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f41e6-da5b-4d85-aeb0-ec26793ebaca admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:12.426065 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05079775-a2ca-46e7-ba6a-0ee589347cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:12.434614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6d91e-60f1-46aa-9b50-ab5df3d82a32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:12.434747 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05079775-a2ca-46e7-ba6a-0ee589347cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:12.434747 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05079775-a2ca-46e7-ba6a-0ee589347cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:12.434747 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05079775-a2ca-46e7-ba6a-0ee589347cbe admin admin] PATH_INFO: `/v3/projects/c8a5744bae4d48dd8cf09ffd00f04b43/users/4a68ae07b08d4fe39b320379579fa8ea/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:12.434987 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6d91e-60f1-46aa-9b50-ab5df3d82a32 service nova] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:12.445053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 919/1816] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:56:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:56:12.446041 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6d91e-60f1-46aa-9b50-ab5df3d82a32 service nova] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:12.461102 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6d91e-60f1-46aa-9b50-ab5df3d82a32 service nova] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:12.483664 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403323e-775d-432a-96d6-b427b59d6627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:12.483859 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05079775-a2ca-46e7-ba6a-0ee589347cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8a5744bae4d48dd8cf09ffd00f04b43, user_id=4a68ae07b08d4fe39b320379579fa8ea, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:12.484090 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403323e-775d-432a-96d6-b427b59d6627 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:12.484090 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403323e-775d-432a-96d6-b427b59d6627 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:12.484090 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403323e-775d-432a-96d6-b427b59d6627 admin admin] PATH_INFO: `/v3/projects/b8bf506deb0f4aceaf98d6927b5e083a/users/4ba5922746d74901a685a6823117d439/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:12.484780 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05079775-a2ca-46e7-ba6a-0ee589347cbe admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:12.491005 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403323e-775d-432a-96d6-b427b59d6627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8bf506deb0f4aceaf98d6927b5e083a, user_id=4ba5922746d74901a685a6823117d439, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:12.493722 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403323e-775d-432a-96d6-b427b59d6627 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:12.598762 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 920/1817] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:56:12 2022] PUT /identity/v3/projects/b8bf506deb0f4aceaf98d6927b5e083a/users/4ba5922746d74901a685a6823117d439/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:12.600605 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403323e-775d-432a-96d6-b427b59d6627 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:12.602742 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 898/1818] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:56:12 2022] PUT /identity/v3/projects/c8a5744bae4d48dd8cf09ffd00f04b43/users/4a68ae07b08d4fe39b320379579fa8ea/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:12.602742 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05079775-a2ca-46e7-ba6a-0ee589347cbe admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:12.607050 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-0403323e-775d-432a-96d6-b427b59d6627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:12.704717 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05079775-a2ca-46e7-ba6a-0ee589347cbe admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:12.707748 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403323e-775d-432a-96d6-b427b59d6627 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:12.714655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd2a0e-d6e8-40fc-aad2-25765fe49eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:12.714830 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96a6b4-da47-4eb9-abd5-66253b9db733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:12.715349 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd2a0e-d6e8-40fc-aad2-25765fe49eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:12.715700 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96a6b4-da47-4eb9-abd5-66253b9db733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:12.715793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd2a0e-d6e8-40fc-aad2-25765fe49eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:12.716010 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd2a0e-d6e8-40fc-aad2-25765fe49eb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:12.716101 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96a6b4-da47-4eb9-abd5-66253b9db733 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:12.716378 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96a6b4-da47-4eb9-abd5-66253b9db733 admin admin] PATH_INFO: `/v3/projects/80f33ad243594fc08297826684b22c37` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:12.716755 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd2a0e-d6e8-40fc-aad2-25765fe49eb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:12.717725 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96a6b4-da47-4eb9-abd5-66253b9db733 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80f33ad243594fc08297826684b22c37)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:12.718402 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd2a0e-d6e8-40fc-aad2-25765fe49eb3 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:12.719710 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96a6b4-da47-4eb9-abd5-66253b9db733 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:12.732336 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 899/1819] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:56:12.733292 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd2a0e-d6e8-40fc-aad2-25765fe49eb3 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:12.745103 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd2a0e-d6e8-40fc-aad2-25765fe49eb3 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:12.751549 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed90574-7a1a-4183-b0b0-43ce98e2073a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:12.752820 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed90574-7a1a-4183-b0b0-43ce98e2073a admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:12.753109 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed90574-7a1a-4183-b0b0-43ce98e2073a admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:12.753394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed90574-7a1a-4183-b0b0-43ce98e2073a admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:12.754139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed90574-7a1a-4183-b0b0-43ce98e2073a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:12.755799 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed90574-7a1a-4183-b0b0-43ce98e2073a admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:12.766529 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 900/1820] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:56:12.767351 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed90574-7a1a-4183-b0b0-43ce98e2073a admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:12.777867 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed90574-7a1a-4183-b0b0-43ce98e2073a admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:12.783774 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14077a0c-9223-4186-aea3-0708bc97cdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:12.784675 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14077a0c-9223-4186-aea3-0708bc97cdb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:12.784964 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14077a0c-9223-4186-aea3-0708bc97cdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:12.785245 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14077a0c-9223-4186-aea3-0708bc97cdb3 admin admin] PATH_INFO: `/v3/projects/b8bf506deb0f4aceaf98d6927b5e083a/users/4ba5922746d74901a685a6823117d439/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:12.793465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14077a0c-9223-4186-aea3-0708bc97cdb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8bf506deb0f4aceaf98d6927b5e083a, user_id=4ba5922746d74901a685a6823117d439, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:12.800145 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14077a0c-9223-4186-aea3-0708bc97cdb3 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:12.819688 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 901/1821] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:56:12 2022] PUT /identity/v3/projects/b8bf506deb0f4aceaf98d6927b5e083a/users/4ba5922746d74901a685a6823117d439/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:12.822003 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14077a0c-9223-4186-aea3-0708bc97cdb3 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:12.853211 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:12.895014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14077a0c-9223-4186-aea3-0708bc97cdb3 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:12.906984 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-2e96a6b4-da47-4eb9-abd5-66253b9db733 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80f33ad243594fc08297826684b22c37', 'request_id': 'req-2e96a6b4-da47-4eb9-abd5-66253b9db733'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:12.913423 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-2e96a6b4-da47-4eb9-abd5-66253b9db733 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80f33ad243594fc08297826684b22c37', 'request_id': 'req-2e96a6b4-da47-4eb9-abd5-66253b9db733'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:12.959867 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe09ad5-f8b7-40ef-ae2b-76651a9e2cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:12.961039 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe09ad5-f8b7-40ef-ae2b-76651a9e2cf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:12.961174 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe09ad5-f8b7-40ef-ae2b-76651a9e2cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:12.961364 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe09ad5-f8b7-40ef-ae2b-76651a9e2cf9 admin admin] PATH_INFO: `/v3/projects/c8a5744bae4d48dd8cf09ffd00f04b43/users/4a68ae07b08d4fe39b320379579fa8ea/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:12.963506 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe09ad5-f8b7-40ef-ae2b-76651a9e2cf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8a5744bae4d48dd8cf09ffd00f04b43, user_id=4a68ae07b08d4fe39b320379579fa8ea, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:12.966246 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe09ad5-f8b7-40ef-ae2b-76651a9e2cf9 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:12.976635 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 902/1822] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:56:12 2022] PUT /identity/v3/projects/c8a5744bae4d48dd8cf09ffd00f04b43/users/4a68ae07b08d4fe39b320379579fa8ea/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:12.977989 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c4f20-507d-4cd6-b20d-375edbe70b3c None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:12.978287 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c4f20-507d-4cd6-b20d-375edbe70b3c None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:12.978567 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c4f20-507d-4cd6-b20d-375edbe70b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:12.986497 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-2e96a6b4-da47-4eb9-abd5-66253b9db733 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80f33ad243594fc08297826684b22c37', 'request_id': 'req-2e96a6b4-da47-4eb9-abd5-66253b9db733'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:12.997788 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-2e96a6b4-da47-4eb9-abd5-66253b9db733 admin admin] The token cache is being invalidate because project 80f33ad243594fc08297826684b22c37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:56:12.998188 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-2e96a6b4-da47-4eb9-abd5-66253b9db733 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:12.998857 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-2e96a6b4-da47-4eb9-abd5-66253b9db733 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:13.001846 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 921/1823] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:56:12 2022] DELETE /identity/v3/projects/80f33ad243594fc08297826684b22c37 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:13.006316 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b9bc4-36b5-406f-b700-af67755a592c None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:13.006747 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b9bc4-36b5-406f-b700-af67755a592c None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:13.007035 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b9bc4-36b5-406f-b700-af67755a592c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:13.011059 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-282c4f20-507d-4cd6-b20d-375edbe70b3c None None] MFA Rules not processed for user `4ba5922746d74901a685a6823117d439`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:13.012352 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-282c4f20-507d-4cd6-b20d-375edbe70b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:13.039948 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-2a1b9bc4-36b5-406f-b700-af67755a592c None None] MFA Rules not processed for user `4a68ae07b08d4fe39b320379579fa8ea`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:13.041200 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-2a1b9bc4-36b5-406f-b700-af67755a592c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:13.093107 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 903/1824] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:12 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:13.097218 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0de9a-5277-4e3b-b86c-1ede3e9cdb72 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:13.097339 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0de9a-5277-4e3b-b86c-1ede3e9cdb72 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:13.097848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0de9a-5277-4e3b-b86c-1ede3e9cdb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:13.123990 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 922/1825] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:13 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:13.123990 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b9bc4-36b5-406f-b700-af67755a592c None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:13.123990 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-2a1b9bc4-36b5-406f-b700-af67755a592c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:13.128309 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-8ec0de9a-5277-4e3b-b86c-1ede3e9cdb72 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:13.129575 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-8ec0de9a-5277-4e3b-b86c-1ede3e9cdb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:13.189738 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b9bc4-36b5-406f-b700-af67755a592c None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:13.200085 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1923c0-914f-453a-9fdf-a9eaf8f54f85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:13.200307 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 904/1826] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:13.200403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1923c0-914f-453a-9fdf-a9eaf8f54f85 service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:13.200403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1923c0-914f-453a-9fdf-a9eaf8f54f85 service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:13.200647 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8a205-8512-48b2-9300-eed7f4ecc9e5 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:13.200730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1923c0-914f-453a-9fdf-a9eaf8f54f85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:13.200799 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8a205-8512-48b2-9300-eed7f4ecc9e5 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:13.200799 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8a205-8512-48b2-9300-eed7f4ecc9e5 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:13.200799 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 905/1827] 10.222.0.39 () {54 vars in 921 bytes} [Mon May 23 15:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:56:13.200799 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8a205-8512-48b2-9300-eed7f4ecc9e5 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:13.203412 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-3bf8a205-8512-48b2-9300-eed7f4ecc9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:13.216861 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1923c0-914f-453a-9fdf-a9eaf8f54f85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:13.219150 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1923c0-914f-453a-9fdf-a9eaf8f54f85 service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:13.225763 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8a205-8512-48b2-9300-eed7f4ecc9e5 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:13.229878 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a23abd-0b6a-41d2-924c-6107e8a3b8eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:13.230626 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a23abd-0b6a-41d2-924c-6107e8a3b8eb service cinder] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:13.230990 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a23abd-0b6a-41d2-924c-6107e8a3b8eb service cinder] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:13.231342 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a23abd-0b6a-41d2-924c-6107e8a3b8eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:13.243182 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 923/1828] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:56:13 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:56:13.244681 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042b814-7770-45ad-b8d0-7ba02629f19f None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:13.245096 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042b814-7770-45ad-b8d0-7ba02629f19f None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:13.247341 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042b814-7770-45ad-b8d0-7ba02629f19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:13.253664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a23abd-0b6a-41d2-924c-6107e8a3b8eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:13.259932 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a23abd-0b6a-41d2-924c-6107e8a3b8eb service cinder] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:13.267565 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-5042b814-7770-45ad-b8d0-7ba02629f19f None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:13.268809 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-5042b814-7770-45ad-b8d0-7ba02629f19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:13.275403 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 906/1829] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:56:13 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:56:13.276589 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da004dc-c734-43be-be61-cdc6f1335e42 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:13.277249 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da004dc-c734-43be-be61-cdc6f1335e42 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:13.277249 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da004dc-c734-43be-be61-cdc6f1335e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:13.290645 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 924/1830] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:13.294784 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042b814-7770-45ad-b8d0-7ba02629f19f None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:13.307912 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042b814-7770-45ad-b8d0-7ba02629f19f None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:13.311731 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-6da004dc-c734-43be-be61-cdc6f1335e42 None None] MFA Rules not processed for user `76f7895b7b5748e7b4461f7fde1d558a`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:13.313782 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-6da004dc-c734-43be-be61-cdc6f1335e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:13.317531 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7eae84-9b9d-439c-a3b9-6397c6c5f389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:13.317857 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7eae84-9b9d-439c-a3b9-6397c6c5f389 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:13.318544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7eae84-9b9d-439c-a3b9-6397c6c5f389 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:13.319006 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7eae84-9b9d-439c-a3b9-6397c6c5f389 admin admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:13.319978 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7eae84-9b9d-439c-a3b9-6397c6c5f389 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:56:13.320484 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7eae84-9b9d-439c-a3b9-6397c6c5f389 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:13.323274 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7eae84-9b9d-439c-a3b9-6397c6c5f389 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:13.351506 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 925/1831] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 15:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:56:13.355520 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7eae84-9b9d-439c-a3b9-6397c6c5f389 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:13.367899 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7eae84-9b9d-439c-a3b9-6397c6c5f389 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:13.374019 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601fc311-e419-4c47-96c0-f99371b99c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:13.376467 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fc311-e419-4c47-96c0-f99371b99c91 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:13.377120 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fc311-e419-4c47-96c0-f99371b99c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:13.377543 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fc311-e419-4c47-96c0-f99371b99c91 admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:13.379569 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601fc311-e419-4c47-96c0-f99371b99c91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:13.386598 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601fc311-e419-4c47-96c0-f99371b99c91 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:13.402142 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 907/1832] 10.222.0.39 () {58 vars in 1018 bytes} [Mon May 23 15:56:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:13.417839 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da004dc-c734-43be-be61-cdc6f1335e42 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:13.419243 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-6da004dc-c734-43be-be61-cdc6f1335e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:13.436139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da004dc-c734-43be-be61-cdc6f1335e42 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:13.442850 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68df67-691c-48ba-bb70-33e3e71deaa5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:13.443545 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68df67-691c-48ba-bb70-33e3e71deaa5 service nova] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:13.443882 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68df67-691c-48ba-bb70-33e3e71deaa5 service nova] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:13.444157 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68df67-691c-48ba-bb70-33e3e71deaa5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:13.454454 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68df67-691c-48ba-bb70-33e3e71deaa5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:13.456293 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68df67-691c-48ba-bb70-33e3e71deaa5 service nova] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:13.467834 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 908/1833] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:56:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:56:13.567543 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 926/1834] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:56:13 2022] POST /identity/v3/projects => generated 369 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:56:13.568723 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68df67-691c-48ba-bb70-33e3e71deaa5 service nova] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:13.579139 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601fc311-e419-4c47-96c0-f99371b99c91 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:13.585313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68df67-691c-48ba-bb70-33e3e71deaa5 service nova] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:13.680417 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:13.688014 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601fc311-e419-4c47-96c0-f99371b99c91 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:13.692768 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848427e-09f9-4250-b277-435d418e40f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:13.693837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848427e-09f9-4250-b277-435d418e40f5 service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:13.694490 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848427e-09f9-4250-b277-435d418e40f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:13.694965 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848427e-09f9-4250-b277-435d418e40f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:13.697118 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-6848427e-09f9-4250-b277-435d418e40f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:13.728133 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64626d61-8f96-491e-bc18-6be0a109d792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:13.728133 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64626d61-8f96-491e-bc18-6be0a109d792 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:13.728133 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64626d61-8f96-491e-bc18-6be0a109d792 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:13.728133 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64626d61-8f96-491e-bc18-6be0a109d792 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:13.728425 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64626d61-8f96-491e-bc18-6be0a109d792 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:13.728425 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64626d61-8f96-491e-bc18-6be0a109d792 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:13.798323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848427e-09f9-4250-b277-435d418e40f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:13.800132 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848427e-09f9-4250-b277-435d418e40f5 service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:13.817867 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 927/1835] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:56:13 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:56:13.823288 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 909/1836] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:56:13 2022] POST /identity/v3/users => generated 285 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:56:13.827340 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848427e-09f9-4250-b277-435d418e40f5 service cinder] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:13.851996 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848427e-09f9-4250-b277-435d418e40f5 service cinder] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:13.867221 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db9094-b641-4fd0-8967-1e453788eefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:13.871783 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db9094-b641-4fd0-8967-1e453788eefc admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:13.871783 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db9094-b641-4fd0-8967-1e453788eefc admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:13.871783 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db9094-b641-4fd0-8967-1e453788eefc admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:13.871783 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db9094-b641-4fd0-8967-1e453788eefc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:13.872314 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db9094-b641-4fd0-8967-1e453788eefc admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:13.890954 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 928/1837] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:56:13.893036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64626d61-8f96-491e-bc18-6be0a109d792 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:13.909495 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64626d61-8f96-491e-bc18-6be0a109d792 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:13.920382 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bdb794-6cf6-4796-a115-a35d73d9d886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:13.921216 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdb794-6cf6-4796-a115-a35d73d9d886 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:13.922234 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdb794-6cf6-4796-a115-a35d73d9d886 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:13.922588 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdb794-6cf6-4796-a115-a35d73d9d886 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:13.924706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bdb794-6cf6-4796-a115-a35d73d9d886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:13.927641 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bdb794-6cf6-4796-a115-a35d73d9d886 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:13.941302 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 910/1838] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:56:13.946027 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db9094-b641-4fd0-8967-1e453788eefc admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:13.960380 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db9094-b641-4fd0-8967-1e453788eefc admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:13.970705 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6d7fb-a711-40dc-8e2d-85dcdcca41cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:13.971846 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6d7fb-a711-40dc-8e2d-85dcdcca41cd admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:13.972223 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6d7fb-a711-40dc-8e2d-85dcdcca41cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:13.972534 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6d7fb-a711-40dc-8e2d-85dcdcca41cd admin admin] PATH_INFO: `/v3/projects/58fd1b0d472049698d044a177acf3ad5/users/f2dc1451294b47c79e4db3fd4e7c133a/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:13.991684 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6d7fb-a711-40dc-8e2d-85dcdcca41cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=58fd1b0d472049698d044a177acf3ad5, user_id=f2dc1451294b47c79e4db3fd4e7c133a, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:13.994451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6d7fb-a711-40dc-8e2d-85dcdcca41cd admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:14.132799 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 929/1839] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:56:13 2022] PUT /identity/v3/projects/58fd1b0d472049698d044a177acf3ad5/users/f2dc1451294b47c79e4db3fd4e7c133a/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:14.144081 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e124e7-a62f-496f-8dc4-899b924661ab None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:14.144675 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e124e7-a62f-496f-8dc4-899b924661ab None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:14.144968 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e124e7-a62f-496f-8dc4-899b924661ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:14.183900 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-c6e124e7-a62f-496f-8dc4-899b924661ab None None] MFA Rules not processed for user `f2dc1451294b47c79e4db3fd4e7c133a`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:14.185127 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-c6e124e7-a62f-496f-8dc4-899b924661ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:14.313007 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 911/1840] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:14 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:14.335512 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6d7fb-a711-40dc-8e2d-85dcdcca41cd admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:14.393678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6d7fb-a711-40dc-8e2d-85dcdcca41cd admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:14.397356 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b605861-9e85-4777-9397-6e733adfeff9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:14.398029 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b605861-9e85-4777-9397-6e733adfeff9 service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:14.398320 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b605861-9e85-4777-9397-6e733adfeff9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:14.398602 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b605861-9e85-4777-9397-6e733adfeff9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:14.411585 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b605861-9e85-4777-9397-6e733adfeff9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:14.413092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b605861-9e85-4777-9397-6e733adfeff9 service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:14.422127 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 930/1841] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:56:14 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:56:14.446285 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e124e7-a62f-496f-8dc4-899b924661ab None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:14.517683 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e124e7-a62f-496f-8dc4-899b924661ab None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:14.522263 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55125386-3529-4475-b13f-4df093740c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:14.523138 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55125386-3529-4475-b13f-4df093740c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:14.523422 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55125386-3529-4475-b13f-4df093740c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:14.523736 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55125386-3529-4475-b13f-4df093740c27 admin admin] PATH_INFO: `/v3/users/f2dc1451294b47c79e4db3fd4e7c133a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:14.524938 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55125386-3529-4475-b13f-4df093740c27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2dc1451294b47c79e4db3fd4e7c133a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:14.526918 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55125386-3529-4475-b13f-4df093740c27 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:14.763255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b605861-9e85-4777-9397-6e733adfeff9 service cinder] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:14.766708 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-1b605861-9e85-4777-9397-6e733adfeff9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:14.777594 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-55125386-3529-4475-b13f-4df093740c27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2dc1451294b47c79e4db3fd4e7c133a'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:14.786980 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b605861-9e85-4777-9397-6e733adfeff9 service cinder] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:14.787880 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-55125386-3529-4475-b13f-4df093740c27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2dc1451294b47c79e4db3fd4e7c133a'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:14.789410 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-55125386-3529-4475-b13f-4df093740c27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2dc1451294b47c79e4db3fd4e7c133a'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:14.792895 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894988c-cd6f-41f1-8f4a-9b0e5715e9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:14.803534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-55125386-3529-4475-b13f-4df093740c27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2dc1451294b47c79e4db3fd4e7c133a'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:14.806172 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894988c-cd6f-41f1-8f4a-9b0e5715e9e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:14.806473 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894988c-cd6f-41f1-8f4a-9b0e5715e9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:14.806790 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894988c-cd6f-41f1-8f4a-9b0e5715e9e3 admin admin] PATH_INFO: `/v3/users/2471bb24bc8a4aaf803ffbcaef69dd8f` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:14.808271 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894988c-cd6f-41f1-8f4a-9b0e5715e9e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2471bb24bc8a4aaf803ffbcaef69dd8f)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:14.810599 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894988c-cd6f-41f1-8f4a-9b0e5715e9e3 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:14.865711 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-55125386-3529-4475-b13f-4df093740c27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2dc1451294b47c79e4db3fd4e7c133a'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:14.872444 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 912/1842] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:56:14 2022] DELETE /identity/v3/users/f2dc1451294b47c79e4db3fd4e7c133a => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:14.878623 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773894e-366e-4881-8553-8ee15d0dadcc None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:14.878922 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773894e-366e-4881-8553-8ee15d0dadcc None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:14.879238 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773894e-366e-4881-8553-8ee15d0dadcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:14.897042 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-7773894e-366e-4881-8553-8ee15d0dadcc None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:14.898260 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-7773894e-366e-4881-8553-8ee15d0dadcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:14.959165 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 913/1843] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:56:14.970165 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773894e-366e-4881-8553-8ee15d0dadcc None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:14.971542 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-7773894e-366e-4881-8553-8ee15d0dadcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:15.033855 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773894e-366e-4881-8553-8ee15d0dadcc None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:15.037487 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f53e44-b7e8-4aff-86a0-68f7c5a4e448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:15.038137 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f53e44-b7e8-4aff-86a0-68f7c5a4e448 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:15.038420 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f53e44-b7e8-4aff-86a0-68f7c5a4e448 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:15.038727 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f53e44-b7e8-4aff-86a0-68f7c5a4e448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:15.050015 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f53e44-b7e8-4aff-86a0-68f7c5a4e448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:15.051180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-9894988c-cd6f-41f1-8f4a-9b0e5715e9e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2471bb24bc8a4aaf803ffbcaef69dd8f'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:15.054832 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f53e44-b7e8-4aff-86a0-68f7c5a4e448 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:15.054966 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-9894988c-cd6f-41f1-8f4a-9b0e5715e9e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2471bb24bc8a4aaf803ffbcaef69dd8f'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:15.054966 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-9894988c-cd6f-41f1-8f4a-9b0e5715e9e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2471bb24bc8a4aaf803ffbcaef69dd8f'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:15.065418 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 914/1844] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:56:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:56:15.123812 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-9894988c-cd6f-41f1-8f4a-9b0e5715e9e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2471bb24bc8a4aaf803ffbcaef69dd8f'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:15.130015 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-9894988c-cd6f-41f1-8f4a-9b0e5715e9e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2471bb24bc8a4aaf803ffbcaef69dd8f'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:15.167065 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 931/1845] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:56:14 2022] DELETE /identity/v3/users/2471bb24bc8a4aaf803ffbcaef69dd8f => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:15.171917 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8471eb-1bd3-4b84-9447-6e454b53ded5 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:15.172560 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8471eb-1bd3-4b84-9447-6e454b53ded5 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:15.173265 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8471eb-1bd3-4b84-9447-6e454b53ded5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:15.197708 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-5d8471eb-1bd3-4b84-9447-6e454b53ded5 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:15.199019 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-5d8471eb-1bd3-4b84-9447-6e454b53ded5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:15.261060 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 915/1846] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:56:15.271403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894988c-cd6f-41f1-8f4a-9b0e5715e9e3 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:15.272832 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-9894988c-cd6f-41f1-8f4a-9b0e5715e9e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:15.344617 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894988c-cd6f-41f1-8f4a-9b0e5715e9e3 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:15.344617 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6439e89-5243-4650-a3d5-98d92b4dc742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:15.345108 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6439e89-5243-4650-a3d5-98d92b4dc742 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:15.345548 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6439e89-5243-4650-a3d5-98d92b4dc742 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:15.346654 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6439e89-5243-4650-a3d5-98d92b4dc742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:15.358419 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6439e89-5243-4650-a3d5-98d92b4dc742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:15.360370 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6439e89-5243-4650-a3d5-98d92b4dc742 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:15.373394 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 932/1847] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:56:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:56:15.650609 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8471eb-1bd3-4b84-9447-6e454b53ded5 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:15.652447 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-5d8471eb-1bd3-4b84-9447-6e454b53ded5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:15.672552 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8471eb-1bd3-4b84-9447-6e454b53ded5 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:15.677545 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341c390-8ae1-41d4-9ed8-9be01f21784d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:15.678577 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341c390-8ae1-41d4-9ed8-9be01f21784d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:15.678864 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341c390-8ae1-41d4-9ed8-9be01f21784d admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:15.679136 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341c390-8ae1-41d4-9ed8-9be01f21784d admin admin] PATH_INFO: `/v3/projects/58fd1b0d472049698d044a177acf3ad5` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:15.680479 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341c390-8ae1-41d4-9ed8-9be01f21784d admin admin] RBAC: Authorizing `identity:delete_project(project_id=58fd1b0d472049698d044a177acf3ad5)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:15.682624 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341c390-8ae1-41d4-9ed8-9be01f21784d admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:15.840695 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e341c390-8ae1-41d4-9ed8-9be01f21784d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58fd1b0d472049698d044a177acf3ad5', 'request_id': 'req-e341c390-8ae1-41d4-9ed8-9be01f21784d'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:15.846296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e341c390-8ae1-41d4-9ed8-9be01f21784d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58fd1b0d472049698d044a177acf3ad5', 'request_id': 'req-e341c390-8ae1-41d4-9ed8-9be01f21784d'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:15.952271 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e341c390-8ae1-41d4-9ed8-9be01f21784d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58fd1b0d472049698d044a177acf3ad5', 'request_id': 'req-e341c390-8ae1-41d4-9ed8-9be01f21784d'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:15.965863 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e341c390-8ae1-41d4-9ed8-9be01f21784d admin admin] The token cache is being invalidate because project 58fd1b0d472049698d044a177acf3ad5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:56:15.966151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e341c390-8ae1-41d4-9ed8-9be01f21784d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:15.966860 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e341c390-8ae1-41d4-9ed8-9be01f21784d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:15.968458 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 916/1848] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:56:15 2022] DELETE /identity/v3/projects/58fd1b0d472049698d044a177acf3ad5 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:15.974920 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df3b46-5ff4-473e-a0d5-399ed4eb8bdc None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:15.975438 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df3b46-5ff4-473e-a0d5-399ed4eb8bdc None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:15.975760 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df3b46-5ff4-473e-a0d5-399ed4eb8bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:15.988065 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:15.996229 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-f5df3b46-5ff4-473e-a0d5-399ed4eb8bdc None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:15.997628 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-f5df3b46-5ff4-473e-a0d5-399ed4eb8bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:16.007736 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341c390-8ae1-41d4-9ed8-9be01f21784d admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:16.007736 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-e341c390-8ae1-41d4-9ed8-9be01f21784d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:16.075308 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 933/1849] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:16.084826 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341c390-8ae1-41d4-9ed8-9be01f21784d admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:16.085003 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a132e3-6d85-4484-b651-6cb6db0bc0a7 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:16.085214 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a132e3-6d85-4484-b651-6cb6db0bc0a7 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:16.085550 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a132e3-6d85-4484-b651-6cb6db0bc0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:16.089870 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5501bc-4882-4f4e-8e86-0c991e283d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:16.090732 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5501bc-4882-4f4e-8e86-0c991e283d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:16.091020 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5501bc-4882-4f4e-8e86-0c991e283d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:16.091288 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5501bc-4882-4f4e-8e86-0c991e283d72 admin admin] PATH_INFO: `/v3/projects/c5da98e3d89f4eaca203505e1de5629b` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:16.092507 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5501bc-4882-4f4e-8e86-0c991e283d72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5da98e3d89f4eaca203505e1de5629b)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:16.094575 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5501bc-4882-4f4e-8e86-0c991e283d72 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:16.109882 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-f5a132e3-6d85-4484-b651-6cb6db0bc0a7 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:16.111368 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-f5a132e3-6d85-4484-b651-6cb6db0bc0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:16.119856 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 934/1850] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:56:16.129312 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a132e3-6d85-4484-b651-6cb6db0bc0a7 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:16.138637 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a132e3-6d85-4484-b651-6cb6db0bc0a7 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:16.143938 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31ed8d-734f-47dd-a9ab-aa93f6e0e4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:16.144591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31ed8d-734f-47dd-a9ab-aa93f6e0e4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:16.144879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31ed8d-734f-47dd-a9ab-aa93f6e0e4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:16.145159 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31ed8d-734f-47dd-a9ab-aa93f6e0e4f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:16.145892 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e31ed8d-734f-47dd-a9ab-aa93f6e0e4f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:56:16.146231 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e31ed8d-734f-47dd-a9ab-aa93f6e0e4f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:16.147874 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e31ed8d-734f-47dd-a9ab-aa93f6e0e4f5 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:16.162113 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 935/1851] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 15:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:56:16.166778 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31ed8d-734f-47dd-a9ab-aa93f6e0e4f5 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:16.177602 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31ed8d-734f-47dd-a9ab-aa93f6e0e4f5 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:16.183089 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63b576-0cdb-4756-8411-75f304c77fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:16.184461 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63b576-0cdb-4756-8411-75f304c77fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:16.184742 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63b576-0cdb-4756-8411-75f304c77fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:16.185024 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63b576-0cdb-4756-8411-75f304c77fd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:16.186205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63b576-0cdb-4756-8411-75f304c77fd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:16.188280 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63b576-0cdb-4756-8411-75f304c77fd0 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:16.245397 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-6b5501bc-4882-4f4e-8e86-0c991e283d72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5da98e3d89f4eaca203505e1de5629b', 'request_id': 'req-6b5501bc-4882-4f4e-8e86-0c991e283d72'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:16.253383 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-6b5501bc-4882-4f4e-8e86-0c991e283d72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5da98e3d89f4eaca203505e1de5629b', 'request_id': 'req-6b5501bc-4882-4f4e-8e86-0c991e283d72'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:16.338915 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 936/1852] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:56:16 2022] POST /identity/v3/projects => generated 385 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:56:16.359625 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63b576-0cdb-4756-8411-75f304c77fd0 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:16.391344 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-6b5501bc-4882-4f4e-8e86-0c991e283d72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5da98e3d89f4eaca203505e1de5629b', 'request_id': 'req-6b5501bc-4882-4f4e-8e86-0c991e283d72'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:16.412592 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-6b5501bc-4882-4f4e-8e86-0c991e283d72 admin admin] The token cache is being invalidate because project c5da98e3d89f4eaca203505e1de5629b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:56:16.412961 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-6b5501bc-4882-4f4e-8e86-0c991e283d72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:16.416920 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-6b5501bc-4882-4f4e-8e86-0c991e283d72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:16.421319 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 917/1853] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:56:16 2022] DELETE /identity/v3/projects/c5da98e3d89f4eaca203505e1de5629b => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:56:16.422748 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5501bc-4882-4f4e-8e86-0c991e283d72 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:16.424191 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-6b5501bc-4882-4f4e-8e86-0c991e283d72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:16.495763 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63b576-0cdb-4756-8411-75f304c77fd0 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:16.508211 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e82205-9e11-47bc-a6f7-ca2d0c7714b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:16.509300 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e82205-9e11-47bc-a6f7-ca2d0c7714b1 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:16.510115 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e82205-9e11-47bc-a6f7-ca2d0c7714b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:16.510597 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e82205-9e11-47bc-a6f7-ca2d0c7714b1 admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:16.511773 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e82205-9e11-47bc-a6f7-ca2d0c7714b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:16.514352 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e82205-9e11-47bc-a6f7-ca2d0c7714b1 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:16.519021 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:16.592660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5501bc-4882-4f4e-8e86-0c991e283d72 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:16.610111 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdae52c-b60d-4746-8a99-aa656f592657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:16.612073 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdae52c-b60d-4746-8a99-aa656f592657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:16.612556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdae52c-b60d-4746-8a99-aa656f592657 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:16.613015 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdae52c-b60d-4746-8a99-aa656f592657 admin admin] PATH_INFO: `/v3/users/4a68ae07b08d4fe39b320379579fa8ea` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:16.615540 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdae52c-b60d-4746-8a99-aa656f592657 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a68ae07b08d4fe39b320379579fa8ea)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:16.618940 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdae52c-b60d-4746-8a99-aa656f592657 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:16.642381 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 937/1854] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:56:16 2022] POST /identity/v3/users => generated 293 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:56:16.652617 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e82205-9e11-47bc-a6f7-ca2d0c7714b1 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:16.652617 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-18e82205-9e11-47bc-a6f7-ca2d0c7714b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:16.665609 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e82205-9e11-47bc-a6f7-ca2d0c7714b1 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:16.677584 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16710c5e-0469-4c8e-954f-0cbcdfd1e12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:16.683295 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16710c5e-0469-4c8e-954f-0cbcdfd1e12d admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:16.683295 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16710c5e-0469-4c8e-954f-0cbcdfd1e12d admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:16.683295 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16710c5e-0469-4c8e-954f-0cbcdfd1e12d admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:16.683295 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16710c5e-0469-4c8e-954f-0cbcdfd1e12d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:16.684978 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16710c5e-0469-4c8e-954f-0cbcdfd1e12d admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:16.702566 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 938/1855] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:56:16.707196 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16710c5e-0469-4c8e-954f-0cbcdfd1e12d admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:16.720988 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16710c5e-0469-4c8e-954f-0cbcdfd1e12d admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:16.725964 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48005539-b84c-493b-be8c-0a9871f6db28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:16.726945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48005539-b84c-493b-be8c-0a9871f6db28 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:16.727255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48005539-b84c-493b-be8c-0a9871f6db28 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:16.727560 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48005539-b84c-493b-be8c-0a9871f6db28 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:16.728378 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48005539-b84c-493b-be8c-0a9871f6db28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:16.730928 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48005539-b84c-493b-be8c-0a9871f6db28 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:16.751443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 939/1856] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:56:16.752676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48005539-b84c-493b-be8c-0a9871f6db28 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:16.766589 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48005539-b84c-493b-be8c-0a9871f6db28 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:16.775930 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06f09d-7adb-4638-9392-859ba67a92b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:16.776615 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06f09d-7adb-4638-9392-859ba67a92b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:16.776878 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06f09d-7adb-4638-9392-859ba67a92b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:16.777301 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06f09d-7adb-4638-9392-859ba67a92b5 admin admin] PATH_INFO: `/v3/projects/a96b5fba4c3844da9389e23f016c1479/users/c951fd797a694516ac54a92d26421389/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:16.794509 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06f09d-7adb-4638-9392-859ba67a92b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a96b5fba4c3844da9389e23f016c1479, user_id=c951fd797a694516ac54a92d26421389, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:16.798049 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06f09d-7adb-4638-9392-859ba67a92b5 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:16.976354 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 940/1857] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:56:16 2022] PUT /identity/v3/projects/a96b5fba4c3844da9389e23f016c1479/users/c951fd797a694516ac54a92d26421389/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:16.981815 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7ecbd-f2c7-4d93-b3da-fc1734c8b100 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:16.982114 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7ecbd-f2c7-4d93-b3da-fc1734c8b100 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:16.982395 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7ecbd-f2c7-4d93-b3da-fc1734c8b100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:17.001911 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-fbdae52c-b60d-4746-8a99-aa656f592657 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a68ae07b08d4fe39b320379579fa8ea'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:17.024996 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-07e7ecbd-f2c7-4d93-b3da-fc1734c8b100 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:17.028761 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-07e7ecbd-f2c7-4d93-b3da-fc1734c8b100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:17.030271 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-fbdae52c-b60d-4746-8a99-aa656f592657 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a68ae07b08d4fe39b320379579fa8ea'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:17.033424 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-fbdae52c-b60d-4746-8a99-aa656f592657 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a68ae07b08d4fe39b320379579fa8ea'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:17.079669 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-fbdae52c-b60d-4746-8a99-aa656f592657 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a68ae07b08d4fe39b320379579fa8ea'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:17.129760 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 941/1858] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:17.152399 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7ecbd-f2c7-4d93-b3da-fc1734c8b100 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:17.160654 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-07e7ecbd-f2c7-4d93-b3da-fc1734c8b100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:17.208703 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-fbdae52c-b60d-4746-8a99-aa656f592657 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a68ae07b08d4fe39b320379579fa8ea'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:17.218198 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 918/1859] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:56:16 2022] DELETE /identity/v3/users/4a68ae07b08d4fe39b320379579fa8ea => generated 0 bytes in 796 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:17.277666 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7ecbd-f2c7-4d93-b3da-fc1734c8b100 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:17.352714 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a75f6-a069-4e77-b006-da360b0535cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:17.353416 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a75f6-a069-4e77-b006-da360b0535cd service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:17.353706 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a75f6-a069-4e77-b006-da360b0535cd service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:17.353986 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a75f6-a069-4e77-b006-da360b0535cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:17.356227 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-367a75f6-a069-4e77-b006-da360b0535cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:17.585910 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a75f6-a069-4e77-b006-da360b0535cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:17.585910 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a75f6-a069-4e77-b006-da360b0535cd service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:17.600920 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 942/1860] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:56:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:56:18.055771 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:18.083766 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdae52c-b60d-4746-8a99-aa656f592657 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:18.085493 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-fbdae52c-b60d-4746-8a99-aa656f592657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:18.107988 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdae52c-b60d-4746-8a99-aa656f592657 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:18.125731 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22735c7-98e8-48a5-b3a0-0f424d855df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:18.126902 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22735c7-98e8-48a5-b3a0-0f424d855df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:18.127331 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22735c7-98e8-48a5-b3a0-0f424d855df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:18.127773 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22735c7-98e8-48a5-b3a0-0f424d855df3 admin admin] PATH_INFO: `/v3/projects/c8a5744bae4d48dd8cf09ffd00f04b43` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:18.129157 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22735c7-98e8-48a5-b3a0-0f424d855df3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8a5744bae4d48dd8cf09ffd00f04b43)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:18.131503 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22735c7-98e8-48a5-b3a0-0f424d855df3 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:18.380976 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-b22735c7-98e8-48a5-b3a0-0f424d855df3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8a5744bae4d48dd8cf09ffd00f04b43', 'request_id': 'req-b22735c7-98e8-48a5-b3a0-0f424d855df3'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:18.398766 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-b22735c7-98e8-48a5-b3a0-0f424d855df3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8a5744bae4d48dd8cf09ffd00f04b43', 'request_id': 'req-b22735c7-98e8-48a5-b3a0-0f424d855df3'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:18.488379 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-b22735c7-98e8-48a5-b3a0-0f424d855df3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8a5744bae4d48dd8cf09ffd00f04b43', 'request_id': 'req-b22735c7-98e8-48a5-b3a0-0f424d855df3'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:18.506718 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-b22735c7-98e8-48a5-b3a0-0f424d855df3 admin admin] The token cache is being invalidate because project c8a5744bae4d48dd8cf09ffd00f04b43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:56:18.507798 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-b22735c7-98e8-48a5-b3a0-0f424d855df3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:18.513770 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-b22735c7-98e8-48a5-b3a0-0f424d855df3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:18.520682 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 919/1861] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:56:18 2022] DELETE /identity/v3/projects/c8a5744bae4d48dd8cf09ffd00f04b43 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:18.522212 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1dcd4-271f-4005-8e59-dbecccca1f26 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:18.522659 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1dcd4-271f-4005-8e59-dbecccca1f26 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:18.522820 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1dcd4-271f-4005-8e59-dbecccca1f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:18.549813 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-0bf1dcd4-271f-4005-8e59-dbecccca1f26 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:18.551322 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-0bf1dcd4-271f-4005-8e59-dbecccca1f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:18.660068 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 943/1862] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:56:18.670252 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a171a-e6f7-4354-9955-53ddd5549ba8 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:18.670548 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a171a-e6f7-4354-9955-53ddd5549ba8 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:18.670832 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a171a-e6f7-4354-9955-53ddd5549ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:18.724384 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-c60a171a-e6f7-4354-9955-53ddd5549ba8 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:18.727511 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-c60a171a-e6f7-4354-9955-53ddd5549ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:18.753032 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 920/1863] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:18.753782 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1dcd4-271f-4005-8e59-dbecccca1f26 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:18.774979 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1dcd4-271f-4005-8e59-dbecccca1f26 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:18.785108 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53fa26-4465-48a6-a637-1d50d89196df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:18.785864 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53fa26-4465-48a6-a637-1d50d89196df admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:18.786145 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53fa26-4465-48a6-a637-1d50d89196df admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:18.786432 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53fa26-4465-48a6-a637-1d50d89196df admin admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:18.787411 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53fa26-4465-48a6-a637-1d50d89196df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:56:18.787574 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53fa26-4465-48a6-a637-1d50d89196df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:18.789442 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53fa26-4465-48a6-a637-1d50d89196df admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:18.807278 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 944/1864] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 15:56:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:56:18.808551 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a171a-e6f7-4354-9955-53ddd5549ba8 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:18.820879 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a171a-e6f7-4354-9955-53ddd5549ba8 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:18.829317 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327e31a-9adf-4948-9fef-9e8ab4613a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:18.830153 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327e31a-9adf-4948-9fef-9e8ab4613a16 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:18.830445 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327e31a-9adf-4948-9fef-9e8ab4613a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:18.830726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327e31a-9adf-4948-9fef-9e8ab4613a16 admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:18.831511 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a327e31a-9adf-4948-9fef-9e8ab4613a16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:18.833610 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a327e31a-9adf-4948-9fef-9e8ab4613a16 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:18.981755 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 921/1865] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:56:18 2022] POST /identity/v3/projects => generated 355 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:56:18.989272 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53fa26-4465-48a6-a637-1d50d89196df admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:19.016140 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53fa26-4465-48a6-a637-1d50d89196df admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:19.132069 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13dcf0-5e3c-46eb-be38-6f48d53ad8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:19.133235 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13dcf0-5e3c-46eb-be38-6f48d53ad8c2 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:19.133528 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13dcf0-5e3c-46eb-be38-6f48d53ad8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:19.134207 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13dcf0-5e3c-46eb-be38-6f48d53ad8c2 admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:19.139979 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13dcf0-5e3c-46eb-be38-6f48d53ad8c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:19.139979 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13dcf0-5e3c-46eb-be38-6f48d53ad8c2 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:19.162953 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:19.314326 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327e31a-9adf-4948-9fef-9e8ab4613a16 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:19.314853 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 945/1866] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:56:18 2022] POST /identity/v3/users => generated 278 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:56:19.333439 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327e31a-9adf-4948-9fef-9e8ab4613a16 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:19.357151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7422fd8-6e37-4209-8a49-416b000f5358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:19.358139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7422fd8-6e37-4209-8a49-416b000f5358 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:19.358581 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7422fd8-6e37-4209-8a49-416b000f5358 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:19.360297 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7422fd8-6e37-4209-8a49-416b000f5358 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:19.361353 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7422fd8-6e37-4209-8a49-416b000f5358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:19.368880 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7422fd8-6e37-4209-8a49-416b000f5358 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:19.403546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13dcf0-5e3c-46eb-be38-6f48d53ad8c2 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:19.412227 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 922/1867] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:56:19.437807 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13dcf0-5e3c-46eb-be38-6f48d53ad8c2 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:19.456899 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622db85e-3b43-485c-bd7d-2992d5267532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:19.457934 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622db85e-3b43-485c-bd7d-2992d5267532 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:19.461669 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622db85e-3b43-485c-bd7d-2992d5267532 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:19.461669 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622db85e-3b43-485c-bd7d-2992d5267532 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:19.461669 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622db85e-3b43-485c-bd7d-2992d5267532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:19.463551 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622db85e-3b43-485c-bd7d-2992d5267532 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:19.493964 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7422fd8-6e37-4209-8a49-416b000f5358 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:19.506667 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 946/1868] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:56:19.508250 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7422fd8-6e37-4209-8a49-416b000f5358 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:19.514354 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f215fa-b65d-4b08-8f19-c728c2a28ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:19.516869 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f215fa-b65d-4b08-8f19-c728c2a28ce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:19.516990 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f215fa-b65d-4b08-8f19-c728c2a28ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:19.517234 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f215fa-b65d-4b08-8f19-c728c2a28ce3 admin admin] PATH_INFO: `/v3/projects/1df55cc04c8f4b9896434d30a3b60c1a/users/b16c609f2f5f471398a25b3242b0fc72/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:19.537834 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f215fa-b65d-4b08-8f19-c728c2a28ce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1df55cc04c8f4b9896434d30a3b60c1a, user_id=b16c609f2f5f471398a25b3242b0fc72, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:19.540637 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f215fa-b65d-4b08-8f19-c728c2a28ce3 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:19.650872 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 923/1869] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:56:19 2022] PUT /identity/v3/projects/1df55cc04c8f4b9896434d30a3b60c1a/users/b16c609f2f5f471398a25b3242b0fc72/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:19.666042 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252766de-1678-4c11-bc71-4f02eb8ee498 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:19.668297 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252766de-1678-4c11-bc71-4f02eb8ee498 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:19.671730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252766de-1678-4c11-bc71-4f02eb8ee498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:19.705539 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-252766de-1678-4c11-bc71-4f02eb8ee498 None None] MFA Rules not processed for user `b16c609f2f5f471398a25b3242b0fc72`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:19.707393 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-252766de-1678-4c11-bc71-4f02eb8ee498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:19.766461 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:19.807640 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 947/1870] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:19 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:19.811344 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f215fa-b65d-4b08-8f19-c728c2a28ce3 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:19.913136 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f215fa-b65d-4b08-8f19-c728c2a28ce3 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:19.930676 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161d110-8914-4ac7-8980-a1866df1597f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:19.931476 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161d110-8914-4ac7-8980-a1866df1597f admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:19.931879 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161d110-8914-4ac7-8980-a1866df1597f admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:19.932253 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161d110-8914-4ac7-8980-a1866df1597f admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:19.933072 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161d110-8914-4ac7-8980-a1866df1597f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:19.936115 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161d110-8914-4ac7-8980-a1866df1597f admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:20.059625 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 924/1871] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:56:19 2022] POST /identity/v3/projects => generated 357 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:56:20.059858 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252766de-1678-4c11-bc71-4f02eb8ee498 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:20.073677 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252766de-1678-4c11-bc71-4f02eb8ee498 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:20.149190 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ae881-13ca-4ec3-bae4-9c95685bb8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:20.149873 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ae881-13ca-4ec3-bae4-9c95685bb8aa admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:20.150162 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ae881-13ca-4ec3-bae4-9c95685bb8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:20.150434 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ae881-13ca-4ec3-bae4-9c95685bb8aa admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:20.151135 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ae881-13ca-4ec3-bae4-9c95685bb8aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:20.153506 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ae881-13ca-4ec3-bae4-9c95685bb8aa admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:20.255254 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 948/1872] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:56:20 2022] POST /identity/v3/users => generated 285 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:56:20.256601 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161d110-8914-4ac7-8980-a1866df1597f admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:20.267961 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161d110-8914-4ac7-8980-a1866df1597f admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:20.273050 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab288d4d-bc4c-4c5b-99b3-ae4c259c37e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:20.273741 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab288d4d-bc4c-4c5b-99b3-ae4c259c37e9 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:20.274033 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab288d4d-bc4c-4c5b-99b3-ae4c259c37e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:20.274313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab288d4d-bc4c-4c5b-99b3-ae4c259c37e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:20.275077 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab288d4d-bc4c-4c5b-99b3-ae4c259c37e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:20.276904 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab288d4d-bc4c-4c5b-99b3-ae4c259c37e9 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:20.288147 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 925/1873] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:56:20.292501 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ae881-13ca-4ec3-bae4-9c95685bb8aa admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:20.303644 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ae881-13ca-4ec3-bae4-9c95685bb8aa admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:20.309690 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e959d-42b8-4a37-b7d4-5de5cfbac4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:20.309690 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e959d-42b8-4a37-b7d4-5de5cfbac4c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:20.309690 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e959d-42b8-4a37-b7d4-5de5cfbac4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:20.310446 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e959d-42b8-4a37-b7d4-5de5cfbac4c1 admin admin] PATH_INFO: `/v3/projects/2f10c831d1664dd1bd72ed2a377d8af8/users/e989792ae96b4b1eaf432e50baec3c4d/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:20.326353 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e959d-42b8-4a37-b7d4-5de5cfbac4c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f10c831d1664dd1bd72ed2a377d8af8, user_id=e989792ae96b4b1eaf432e50baec3c4d, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:20.329504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e959d-42b8-4a37-b7d4-5de5cfbac4c1 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:20.429167 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 949/1874] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:56:20 2022] PUT /identity/v3/projects/2f10c831d1664dd1bd72ed2a377d8af8/users/e989792ae96b4b1eaf432e50baec3c4d/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:20.432413 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab288d4d-bc4c-4c5b-99b3-ae4c259c37e9 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:20.444600 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab288d4d-bc4c-4c5b-99b3-ae4c259c37e9 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:20.507357 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf56997-ddbb-417c-bac0-ffc11e1994a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:20.509137 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf56997-ddbb-417c-bac0-ffc11e1994a4 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:20.509137 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf56997-ddbb-417c-bac0-ffc11e1994a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:20.509137 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf56997-ddbb-417c-bac0-ffc11e1994a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:20.509576 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf56997-ddbb-417c-bac0-ffc11e1994a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:20.511278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf56997-ddbb-417c-bac0-ffc11e1994a4 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:20.526210 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 926/1875] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:56:20.527883 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e959d-42b8-4a37-b7d4-5de5cfbac4c1 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:20.539726 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e959d-42b8-4a37-b7d4-5de5cfbac4c1 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:20.544793 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72e5a3-5d6a-418d-aefb-cb3ce720ed32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:20.545791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72e5a3-5d6a-418d-aefb-cb3ce720ed32 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:20.546134 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72e5a3-5d6a-418d-aefb-cb3ce720ed32 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:20.547310 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72e5a3-5d6a-418d-aefb-cb3ce720ed32 admin admin] PATH_INFO: `/v3/projects/2f10c831d1664dd1bd72ed2a377d8af8/users/e989792ae96b4b1eaf432e50baec3c4d/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:20.549643 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72e5a3-5d6a-418d-aefb-cb3ce720ed32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f10c831d1664dd1bd72ed2a377d8af8, user_id=e989792ae96b4b1eaf432e50baec3c4d, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:20.552579 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72e5a3-5d6a-418d-aefb-cb3ce720ed32 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:20.576998 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 950/1876] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:56:20 2022] PUT /identity/v3/projects/2f10c831d1664dd1bd72ed2a377d8af8/users/e989792ae96b4b1eaf432e50baec3c4d/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:20.578729 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3ec7c-d5af-41cd-b18a-82436eac7807 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:20.579025 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3ec7c-d5af-41cd-b18a-82436eac7807 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:20.579303 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3ec7c-d5af-41cd-b18a-82436eac7807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:20.619648 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-ebc3ec7c-d5af-41cd-b18a-82436eac7807 None None] MFA Rules not processed for user `e989792ae96b4b1eaf432e50baec3c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:20.621428 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-ebc3ec7c-d5af-41cd-b18a-82436eac7807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:20.747294 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 927/1877] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:20 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:20.760737 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72e5a3-5d6a-418d-aefb-cb3ce720ed32 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:20.762614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-2f72e5a3-5d6a-418d-aefb-cb3ce720ed32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:20.829329 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72e5a3-5d6a-418d-aefb-cb3ce720ed32 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:20.833587 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3677e1b-5375-407c-965f-22d5ce5182c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:20.834365 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3677e1b-5375-407c-965f-22d5ce5182c8 service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:20.834747 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3677e1b-5375-407c-965f-22d5ce5182c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:20.835168 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3677e1b-5375-407c-965f-22d5ce5182c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:20.846337 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3677e1b-5375-407c-965f-22d5ce5182c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:20.847949 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3677e1b-5375-407c-965f-22d5ce5182c8 service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:20.858213 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 951/1878] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:56:20 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:56:21.081700 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3ec7c-d5af-41cd-b18a-82436eac7807 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:21.096330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3ec7c-d5af-41cd-b18a-82436eac7807 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:21.104011 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44af94-1f75-4300-961b-9fb33e793a72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:21.104675 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44af94-1f75-4300-961b-9fb33e793a72 service cinder] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:21.104965 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44af94-1f75-4300-961b-9fb33e793a72 service cinder] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:21.105239 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44af94-1f75-4300-961b-9fb33e793a72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:21.242690 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44af94-1f75-4300-961b-9fb33e793a72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:21.245654 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44af94-1f75-4300-961b-9fb33e793a72 service cinder] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:21.260779 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 928/1879] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:56:21 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:56:21.285870 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:21.946154 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:23.110043 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:24.083442 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:25.489254 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3677e1b-5375-407c-965f-22d5ce5182c8 service cinder] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:25.490787 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-a3677e1b-5375-407c-965f-22d5ce5182c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:25.628221 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3677e1b-5375-407c-965f-22d5ce5182c8 service cinder] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:25.633348 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d79be3-28f2-4f77-94db-1dc1f4c2f6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:25.634618 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d79be3-28f2-4f77-94db-1dc1f4c2f6ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:25.635050 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d79be3-28f2-4f77-94db-1dc1f4c2f6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:25.635562 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d79be3-28f2-4f77-94db-1dc1f4c2f6ee admin admin] PATH_INFO: `/v3/users/57856abec0aa4eb7ba9a5629f1fbbfa4` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:25.638567 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d79be3-28f2-4f77-94db-1dc1f4c2f6ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=57856abec0aa4eb7ba9a5629f1fbbfa4)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:25.641435 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d79be3-28f2-4f77-94db-1dc1f4c2f6ee admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:25.924715 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-94d79be3-28f2-4f77-94db-1dc1f4c2f6ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57856abec0aa4eb7ba9a5629f1fbbfa4'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:25.925687 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-94d79be3-28f2-4f77-94db-1dc1f4c2f6ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57856abec0aa4eb7ba9a5629f1fbbfa4'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:25.927034 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-94d79be3-28f2-4f77-94db-1dc1f4c2f6ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57856abec0aa4eb7ba9a5629f1fbbfa4'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:26.022442 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-94d79be3-28f2-4f77-94db-1dc1f4c2f6ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57856abec0aa4eb7ba9a5629f1fbbfa4'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:26.030381 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-94d79be3-28f2-4f77-94db-1dc1f4c2f6ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57856abec0aa4eb7ba9a5629f1fbbfa4'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:26.053478 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 952/1880] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:56:25 2022] DELETE /identity/v3/users/57856abec0aa4eb7ba9a5629f1fbbfa4 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:26.055370 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30b1d1-27c6-4b61-ae8d-1867fb2016d9 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:26.055833 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30b1d1-27c6-4b61-ae8d-1867fb2016d9 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:26.056061 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30b1d1-27c6-4b61-ae8d-1867fb2016d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:26.077070 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-aa30b1d1-27c6-4b61-ae8d-1867fb2016d9 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:26.078879 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-aa30b1d1-27c6-4b61-ae8d-1867fb2016d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:26.143982 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 929/1881] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:56:26.157335 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d79be3-28f2-4f77-94db-1dc1f4c2f6ee admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:26.158754 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-94d79be3-28f2-4f77-94db-1dc1f4c2f6ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:26.240957 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d79be3-28f2-4f77-94db-1dc1f4c2f6ee admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:26.245128 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47731684-acce-4be7-b371-b1c2b932025f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:26.245827 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47731684-acce-4be7-b371-b1c2b932025f service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:26.246117 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47731684-acce-4be7-b371-b1c2b932025f service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:26.246399 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47731684-acce-4be7-b371-b1c2b932025f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:26.256607 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47731684-acce-4be7-b371-b1c2b932025f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:26.257990 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47731684-acce-4be7-b371-b1c2b932025f service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:26.268890 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 953/1882] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:56:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:56:26.423356 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:26.855439 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:27.284812 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30b1d1-27c6-4b61-ae8d-1867fb2016d9 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:27.286769 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-aa30b1d1-27c6-4b61-ae8d-1867fb2016d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:27.318506 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30b1d1-27c6-4b61-ae8d-1867fb2016d9 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:27.324970 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806dbe2-e3bd-4788-81a8-572682d3968f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:27.325886 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806dbe2-e3bd-4788-81a8-572682d3968f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:27.326336 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806dbe2-e3bd-4788-81a8-572682d3968f admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:27.326910 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806dbe2-e3bd-4788-81a8-572682d3968f admin admin] PATH_INFO: `/v3/projects/e43169c661c64871bd021c9adacae008` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:27.329119 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806dbe2-e3bd-4788-81a8-572682d3968f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e43169c661c64871bd021c9adacae008)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:27.331245 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806dbe2-e3bd-4788-81a8-572682d3968f admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:27.454344 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-6806dbe2-e3bd-4788-81a8-572682d3968f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e43169c661c64871bd021c9adacae008', 'request_id': 'req-6806dbe2-e3bd-4788-81a8-572682d3968f'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:27.462175 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-6806dbe2-e3bd-4788-81a8-572682d3968f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e43169c661c64871bd021c9adacae008', 'request_id': 'req-6806dbe2-e3bd-4788-81a8-572682d3968f'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:27.565764 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-6806dbe2-e3bd-4788-81a8-572682d3968f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e43169c661c64871bd021c9adacae008', 'request_id': 'req-6806dbe2-e3bd-4788-81a8-572682d3968f'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:27.565950 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11e22f-7644-4524-b0fc-b83b7b98f739 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:27.566206 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11e22f-7644-4524-b0fc-b83b7b98f739 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:27.566479 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11e22f-7644-4524-b0fc-b83b7b98f739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:27.583869 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-6806dbe2-e3bd-4788-81a8-572682d3968f admin admin] The token cache is being invalidate because project e43169c661c64871bd021c9adacae008 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:56:27.584621 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-6806dbe2-e3bd-4788-81a8-572682d3968f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:27.585854 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-6806dbe2-e3bd-4788-81a8-572682d3968f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:27.588455 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 930/1883] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:56:27 2022] DELETE /identity/v3/projects/e43169c661c64871bd021c9adacae008 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:56:27.594005 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806dbe2-e3bd-4788-81a8-572682d3968f admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:27.596019 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-6806dbe2-e3bd-4788-81a8-572682d3968f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:27.623337 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-8d11e22f-7644-4524-b0fc-b83b7b98f739 None None] MFA Rules not processed for user `c951fd797a694516ac54a92d26421389`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:27.625339 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-8d11e22f-7644-4524-b0fc-b83b7b98f739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:27.747243 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 954/1884] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:56:27.752183 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11e22f-7644-4524-b0fc-b83b7b98f739 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:27.753705 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-8d11e22f-7644-4524-b0fc-b83b7b98f739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:27.847635 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806dbe2-e3bd-4788-81a8-572682d3968f admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:27.862605 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11e22f-7644-4524-b0fc-b83b7b98f739 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:27.865609 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0a581-3359-4533-b360-7d101a548644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:27.867976 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0a581-3359-4533-b360-7d101a548644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:27.868365 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0a581-3359-4533-b360-7d101a548644 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:27.870115 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0a581-3359-4533-b360-7d101a548644 admin admin] PATH_INFO: `/v3/users/4ba5922746d74901a685a6823117d439` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:27.881457 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72895a15-5a54-4664-bd7d-b1df5c3fbef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:27.882523 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72895a15-5a54-4664-bd7d-b1df5c3fbef5 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:27.883105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72895a15-5a54-4664-bd7d-b1df5c3fbef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:27.883637 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72895a15-5a54-4664-bd7d-b1df5c3fbef5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:27.891782 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72895a15-5a54-4664-bd7d-b1df5c3fbef5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:27.892023 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0a581-3359-4533-b360-7d101a548644 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ba5922746d74901a685a6823117d439)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:27.892103 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72895a15-5a54-4664-bd7d-b1df5c3fbef5 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:27.900984 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0a581-3359-4533-b360-7d101a548644 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:28.092361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 955/1885] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:56:27 2022] POST /identity/v3/projects => generated 385 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:56:28.094713 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72895a15-5a54-4664-bd7d-b1df5c3fbef5 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:28.150144 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-2ef0a581-3359-4533-b360-7d101a548644 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ba5922746d74901a685a6823117d439'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:28.172361 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-2ef0a581-3359-4533-b360-7d101a548644 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ba5922746d74901a685a6823117d439'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:28.172361 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-2ef0a581-3359-4533-b360-7d101a548644 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ba5922746d74901a685a6823117d439'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:28.196870 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-2ef0a581-3359-4533-b360-7d101a548644 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ba5922746d74901a685a6823117d439'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:28.212727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72895a15-5a54-4664-bd7d-b1df5c3fbef5 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:28.220893 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77635e0-8fd0-4e4c-b23a-aaa569eff98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:28.221663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77635e0-8fd0-4e4c-b23a-aaa569eff98c admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:28.223713 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77635e0-8fd0-4e4c-b23a-aaa569eff98c admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:28.223713 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77635e0-8fd0-4e4c-b23a-aaa569eff98c admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:28.225831 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77635e0-8fd0-4e4c-b23a-aaa569eff98c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:28.228165 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77635e0-8fd0-4e4c-b23a-aaa569eff98c admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:28.275458 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-2ef0a581-3359-4533-b360-7d101a548644 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ba5922746d74901a685a6823117d439'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:28.287991 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 931/1886] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:56:27 2022] DELETE /identity/v3/users/4ba5922746d74901a685a6823117d439 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:28.364155 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 956/1887] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:56:28 2022] POST /identity/v3/users => generated 299 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:56:28.367877 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0a581-3359-4533-b360-7d101a548644 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:28.370364 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-2ef0a581-3359-4533-b360-7d101a548644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:28.453593 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0a581-3359-4533-b360-7d101a548644 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:28.458643 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7041c9-7fee-4686-a902-f7b205be0a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:28.459765 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7041c9-7fee-4686-a902-f7b205be0a38 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:28.460326 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7041c9-7fee-4686-a902-f7b205be0a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:28.460691 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7041c9-7fee-4686-a902-f7b205be0a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:28.461564 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7041c9-7fee-4686-a902-f7b205be0a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:28.464214 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7041c9-7fee-4686-a902-f7b205be0a38 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:28.477550 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 932/1888] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:56:28.486549 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77635e0-8fd0-4e4c-b23a-aaa569eff98c admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:28.505031 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77635e0-8fd0-4e4c-b23a-aaa569eff98c admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:28.510012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281aec4-7eb9-48af-9de0-147b3d06146b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:28.510917 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281aec4-7eb9-48af-9de0-147b3d06146b admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:28.511210 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281aec4-7eb9-48af-9de0-147b3d06146b admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:28.511491 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281aec4-7eb9-48af-9de0-147b3d06146b admin admin] PATH_INFO: `/v3/projects/55a7c00510cc4ef680e6e9fa775cc10e/users/343e1424c43543218f790516acc3976a/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:28.544884 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281aec4-7eb9-48af-9de0-147b3d06146b admin admin] RBAC: Authorizing `identity:create_grant(project_id=55a7c00510cc4ef680e6e9fa775cc10e, user_id=343e1424c43543218f790516acc3976a, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:28.549387 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281aec4-7eb9-48af-9de0-147b3d06146b admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:28.668908 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 957/1889] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:56:28 2022] PUT /identity/v3/projects/55a7c00510cc4ef680e6e9fa775cc10e/users/343e1424c43543218f790516acc3976a/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:28.675144 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7041c9-7fee-4686-a902-f7b205be0a38 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:28.685436 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7041c9-7fee-4686-a902-f7b205be0a38 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:28.693206 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:28.744820 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98de5ff-9085-4a97-a96b-39eb8f82f7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:28.745493 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98de5ff-9085-4a97-a96b-39eb8f82f7db admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:28.745818 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98de5ff-9085-4a97-a96b-39eb8f82f7db admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:28.746094 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98de5ff-9085-4a97-a96b-39eb8f82f7db admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:28.746819 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98de5ff-9085-4a97-a96b-39eb8f82f7db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:28.748477 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98de5ff-9085-4a97-a96b-39eb8f82f7db admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:28.758940 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 933/1890] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:56:28.763107 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281aec4-7eb9-48af-9de0-147b3d06146b admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:28.774087 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281aec4-7eb9-48af-9de0-147b3d06146b admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:28.779350 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f06596-1b0f-4b26-b27e-6ba43a7525ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:28.779830 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f06596-1b0f-4b26-b27e-6ba43a7525ef admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:28.780123 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f06596-1b0f-4b26-b27e-6ba43a7525ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:28.780405 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f06596-1b0f-4b26-b27e-6ba43a7525ef admin admin] PATH_INFO: `/v3/projects/55a7c00510cc4ef680e6e9fa775cc10e/users/343e1424c43543218f790516acc3976a/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:28.782681 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f06596-1b0f-4b26-b27e-6ba43a7525ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=55a7c00510cc4ef680e6e9fa775cc10e, user_id=343e1424c43543218f790516acc3976a, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:28.785403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f06596-1b0f-4b26-b27e-6ba43a7525ef admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:28.800633 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 958/1891] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:56:28 2022] PUT /identity/v3/projects/55a7c00510cc4ef680e6e9fa775cc10e/users/343e1424c43543218f790516acc3976a/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:28.818601 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98de5ff-9085-4a97-a96b-39eb8f82f7db admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:28.820692 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-a98de5ff-9085-4a97-a96b-39eb8f82f7db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:28.836013 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98de5ff-9085-4a97-a96b-39eb8f82f7db admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:28.899680 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95122b5-02f3-4a3c-bad4-210fffeda70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:28.900697 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95122b5-02f3-4a3c-bad4-210fffeda70c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:28.900964 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95122b5-02f3-4a3c-bad4-210fffeda70c admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:28.901424 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95122b5-02f3-4a3c-bad4-210fffeda70c admin admin] PATH_INFO: `/v3/projects/b8bf506deb0f4aceaf98d6927b5e083a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:28.902632 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95122b5-02f3-4a3c-bad4-210fffeda70c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8bf506deb0f4aceaf98d6927b5e083a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:28.904580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95122b5-02f3-4a3c-bad4-210fffeda70c admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:29.023000 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-f95122b5-02f3-4a3c-bad4-210fffeda70c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8bf506deb0f4aceaf98d6927b5e083a', 'request_id': 'req-f95122b5-02f3-4a3c-bad4-210fffeda70c'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:29.028375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-f95122b5-02f3-4a3c-bad4-210fffeda70c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8bf506deb0f4aceaf98d6927b5e083a', 'request_id': 'req-f95122b5-02f3-4a3c-bad4-210fffeda70c'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:29.108405 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-f95122b5-02f3-4a3c-bad4-210fffeda70c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8bf506deb0f4aceaf98d6927b5e083a', 'request_id': 'req-f95122b5-02f3-4a3c-bad4-210fffeda70c'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:29.126065 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-f95122b5-02f3-4a3c-bad4-210fffeda70c admin admin] The token cache is being invalidate because project b8bf506deb0f4aceaf98d6927b5e083a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:56:29.126671 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-f95122b5-02f3-4a3c-bad4-210fffeda70c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:29.127514 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-f95122b5-02f3-4a3c-bad4-210fffeda70c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:29.133317 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 934/1892] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:56:28 2022] DELETE /identity/v3/projects/b8bf506deb0f4aceaf98d6927b5e083a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:29.135034 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6483a-1b18-490f-95e9-9dad160552dd None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:29.135530 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6483a-1b18-490f-95e9-9dad160552dd None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:29.135732 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6483a-1b18-490f-95e9-9dad160552dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:29.155539 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-a1e6483a-1b18-490f-95e9-9dad160552dd None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:29.157605 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-a1e6483a-1b18-490f-95e9-9dad160552dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:29.252396 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 959/1893] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:29.255407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4d0f9-ab83-4570-932b-5395c59b3082 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:29.255915 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4d0f9-ab83-4570-932b-5395c59b3082 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:29.258385 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4d0f9-ab83-4570-932b-5395c59b3082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:29.280151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-71c4d0f9-ab83-4570-932b-5395c59b3082 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:29.281976 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-71c4d0f9-ab83-4570-932b-5395c59b3082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:29.296956 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6483a-1b18-490f-95e9-9dad160552dd None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:29.308356 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 935/1894] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:29.323358 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6483a-1b18-490f-95e9-9dad160552dd None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:29.327025 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:29.336249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca01f4c-2749-4e51-ab20-dd51feacfbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:29.337236 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca01f4c-2749-4e51-ab20-dd51feacfbda admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:29.337236 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca01f4c-2749-4e51-ab20-dd51feacfbda admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:29.337540 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca01f4c-2749-4e51-ab20-dd51feacfbda admin admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:29.338321 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca01f4c-2749-4e51-ab20-dd51feacfbda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:56:29.338635 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca01f4c-2749-4e51-ab20-dd51feacfbda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:29.345874 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca01f4c-2749-4e51-ab20-dd51feacfbda admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:29.373193 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 960/1895] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 15:56:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:56:29.374454 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4d0f9-ab83-4570-932b-5395c59b3082 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:29.385165 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4d0f9-ab83-4570-932b-5395c59b3082 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:29.400470 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16925aee-bf61-4c6e-96d7-eb464b7bea27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:29.405633 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16925aee-bf61-4c6e-96d7-eb464b7bea27 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:29.405633 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16925aee-bf61-4c6e-96d7-eb464b7bea27 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:29.405633 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16925aee-bf61-4c6e-96d7-eb464b7bea27 admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:29.405633 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16925aee-bf61-4c6e-96d7-eb464b7bea27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:29.407373 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16925aee-bf61-4c6e-96d7-eb464b7bea27 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:29.549899 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 936/1896] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:56:29 2022] POST /identity/v3/projects => generated 375 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:56:29.554052 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca01f4c-2749-4e51-ab20-dd51feacfbda admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:29.564788 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca01f4c-2749-4e51-ab20-dd51feacfbda admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:29.630459 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef09f42-e5ac-4d57-890c-a8b728f37f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:29.631286 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef09f42-e5ac-4d57-890c-a8b728f37f7f admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:29.631706 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef09f42-e5ac-4d57-890c-a8b728f37f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:29.632086 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef09f42-e5ac-4d57-890c-a8b728f37f7f admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:29.633098 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef09f42-e5ac-4d57-890c-a8b728f37f7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:29.635265 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef09f42-e5ac-4d57-890c-a8b728f37f7f admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:29.744241 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 961/1897] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:56:29 2022] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:56:29.747938 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16925aee-bf61-4c6e-96d7-eb464b7bea27 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:29.761984 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16925aee-bf61-4c6e-96d7-eb464b7bea27 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:29.777665 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d914ee5-ed33-4030-b7b9-5d48fa2d67fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:29.778576 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d914ee5-ed33-4030-b7b9-5d48fa2d67fa admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:29.778874 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d914ee5-ed33-4030-b7b9-5d48fa2d67fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:29.779267 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d914ee5-ed33-4030-b7b9-5d48fa2d67fa admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:29.780130 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d914ee5-ed33-4030-b7b9-5d48fa2d67fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:29.783902 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d914ee5-ed33-4030-b7b9-5d48fa2d67fa admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:29.802051 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 937/1898] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:56:29.805833 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef09f42-e5ac-4d57-890c-a8b728f37f7f admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:29.818619 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef09f42-e5ac-4d57-890c-a8b728f37f7f admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:29.824906 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf2963-effe-42d7-b0cd-c6bdd1d217b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:29.841377 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf2963-effe-42d7-b0cd-c6bdd1d217b7 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:29.842983 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf2963-effe-42d7-b0cd-c6bdd1d217b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:29.847398 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf2963-effe-42d7-b0cd-c6bdd1d217b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:29.847398 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf2963-effe-42d7-b0cd-c6bdd1d217b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:29.849638 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf2963-effe-42d7-b0cd-c6bdd1d217b7 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:29.864972 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 962/1899] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:56:29.869063 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d914ee5-ed33-4030-b7b9-5d48fa2d67fa admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:29.886834 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d914ee5-ed33-4030-b7b9-5d48fa2d67fa admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:29.893698 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d306c-cb03-4814-b66a-701a41d13703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:29.895143 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d306c-cb03-4814-b66a-701a41d13703 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:29.895540 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d306c-cb03-4814-b66a-701a41d13703 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:29.895852 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d306c-cb03-4814-b66a-701a41d13703 admin admin] PATH_INFO: `/v3/projects/c2acc6945e8c477f803253d01b0db927/users/31687967e02845a4853f70ee042aab0e/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:29.915848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d306c-cb03-4814-b66a-701a41d13703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2acc6945e8c477f803253d01b0db927, user_id=31687967e02845a4853f70ee042aab0e, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:29.920793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d306c-cb03-4814-b66a-701a41d13703 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:30.024670 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 938/1900] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:56:29 2022] PUT /identity/v3/projects/c2acc6945e8c477f803253d01b0db927/users/31687967e02845a4853f70ee042aab0e/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:56:30.035566 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0f545-9e81-440f-8dc3-c87f86b6d86e None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:30.035976 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0f545-9e81-440f-8dc3-c87f86b6d86e None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:30.036331 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0f545-9e81-440f-8dc3-c87f86b6d86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:30.071765 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-fcf0f545-9e81-440f-8dc3-c87f86b6d86e None None] MFA Rules not processed for user `31687967e02845a4853f70ee042aab0e`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:30.073259 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-fcf0f545-9e81-440f-8dc3-c87f86b6d86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:30.171054 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 963/1901] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:30.175743 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d306c-cb03-4814-b66a-701a41d13703 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:30.258929 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d306c-cb03-4814-b66a-701a41d13703 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:30.263773 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af1bef-8185-44e3-87eb-99e2cb0581c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:30.264431 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af1bef-8185-44e3-87eb-99e2cb0581c5 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:30.264712 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af1bef-8185-44e3-87eb-99e2cb0581c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:30.265509 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af1bef-8185-44e3-87eb-99e2cb0581c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:30.266215 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af1bef-8185-44e3-87eb-99e2cb0581c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:30.268247 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af1bef-8185-44e3-87eb-99e2cb0581c5 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:30.415910 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 939/1902] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:56:30 2022] POST /identity/v3/projects => generated 377 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:56:30.420407 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0f545-9e81-440f-8dc3-c87f86b6d86e None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:30.438960 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0f545-9e81-440f-8dc3-c87f86b6d86e None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:30.519181 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501286f-4281-4492-8a74-8882f8f897d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:30.519913 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501286f-4281-4492-8a74-8882f8f897d9 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:30.520254 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501286f-4281-4492-8a74-8882f8f897d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:30.520622 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501286f-4281-4492-8a74-8882f8f897d9 admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:30.521361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501286f-4281-4492-8a74-8882f8f897d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:30.524120 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501286f-4281-4492-8a74-8882f8f897d9 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:30.661766 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 964/1903] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:56:30 2022] POST /identity/v3/users => generated 295 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:56:30.664510 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af1bef-8185-44e3-87eb-99e2cb0581c5 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:30.685552 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af1bef-8185-44e3-87eb-99e2cb0581c5 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:30.692359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70d341-11fa-48c4-a07c-f6e88b50ad73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:30.693043 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70d341-11fa-48c4-a07c-f6e88b50ad73 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:30.693316 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70d341-11fa-48c4-a07c-f6e88b50ad73 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:30.693589 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70d341-11fa-48c4-a07c-f6e88b50ad73 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:30.694318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e70d341-11fa-48c4-a07c-f6e88b50ad73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:30.696794 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e70d341-11fa-48c4-a07c-f6e88b50ad73 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:30.709006 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 940/1904] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:56:30.713337 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501286f-4281-4492-8a74-8882f8f897d9 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:30.726596 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501286f-4281-4492-8a74-8882f8f897d9 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:30.734707 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed95a84-8a68-4441-9545-918a33179309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:30.736265 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed95a84-8a68-4441-9545-918a33179309 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:30.736718 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed95a84-8a68-4441-9545-918a33179309 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:30.737147 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed95a84-8a68-4441-9545-918a33179309 admin admin] PATH_INFO: `/v3/projects/499e4e126b404be3b3cd361856ddf9a7/users/9239ee6c66af46ad9c4b3d4425d63eae/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:30.759010 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed95a84-8a68-4441-9545-918a33179309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=499e4e126b404be3b3cd361856ddf9a7, user_id=9239ee6c66af46ad9c4b3d4425d63eae, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:30.762319 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed95a84-8a68-4441-9545-918a33179309 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:30.949715 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 965/1905] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:56:30 2022] PUT /identity/v3/projects/499e4e126b404be3b3cd361856ddf9a7/users/9239ee6c66af46ad9c4b3d4425d63eae/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:30.953847 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70d341-11fa-48c4-a07c-f6e88b50ad73 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:30.971345 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70d341-11fa-48c4-a07c-f6e88b50ad73 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:31.117694 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f18de-6c47-4075-8f7d-3086d5cb421c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:31.118607 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f18de-6c47-4075-8f7d-3086d5cb421c admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:31.119084 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f18de-6c47-4075-8f7d-3086d5cb421c admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:31.119551 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f18de-6c47-4075-8f7d-3086d5cb421c admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:31.120477 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f18de-6c47-4075-8f7d-3086d5cb421c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:31.122913 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f18de-6c47-4075-8f7d-3086d5cb421c admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:31.136961 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 941/1906] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:56:31.141188 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed95a84-8a68-4441-9545-918a33179309 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:31.157650 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed95a84-8a68-4441-9545-918a33179309 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:31.163926 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9c9a4-f699-4712-a9e4-c35a513d9612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:31.164872 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9c9a4-f699-4712-a9e4-c35a513d9612 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:31.165260 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9c9a4-f699-4712-a9e4-c35a513d9612 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:31.165576 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9c9a4-f699-4712-a9e4-c35a513d9612 admin admin] PATH_INFO: `/v3/projects/499e4e126b404be3b3cd361856ddf9a7/users/9239ee6c66af46ad9c4b3d4425d63eae/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:31.167914 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9c9a4-f699-4712-a9e4-c35a513d9612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=499e4e126b404be3b3cd361856ddf9a7, user_id=9239ee6c66af46ad9c4b3d4425d63eae, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:31.172688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9c9a4-f699-4712-a9e4-c35a513d9612 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:31.207364 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 966/1907] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:56:31 2022] PUT /identity/v3/projects/499e4e126b404be3b3cd361856ddf9a7/users/9239ee6c66af46ad9c4b3d4425d63eae/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:31.212549 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfebf8d-056d-4bf2-96ea-d575b9e1ce60 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:31.212549 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfebf8d-056d-4bf2-96ea-d575b9e1ce60 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:31.212549 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfebf8d-056d-4bf2-96ea-d575b9e1ce60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:31.256978 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-1cfebf8d-056d-4bf2-96ea-d575b9e1ce60 None None] MFA Rules not processed for user `9239ee6c66af46ad9c4b3d4425d63eae`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:31.259178 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-1cfebf8d-056d-4bf2-96ea-d575b9e1ce60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:31.392318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 942/1908] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:31 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:31.405282 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9c9a4-f699-4712-a9e4-c35a513d9612 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:31.409292 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-57b9c9a4-f699-4712-a9e4-c35a513d9612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:31.482477 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9c9a4-f699-4712-a9e4-c35a513d9612 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:31.488604 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e01af-2cb0-41f1-8e4e-d31c112e3354 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:31.490285 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e01af-2cb0-41f1-8e4e-d31c112e3354 service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:31.490833 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e01af-2cb0-41f1-8e4e-d31c112e3354 service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:31.494407 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e01af-2cb0-41f1-8e4e-d31c112e3354 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:31.592892 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e01af-2cb0-41f1-8e4e-d31c112e3354 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:31.596982 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e01af-2cb0-41f1-8e4e-d31c112e3354 service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:31.616623 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 967/1909] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:56:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:56:32.614432 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:33.142929 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:35.154812 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:35.923991 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:36.811947 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:37.174664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26736d8-e92d-4200-9fc3-ed2b23b526c2 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:37.175211 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26736d8-e92d-4200-9fc3-ed2b23b526c2 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:37.175298 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26736d8-e92d-4200-9fc3-ed2b23b526c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:37.237706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-b26736d8-e92d-4200-9fc3-ed2b23b526c2 None None] MFA Rules not processed for user `343e1424c43543218f790516acc3976a`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:37.238996 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-b26736d8-e92d-4200-9fc3-ed2b23b526c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:37.371066 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 943/1910] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:37.383885 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e01af-2cb0-41f1-8e4e-d31c112e3354 service cinder] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:37.385343 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-3c9e01af-2cb0-41f1-8e4e-d31c112e3354 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:37.479617 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e01af-2cb0-41f1-8e4e-d31c112e3354 service cinder] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:37.483242 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292808f1-3b4b-4d1c-bbfc-095d325417a8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd003ff6cc73946da9203c69a167bbfff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:37.484483 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292808f1-3b4b-4d1c-bbfc-095d325417a8 service glance] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:37.487239 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292808f1-3b4b-4d1c-bbfc-095d325417a8 service glance] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:37.487239 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292808f1-3b4b-4d1c-bbfc-095d325417a8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:37.487239 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-292808f1-3b4b-4d1c-bbfc-095d325417a8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:37.552775 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292808f1-3b4b-4d1c-bbfc-095d325417a8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:37.554231 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292808f1-3b4b-4d1c-bbfc-095d325417a8 service glance] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:37.564717 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 968/1911] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:56:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:56:37.720514 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26736d8-e92d-4200-9fc3-ed2b23b526c2 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:37.722092 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-b26736d8-e92d-4200-9fc3-ed2b23b526c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:37.757067 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26736d8-e92d-4200-9fc3-ed2b23b526c2 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:37.761439 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c630436-e57a-48df-96ec-f7e5a8c95461 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:37.762850 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c630436-e57a-48df-96ec-f7e5a8c95461 service cinder] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:37.763220 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c630436-e57a-48df-96ec-f7e5a8c95461 service cinder] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:37.763782 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c630436-e57a-48df-96ec-f7e5a8c95461 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:37.777689 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c630436-e57a-48df-96ec-f7e5a8c95461 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:37.779807 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c630436-e57a-48df-96ec-f7e5a8c95461 service cinder] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:37.792426 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 944/1912] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:56:37 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:56:37.914778 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3648c5-e753-4f0c-8136-c4377eebe1f4 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:37.915956 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3648c5-e753-4f0c-8136-c4377eebe1f4 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:37.916427 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3648c5-e753-4f0c-8136-c4377eebe1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:37.959156 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-7a3648c5-e753-4f0c-8136-c4377eebe1f4 None None] MFA Rules not processed for user `048fc48dd55a43f7b342533a9484c3ad`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:37.960473 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-7a3648c5-e753-4f0c-8136-c4377eebe1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:38.108378 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 969/1913] 10.222.0.39 () {58 vars in 1009 bytes} [Mon May 23 15:56:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:38.118601 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c630436-e57a-48df-96ec-f7e5a8c95461 service cinder] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:38.120591 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-9c630436-e57a-48df-96ec-f7e5a8c95461 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:38.320274 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c630436-e57a-48df-96ec-f7e5a8c95461 service cinder] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:38.327979 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b7a51-70f3-47bc-8199-9cadf8ef2c83 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b275a110936a44ce8d54793af1a34808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:38.328648 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b7a51-70f3-47bc-8199-9cadf8ef2c83 service swift] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:38.328923 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b7a51-70f3-47bc-8199-9cadf8ef2c83 service swift] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:38.329391 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b7a51-70f3-47bc-8199-9cadf8ef2c83 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:38.338104 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b7a51-70f3-47bc-8199-9cadf8ef2c83 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:38.339724 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b7a51-70f3-47bc-8199-9cadf8ef2c83 service swift] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:38.351344 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 945/1914] 10.222.0.39 () {60 vars in 1384 bytes} [Mon May 23 15:56:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 15:56:39.278303 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:39.829402 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:INSERT=5,keystone:DELETE=8,keystone:SELECT=87 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:41.192915 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:42.414823 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:43.237162 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:43.436226 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:45.931338 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:46.720611 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3648c5-e753-4f0c-8136-c4377eebe1f4 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:46.722369 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-7a3648c5-e753-4f0c-8136-c4377eebe1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:46.828858 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:47.010955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3648c5-e753-4f0c-8136-c4377eebe1f4 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:47.018295 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183c0b2-0a09-41ad-ade6-5775aa1e8a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:47.019365 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183c0b2-0a09-41ad-ade6-5775aa1e8a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:47.019779 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183c0b2-0a09-41ad-ade6-5775aa1e8a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:47.020160 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183c0b2-0a09-41ad-ade6-5775aa1e8a3b admin admin] PATH_INFO: `/v3/users/b16c609f2f5f471398a25b3242b0fc72` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:47.021766 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183c0b2-0a09-41ad-ade6-5775aa1e8a3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b16c609f2f5f471398a25b3242b0fc72)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:47.024102 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183c0b2-0a09-41ad-ade6-5775aa1e8a3b admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:47.324323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-3183c0b2-0a09-41ad-ade6-5775aa1e8a3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b16c609f2f5f471398a25b3242b0fc72'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:47.325404 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-3183c0b2-0a09-41ad-ade6-5775aa1e8a3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b16c609f2f5f471398a25b3242b0fc72'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:47.326342 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-3183c0b2-0a09-41ad-ade6-5775aa1e8a3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b16c609f2f5f471398a25b3242b0fc72'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:47.428788 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-3183c0b2-0a09-41ad-ade6-5775aa1e8a3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b16c609f2f5f471398a25b3242b0fc72'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:47.441819 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-3183c0b2-0a09-41ad-ade6-5775aa1e8a3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b16c609f2f5f471398a25b3242b0fc72'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:47.518522 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 970/1915] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:56:46 2022] DELETE /identity/v3/users/b16c609f2f5f471398a25b3242b0fc72 => generated 0 bytes in 798 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:47.522705 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63578b51-4687-44fd-bd9f-dc601317b26d None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:47.523123 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63578b51-4687-44fd-bd9f-dc601317b26d None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:47.523530 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63578b51-4687-44fd-bd9f-dc601317b26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:47.599485 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-63578b51-4687-44fd-bd9f-dc601317b26d None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:47.601811 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-63578b51-4687-44fd-bd9f-dc601317b26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:47.790348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 946/1916] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:56:47.808765 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183c0b2-0a09-41ad-ade6-5775aa1e8a3b admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:47.810833 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-3183c0b2-0a09-41ad-ade6-5775aa1e8a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:48.079377 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183c0b2-0a09-41ad-ade6-5775aa1e8a3b admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:48.091631 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65f95c-7c03-421b-9d03-a92f74c524c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:48.092865 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65f95c-7c03-421b-9d03-a92f74c524c7 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:48.093223 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65f95c-7c03-421b-9d03-a92f74c524c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:48.093576 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65f95c-7c03-421b-9d03-a92f74c524c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:48.117270 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65f95c-7c03-421b-9d03-a92f74c524c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:48.118821 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65f95c-7c03-421b-9d03-a92f74c524c7 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:48.148534 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:48.154843 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 971/1917] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:56:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:56:48.243514 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945abf5-37a4-40b4-aa14-8f4e9c53f475 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:48.244062 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945abf5-37a4-40b4-aa14-8f4e9c53f475 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:48.244260 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945abf5-37a4-40b4-aa14-8f4e9c53f475 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:48.245953 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 947/1918] 10.222.0.39 () {54 vars in 921 bytes} [Mon May 23 15:56:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:56:48.263887 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303b4b8-e231-45ad-818c-80d11be9a7d5 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:48.264328 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303b4b8-e231-45ad-818c-80d11be9a7d5 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:48.265340 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303b4b8-e231-45ad-818c-80d11be9a7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:48.339835 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-5303b4b8-e231-45ad-818c-80d11be9a7d5 None None] MFA Rules not processed for user `84f06d35d7cc48658262bf79d9c72280`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:48.341868 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-5303b4b8-e231-45ad-818c-80d11be9a7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:48.458920 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 972/1919] 10.222.0.39 () {58 vars in 1018 bytes} [Mon May 23 15:56:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:48.481234 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945abf5-37a4-40b4-aa14-8f4e9c53f475 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:48.483084 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-4945abf5-37a4-40b4-aa14-8f4e9c53f475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:48.521701 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945abf5-37a4-40b4-aa14-8f4e9c53f475 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:48.543012 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5db93-fa0e-4b85-90ee-338c3f28a6a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f06d35d7cc48658262bf79d9c72280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:48.545509 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5db93-fa0e-4b85-90ee-338c3f28a6a4 service placement] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:48.546649 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5db93-fa0e-4b85-90ee-338c3f28a6a4 service placement] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:48.547084 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5db93-fa0e-4b85-90ee-338c3f28a6a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:48.567307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303b4b8-e231-45ad-818c-80d11be9a7d5 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:48.569280 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-5303b4b8-e231-45ad-818c-80d11be9a7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:48.584230 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5db93-fa0e-4b85-90ee-338c3f28a6a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:48.585867 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5db93-fa0e-4b85-90ee-338c3f28a6a4 service placement] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:48.594490 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303b4b8-e231-45ad-818c-80d11be9a7d5 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:48.599378 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876685e-bf2f-465c-a8f5-9b0808173e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:48.601947 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 948/1920] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:56:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:56:48.605469 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876685e-bf2f-465c-a8f5-9b0808173e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:48.605765 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876685e-bf2f-465c-a8f5-9b0808173e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:48.606054 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876685e-bf2f-465c-a8f5-9b0808173e13 admin admin] PATH_INFO: `/v3/users/6e82759b3a7b4ca9a38de35ae662c3eb` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:48.608019 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c876685e-bf2f-465c-a8f5-9b0808173e13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e82759b3a7b4ca9a38de35ae662c3eb)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:48.610937 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c876685e-bf2f-465c-a8f5-9b0808173e13 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:48.896574 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-c876685e-bf2f-465c-a8f5-9b0808173e13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e82759b3a7b4ca9a38de35ae662c3eb'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:48.897404 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-c876685e-bf2f-465c-a8f5-9b0808173e13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e82759b3a7b4ca9a38de35ae662c3eb'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:48.898014 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-c876685e-bf2f-465c-a8f5-9b0808173e13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e82759b3a7b4ca9a38de35ae662c3eb'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:48.993926 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-c876685e-bf2f-465c-a8f5-9b0808173e13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e82759b3a7b4ca9a38de35ae662c3eb'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:49.002617 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5db93-fa0e-4b85-90ee-338c3f28a6a4 service placement] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:49.004468 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-39a5db93-fa0e-4b85-90ee-338c3f28a6a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:49.026156 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-c876685e-bf2f-465c-a8f5-9b0808173e13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e82759b3a7b4ca9a38de35ae662c3eb'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:49.036992 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5db93-fa0e-4b85-90ee-338c3f28a6a4 service placement] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:49.049928 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1b37e-2d6b-498a-b2bf-9935beb22037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:49.055030 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1b37e-2d6b-498a-b2bf-9935beb22037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:49.055030 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1b37e-2d6b-498a-b2bf-9935beb22037 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:49.055030 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1b37e-2d6b-498a-b2bf-9935beb22037 admin admin] PATH_INFO: `/v3/projects/1df55cc04c8f4b9896434d30a3b60c1a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:49.055030 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b1b37e-2d6b-498a-b2bf-9935beb22037 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1df55cc04c8f4b9896434d30a3b60c1a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:49.055968 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b1b37e-2d6b-498a-b2bf-9935beb22037 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:49.081087 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 973/1921] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:56:48 2022] DELETE /identity/v3/users/6e82759b3a7b4ca9a38de35ae662c3eb => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:49.300418 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-89b1b37e-2d6b-498a-b2bf-9935beb22037 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1df55cc04c8f4b9896434d30a3b60c1a', 'request_id': 'req-89b1b37e-2d6b-498a-b2bf-9935beb22037'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:49.307259 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-89b1b37e-2d6b-498a-b2bf-9935beb22037 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1df55cc04c8f4b9896434d30a3b60c1a', 'request_id': 'req-89b1b37e-2d6b-498a-b2bf-9935beb22037'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:49.520177 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-89b1b37e-2d6b-498a-b2bf-9935beb22037 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1df55cc04c8f4b9896434d30a3b60c1a', 'request_id': 'req-89b1b37e-2d6b-498a-b2bf-9935beb22037'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:49.548725 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-89b1b37e-2d6b-498a-b2bf-9935beb22037 admin admin] The token cache is being invalidate because project 1df55cc04c8f4b9896434d30a3b60c1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:56:49.550856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-89b1b37e-2d6b-498a-b2bf-9935beb22037 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:49.561062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876685e-bf2f-465c-a8f5-9b0808173e13 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:49.561205 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-89b1b37e-2d6b-498a-b2bf-9935beb22037 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:49.561303 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-c876685e-bf2f-465c-a8f5-9b0808173e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:49.562514 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 949/1922] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:56:49 2022] DELETE /identity/v3/projects/1df55cc04c8f4b9896434d30a3b60c1a => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:56:49.574628 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1b37e-2d6b-498a-b2bf-9935beb22037 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:49.579796 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-89b1b37e-2d6b-498a-b2bf-9935beb22037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:49.732201 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876685e-bf2f-465c-a8f5-9b0808173e13 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:49.790542 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1b37e-2d6b-498a-b2bf-9935beb22037 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:49.798527 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045cda4d-22ec-46f5-b889-d02590374bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:49.800152 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cda4d-22ec-46f5-b889-d02590374bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:49.800345 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cda4d-22ec-46f5-b889-d02590374bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:49.800642 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cda4d-22ec-46f5-b889-d02590374bbd admin admin] PATH_INFO: `/v3/users/e989792ae96b4b1eaf432e50baec3c4d` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:49.804581 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045cda4d-22ec-46f5-b889-d02590374bbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e989792ae96b4b1eaf432e50baec3c4d)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:49.806817 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045cda4d-22ec-46f5-b889-d02590374bbd admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:49.910354 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95302cd3-0c4b-4caf-802b-8b2aa78acb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:49.911228 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95302cd3-0c4b-4caf-802b-8b2aa78acb9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:49.911619 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95302cd3-0c4b-4caf-802b-8b2aa78acb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:49.912017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95302cd3-0c4b-4caf-802b-8b2aa78acb9f admin admin] PATH_INFO: `/v3/projects/ed73c8b93b8a421cbaa26df946f147c7` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:49.913431 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95302cd3-0c4b-4caf-802b-8b2aa78acb9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed73c8b93b8a421cbaa26df946f147c7)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:49.915441 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95302cd3-0c4b-4caf-802b-8b2aa78acb9f admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:50.493718 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-045cda4d-22ec-46f5-b889-d02590374bbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e989792ae96b4b1eaf432e50baec3c4d'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:50.501284 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-95302cd3-0c4b-4caf-802b-8b2aa78acb9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed73c8b93b8a421cbaa26df946f147c7', 'request_id': 'req-95302cd3-0c4b-4caf-802b-8b2aa78acb9f'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:50.506681 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-045cda4d-22ec-46f5-b889-d02590374bbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e989792ae96b4b1eaf432e50baec3c4d'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:50.507437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-045cda4d-22ec-46f5-b889-d02590374bbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e989792ae96b4b1eaf432e50baec3c4d'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:50.510763 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-95302cd3-0c4b-4caf-802b-8b2aa78acb9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed73c8b93b8a421cbaa26df946f147c7', 'request_id': 'req-95302cd3-0c4b-4caf-802b-8b2aa78acb9f'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:50.526895 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-045cda4d-22ec-46f5-b889-d02590374bbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e989792ae96b4b1eaf432e50baec3c4d'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:50.626529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-95302cd3-0c4b-4caf-802b-8b2aa78acb9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed73c8b93b8a421cbaa26df946f147c7', 'request_id': 'req-95302cd3-0c4b-4caf-802b-8b2aa78acb9f'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:50.641193 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-95302cd3-0c4b-4caf-802b-8b2aa78acb9f admin admin] The token cache is being invalidate because project ed73c8b93b8a421cbaa26df946f147c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:56:50.641546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-95302cd3-0c4b-4caf-802b-8b2aa78acb9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:50.642173 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-95302cd3-0c4b-4caf-802b-8b2aa78acb9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:50.644042 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 974/1923] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:56:49 2022] DELETE /identity/v3/projects/ed73c8b93b8a421cbaa26df946f147c7 => generated 0 bytes in 1087 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:56:50.658354 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5218ffc-cf8f-49c9-ab94-fdbe0a55d34b None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:50.658685 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5218ffc-cf8f-49c9-ab94-fdbe0a55d34b None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:50.658913 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5218ffc-cf8f-49c9-ab94-fdbe0a55d34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:50.708583 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-045cda4d-22ec-46f5-b889-d02590374bbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e989792ae96b4b1eaf432e50baec3c4d'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:50.711319 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-b5218ffc-cf8f-49c9-ab94-fdbe0a55d34b None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:50.712740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-b5218ffc-cf8f-49c9-ab94-fdbe0a55d34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:50.716977 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 950/1924] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:56:49 2022] DELETE /identity/v3/users/e989792ae96b4b1eaf432e50baec3c4d => generated 0 bytes in 1144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:50.789492 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 975/1925] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:50.792536 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:50.797194 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af6254-5aa2-4a8a-a6f5-6e43ee67c63e None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:50.804213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af6254-5aa2-4a8a-a6f5-6e43ee67c63e None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:50.804213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af6254-5aa2-4a8a-a6f5-6e43ee67c63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:50.820410 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-98af6254-5aa2-4a8a-a6f5-6e43ee67c63e None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:50.822047 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-98af6254-5aa2-4a8a-a6f5-6e43ee67c63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:50.927214 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 951/1926] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:50.928462 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5218ffc-cf8f-49c9-ab94-fdbe0a55d34b None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:50.943412 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5218ffc-cf8f-49c9-ab94-fdbe0a55d34b None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:50.957891 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1901ec-ab88-46d6-a0b5-1cbcfd1a48ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:50.958520 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1901ec-ab88-46d6-a0b5-1cbcfd1a48ee admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:50.959476 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1901ec-ab88-46d6-a0b5-1cbcfd1a48ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:50.959476 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1901ec-ab88-46d6-a0b5-1cbcfd1a48ee admin admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:50.962623 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1901ec-ab88-46d6-a0b5-1cbcfd1a48ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:56:50.963006 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1901ec-ab88-46d6-a0b5-1cbcfd1a48ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:50.964717 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1901ec-ab88-46d6-a0b5-1cbcfd1a48ee admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:50.972624 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:50.985675 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 976/1927] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 15:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:56:50.989648 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af6254-5aa2-4a8a-a6f5-6e43ee67c63e None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:50.999195 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af6254-5aa2-4a8a-a6f5-6e43ee67c63e None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:51.006509 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332e566-a782-4431-b568-f91049466ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:51.006509 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332e566-a782-4431-b568-f91049466ee7 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:51.006509 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332e566-a782-4431-b568-f91049466ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:51.006509 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332e566-a782-4431-b568-f91049466ee7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:51.007206 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332e566-a782-4431-b568-f91049466ee7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:51.009533 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332e566-a782-4431-b568-f91049466ee7 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:51.112775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 952/1928] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:56:50 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:56:51.113988 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1901ec-ab88-46d6-a0b5-1cbcfd1a48ee admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:51.167071 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1901ec-ab88-46d6-a0b5-1cbcfd1a48ee admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:51.273426 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf437d-1ca3-4829-b439-4719dfaf4f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:51.274174 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf437d-1ca3-4829-b439-4719dfaf4f96 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:51.274459 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf437d-1ca3-4829-b439-4719dfaf4f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:51.274735 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf437d-1ca3-4829-b439-4719dfaf4f96 admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:51.275438 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf437d-1ca3-4829-b439-4719dfaf4f96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:51.278393 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf437d-1ca3-4829-b439-4719dfaf4f96 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:51.393877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 977/1929] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:56:51 2022] POST /identity/v3/users => generated 294 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:56:51.396335 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332e566-a782-4431-b568-f91049466ee7 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:51.409715 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332e566-a782-4431-b568-f91049466ee7 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:51.417082 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ded9e-d376-4ab7-9bad-32a4b29a65e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:51.418007 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ded9e-d376-4ab7-9bad-32a4b29a65e0 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:51.418446 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ded9e-d376-4ab7-9bad-32a4b29a65e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:51.418868 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ded9e-d376-4ab7-9bad-32a4b29a65e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:51.419781 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ded9e-d376-4ab7-9bad-32a4b29a65e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:51.421821 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ded9e-d376-4ab7-9bad-32a4b29a65e0 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:51.438452 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 953/1930] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:56:51.439072 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf437d-1ca3-4829-b439-4719dfaf4f96 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:51.474051 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf437d-1ca3-4829-b439-4719dfaf4f96 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:51.491534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ded9e-d376-4ab7-9bad-32a4b29a65e0 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:51.496388 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-0b2ded9e-d376-4ab7-9bad-32a4b29a65e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:51.502987 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274a3f7-8cf1-46b0-99cf-584605df331c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:51.503493 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274a3f7-8cf1-46b0-99cf-584605df331c admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:51.503493 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274a3f7-8cf1-46b0-99cf-584605df331c admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:51.510569 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274a3f7-8cf1-46b0-99cf-584605df331c admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:51.510569 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274a3f7-8cf1-46b0-99cf-584605df331c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:51.510569 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:51.510569 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274a3f7-8cf1-46b0-99cf-584605df331c admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:51.534042 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 978/1931] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:56:51.537941 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274a3f7-8cf1-46b0-99cf-584605df331c admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:51.544080 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ded9e-d376-4ab7-9bad-32a4b29a65e0 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:51.552585 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274a3f7-8cf1-46b0-99cf-584605df331c admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:51.559719 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b1594-0249-418d-8868-f61afbfac3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:51.561161 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b1594-0249-418d-8868-f61afbfac3dc admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:51.562055 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b1594-0249-418d-8868-f61afbfac3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:51.562511 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b1594-0249-418d-8868-f61afbfac3dc admin admin] PATH_INFO: `/v3/projects/3281b581283a41619031200fc6f5ed78/users/9092f3fd53e74ba48d9aa0215dd00d4e/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:51.563279 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc80f5-ec69-4c6b-ade5-342c19be9f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:51.565472 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc80f5-ec69-4c6b-ade5-342c19be9f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:51.565789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc80f5-ec69-4c6b-ade5-342c19be9f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:51.570511 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc80f5-ec69-4c6b-ade5-342c19be9f9e admin admin] PATH_INFO: `/v3/projects/2f10c831d1664dd1bd72ed2a377d8af8` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:51.576349 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc80f5-ec69-4c6b-ade5-342c19be9f9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f10c831d1664dd1bd72ed2a377d8af8)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:51.578901 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc80f5-ec69-4c6b-ade5-342c19be9f9e admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:51.605710 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b1594-0249-418d-8868-f61afbfac3dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3281b581283a41619031200fc6f5ed78, user_id=9092f3fd53e74ba48d9aa0215dd00d4e, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:51.608549 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b1594-0249-418d-8868-f61afbfac3dc admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:51.719341 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 979/1932] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:56:51 2022] PUT /identity/v3/projects/3281b581283a41619031200fc6f5ed78/users/9092f3fd53e74ba48d9aa0215dd00d4e/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:56:51.730983 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38898eb1-e101-432d-a83b-ae689d9b4f46 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:51.731372 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38898eb1-e101-432d-a83b-ae689d9b4f46 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:51.731870 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38898eb1-e101-432d-a83b-ae689d9b4f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:51.768551 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-92bc80f5-ec69-4c6b-ade5-342c19be9f9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f10c831d1664dd1bd72ed2a377d8af8', 'request_id': 'req-92bc80f5-ec69-4c6b-ade5-342c19be9f9e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:51.789564 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-92bc80f5-ec69-4c6b-ade5-342c19be9f9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f10c831d1664dd1bd72ed2a377d8af8', 'request_id': 'req-92bc80f5-ec69-4c6b-ade5-342c19be9f9e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:51.802556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-38898eb1-e101-432d-a83b-ae689d9b4f46 None None] MFA Rules not processed for user `9092f3fd53e74ba48d9aa0215dd00d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:51.804223 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-38898eb1-e101-432d-a83b-ae689d9b4f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:51.897447 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-92bc80f5-ec69-4c6b-ade5-342c19be9f9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f10c831d1664dd1bd72ed2a377d8af8', 'request_id': 'req-92bc80f5-ec69-4c6b-ade5-342c19be9f9e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:51.917456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-92bc80f5-ec69-4c6b-ade5-342c19be9f9e admin admin] The token cache is being invalidate because project 2f10c831d1664dd1bd72ed2a377d8af8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:56:51.918801 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-92bc80f5-ec69-4c6b-ade5-342c19be9f9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:51.919874 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-92bc80f5-ec69-4c6b-ade5-342c19be9f9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:51.924040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 954/1933] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:56:51 2022] DELETE /identity/v3/projects/2f10c831d1664dd1bd72ed2a377d8af8 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:51.936291 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716543d8-14b6-4312-ae9c-4ce171d0b5f3 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:51.937224 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716543d8-14b6-4312-ae9c-4ce171d0b5f3 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:51.937503 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716543d8-14b6-4312-ae9c-4ce171d0b5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:51.958252 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 980/1934] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:51.959174 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38898eb1-e101-432d-a83b-ae689d9b4f46 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:51.987336 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-716543d8-14b6-4312-ae9c-4ce171d0b5f3 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:51.988631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-716543d8-14b6-4312-ae9c-4ce171d0b5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:52.150718 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38898eb1-e101-432d-a83b-ae689d9b4f46 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:52.160433 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 955/1935] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:52.161102 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696350c-44a9-44a9-ac64-0b6caeea54ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:52.162179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696350c-44a9-44a9-ac64-0b6caeea54ad admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:52.162469 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696350c-44a9-44a9-ac64-0b6caeea54ad admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:52.162752 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696350c-44a9-44a9-ac64-0b6caeea54ad admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:52.163462 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696350c-44a9-44a9-ac64-0b6caeea54ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:52.166832 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732964f-9ee8-4030-ac1d-5c3e023b99f9 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:52.167125 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732964f-9ee8-4030-ac1d-5c3e023b99f9 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:52.167403 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732964f-9ee8-4030-ac1d-5c3e023b99f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:52.169727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696350c-44a9-44a9-ac64-0b6caeea54ad admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:52.217527 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-b732964f-9ee8-4030-ac1d-5c3e023b99f9 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:52.219841 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-b732964f-9ee8-4030-ac1d-5c3e023b99f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:52.232976 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 956/1936] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:56:52.236472 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732964f-9ee8-4030-ac1d-5c3e023b99f9 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:52.250601 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732964f-9ee8-4030-ac1d-5c3e023b99f9 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:52.256470 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b79db4-cd88-4b48-a5da-cc83f3fd4f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:52.257144 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b79db4-cd88-4b48-a5da-cc83f3fd4f8e admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:52.257433 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b79db4-cd88-4b48-a5da-cc83f3fd4f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:52.257712 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b79db4-cd88-4b48-a5da-cc83f3fd4f8e admin admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:52.258449 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b79db4-cd88-4b48-a5da-cc83f3fd4f8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:56:52.258759 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b79db4-cd88-4b48-a5da-cc83f3fd4f8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:52.261051 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b79db4-cd88-4b48-a5da-cc83f3fd4f8e admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:52.276778 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 957/1937] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 15:56:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:56:52.281025 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b79db4-cd88-4b48-a5da-cc83f3fd4f8e admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:52.297925 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b79db4-cd88-4b48-a5da-cc83f3fd4f8e admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:52.309399 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb5a2c-5862-43d0-bf76-06e1d1d4c6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:52.310565 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb5a2c-5862-43d0-bf76-06e1d1d4c6ea admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:52.310940 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb5a2c-5862-43d0-bf76-06e1d1d4c6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:52.311297 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb5a2c-5862-43d0-bf76-06e1d1d4c6ea admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:52.313582 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb5a2c-5862-43d0-bf76-06e1d1d4c6ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:52.316115 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb5a2c-5862-43d0-bf76-06e1d1d4c6ea admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:52.332295 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 981/1938] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:56:51 2022] POST /identity/v3/projects => generated 385 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:56:52.334374 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696350c-44a9-44a9-ac64-0b6caeea54ad admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:52.338368 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-b696350c-44a9-44a9-ac64-0b6caeea54ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:52.444782 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696350c-44a9-44a9-ac64-0b6caeea54ad admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:52.461810 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 958/1939] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:56:52 2022] POST /identity/v3/projects => generated 365 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:56:52.463675 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb5a2c-5862-43d0-bf76-06e1d1d4c6ea admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:52.464214 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73c51d-cdb4-4c21-a404-9772bd7d7737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:52.465342 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73c51d-cdb4-4c21-a404-9772bd7d7737 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:52.466639 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73c51d-cdb4-4c21-a404-9772bd7d7737 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:52.467162 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73c51d-cdb4-4c21-a404-9772bd7d7737 admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:52.468647 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73c51d-cdb4-4c21-a404-9772bd7d7737 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:52.474560 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73c51d-cdb4-4c21-a404-9772bd7d7737 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:52.559680 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb5a2c-5862-43d0-bf76-06e1d1d4c6ea admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:52.569107 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0381f-f450-4178-9ccf-94ccf366e284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:52.569989 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0381f-f450-4178-9ccf-94ccf366e284 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:52.570411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0381f-f450-4178-9ccf-94ccf366e284 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:52.570780 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0381f-f450-4178-9ccf-94ccf366e284 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:52.571740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0381f-f450-4178-9ccf-94ccf366e284 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:52.576638 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0381f-f450-4178-9ccf-94ccf366e284 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:52.587105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 982/1940] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:56:52 2022] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:56:52.587105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73c51d-cdb4-4c21-a404-9772bd7d7737 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:52.606432 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73c51d-cdb4-4c21-a404-9772bd7d7737 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:52.612637 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e3888-4ed6-4c81-bd16-12b1f9781498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:52.615208 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e3888-4ed6-4c81-bd16-12b1f9781498 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:52.615208 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e3888-4ed6-4c81-bd16-12b1f9781498 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:52.615208 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e3888-4ed6-4c81-bd16-12b1f9781498 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:52.615208 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e3888-4ed6-4c81-bd16-12b1f9781498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:52.616968 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e3888-4ed6-4c81-bd16-12b1f9781498 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:52.634805 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 983/1941] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:56:52.636213 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e3888-4ed6-4c81-bd16-12b1f9781498 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:52.653865 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e3888-4ed6-4c81-bd16-12b1f9781498 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:52.659889 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8f9eb-3a08-4b44-bb5b-7d723afa3259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:52.660766 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8f9eb-3a08-4b44-bb5b-7d723afa3259 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:52.661223 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8f9eb-3a08-4b44-bb5b-7d723afa3259 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:52.661645 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8f9eb-3a08-4b44-bb5b-7d723afa3259 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:52.662681 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8f9eb-3a08-4b44-bb5b-7d723afa3259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:52.664601 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8f9eb-3a08-4b44-bb5b-7d723afa3259 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:52.691714 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 959/1942] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:56:52 2022] POST /identity/v3/users => generated 283 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:56:52.691936 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 984/1943] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:56:52.691936 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8f9eb-3a08-4b44-bb5b-7d723afa3259 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:52.701604 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0381f-f450-4178-9ccf-94ccf366e284 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:52.701788 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8f9eb-3a08-4b44-bb5b-7d723afa3259 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:52.706715 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdeef08-e10a-4c3c-a9f4-6588eb9a9a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:52.707781 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdeef08-e10a-4c3c-a9f4-6588eb9a9a7a admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:52.708011 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdeef08-e10a-4c3c-a9f4-6588eb9a9a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:52.708308 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdeef08-e10a-4c3c-a9f4-6588eb9a9a7a admin admin] PATH_INFO: `/v3/projects/8b5e194e87f84bddbe15afa85701e502/users/7f3c794f3c83463bb71f6f8f4708443c/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:52.732450 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0381f-f450-4178-9ccf-94ccf366e284 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:52.736179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdeef08-e10a-4c3c-a9f4-6588eb9a9a7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b5e194e87f84bddbe15afa85701e502, user_id=7f3c794f3c83463bb71f6f8f4708443c, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:52.738848 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdeef08-e10a-4c3c-a9f4-6588eb9a9a7a admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:52.751141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d9857-82a3-43b5-968b-d28b86dc6583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:52.752291 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d9857-82a3-43b5-968b-d28b86dc6583 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:52.756622 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d9857-82a3-43b5-968b-d28b86dc6583 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:52.756622 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d9857-82a3-43b5-968b-d28b86dc6583 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:52.756622 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d9857-82a3-43b5-968b-d28b86dc6583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:52.758204 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d9857-82a3-43b5-968b-d28b86dc6583 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:52.788781 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 960/1944] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:56:52.792753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d9857-82a3-43b5-968b-d28b86dc6583 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:52.814255 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d9857-82a3-43b5-968b-d28b86dc6583 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:52.820547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 985/1945] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:56:52 2022] PUT /identity/v3/projects/8b5e194e87f84bddbe15afa85701e502/users/7f3c794f3c83463bb71f6f8f4708443c/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:52.832013 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277d267-7eb4-45e4-9cd7-570949bfd2ff None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:52.832444 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277d267-7eb4-45e4-9cd7-570949bfd2ff None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:52.832794 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:52.832916 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277d267-7eb4-45e4-9cd7-570949bfd2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:52.873633 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-a277d267-7eb4-45e4-9cd7-570949bfd2ff None None] MFA Rules not processed for user `7f3c794f3c83463bb71f6f8f4708443c`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:52.876059 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-a277d267-7eb4-45e4-9cd7-570949bfd2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:52.891349 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27338962-a75c-4b1a-bf17-500a8fee39c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:52.892357 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27338962-a75c-4b1a-bf17-500a8fee39c1 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:52.892794 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27338962-a75c-4b1a-bf17-500a8fee39c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:52.893290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27338962-a75c-4b1a-bf17-500a8fee39c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:52.894464 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27338962-a75c-4b1a-bf17-500a8fee39c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:52.896246 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27338962-a75c-4b1a-bf17-500a8fee39c1 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:52.907643 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 961/1946] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:56:52.911742 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27338962-a75c-4b1a-bf17-500a8fee39c1 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:52.923042 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27338962-a75c-4b1a-bf17-500a8fee39c1 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:52.932284 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3c014-a5fb-4632-bd2b-c68e1e06f906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:52.933219 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3c014-a5fb-4632-bd2b-c68e1e06f906 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:52.933654 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3c014-a5fb-4632-bd2b-c68e1e06f906 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:52.933920 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3c014-a5fb-4632-bd2b-c68e1e06f906 admin admin] PATH_INFO: `/v3/projects/eb4b269fa1894a09a27085e11ed28e67/users/ac229ef5b05d438a927043481781dc06/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:52.956548 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 986/1947] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:52.958302 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3c014-a5fb-4632-bd2b-c68e1e06f906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb4b269fa1894a09a27085e11ed28e67, user_id=ac229ef5b05d438a927043481781dc06, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:52.962433 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3c014-a5fb-4632-bd2b-c68e1e06f906 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:52.966723 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277d267-7eb4-45e4-9cd7-570949bfd2ff None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:52.983290 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277d267-7eb4-45e4-9cd7-570949bfd2ff None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:52.988877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efd205-e117-4564-968c-ab91f8d30b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:52.989550 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efd205-e117-4564-968c-ab91f8d30b4c admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:52.989838 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efd205-e117-4564-968c-ab91f8d30b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:52.990113 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efd205-e117-4564-968c-ab91f8d30b4c admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:52.990815 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efd205-e117-4564-968c-ab91f8d30b4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:52.992756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efd205-e117-4564-968c-ab91f8d30b4c admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:53.062558 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 962/1948] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:56:52 2022] PUT /identity/v3/projects/eb4b269fa1894a09a27085e11ed28e67/users/ac229ef5b05d438a927043481781dc06/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:53.074926 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c00eea-aad5-418a-aaf1-02ba24d3efd7 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:53.078279 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c00eea-aad5-418a-aaf1-02ba24d3efd7 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:53.085247 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c00eea-aad5-418a-aaf1-02ba24d3efd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:53.091455 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 987/1949] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:56:52 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:56:53.093312 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efd205-e117-4564-968c-ab91f8d30b4c admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:53.123086 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-33c00eea-aad5-418a-aaf1-02ba24d3efd7 None None] MFA Rules not processed for user `ac229ef5b05d438a927043481781dc06`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:53.124898 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-33c00eea-aad5-418a-aaf1-02ba24d3efd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:53.188652 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efd205-e117-4564-968c-ab91f8d30b4c admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:53.200561 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3270d-4d61-4a44-84ed-b54a9764469d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:53.203554 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3270d-4d61-4a44-84ed-b54a9764469d admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:53.203877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3270d-4d61-4a44-84ed-b54a9764469d admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:53.204155 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3270d-4d61-4a44-84ed-b54a9764469d admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:53.204900 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3270d-4d61-4a44-84ed-b54a9764469d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:53.221383 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3270d-4d61-4a44-84ed-b54a9764469d admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:53.225367 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 963/1950] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:53 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:56:53.227642 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c00eea-aad5-418a-aaf1-02ba24d3efd7 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:53.260209 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c00eea-aad5-418a-aaf1-02ba24d3efd7 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:53.265467 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf869d4-d696-4dbc-97e0-8689063b80ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:53.266328 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf869d4-d696-4dbc-97e0-8689063b80ed admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:53.266714 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf869d4-d696-4dbc-97e0-8689063b80ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:53.267161 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf869d4-d696-4dbc-97e0-8689063b80ed admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:53.268013 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf869d4-d696-4dbc-97e0-8689063b80ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:53.270287 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf869d4-d696-4dbc-97e0-8689063b80ed admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:53.315438 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 988/1951] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:56:53 2022] POST /identity/v3/users => generated 299 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:56:53.316392 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3270d-4d61-4a44-84ed-b54a9764469d admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:53.326697 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3270d-4d61-4a44-84ed-b54a9764469d admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:53.332692 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49590ef2-981c-4419-830f-b8a86bcfecd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:53.333386 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49590ef2-981c-4419-830f-b8a86bcfecd3 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:53.333668 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49590ef2-981c-4419-830f-b8a86bcfecd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:53.333941 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49590ef2-981c-4419-830f-b8a86bcfecd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:53.334741 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49590ef2-981c-4419-830f-b8a86bcfecd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:53.336542 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49590ef2-981c-4419-830f-b8a86bcfecd3 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:53.348890 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 989/1952] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:56:53.352929 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49590ef2-981c-4419-830f-b8a86bcfecd3 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:53.366351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49590ef2-981c-4419-830f-b8a86bcfecd3 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:53.370221 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 964/1953] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:56:53 2022] POST /identity/v3/projects => generated 365 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:56:53.376015 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf869d4-d696-4dbc-97e0-8689063b80ed admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:53.477308 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1bbc1-38db-4ce7-85c8-2b6d6cc7f711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:53.478251 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1bbc1-38db-4ce7-85c8-2b6d6cc7f711 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:53.478531 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1bbc1-38db-4ce7-85c8-2b6d6cc7f711 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:53.478812 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1bbc1-38db-4ce7-85c8-2b6d6cc7f711 admin admin] PATH_INFO: `/v3/projects/1cc721cf690b474986b842eaaad32c49/users/d4d86ad3dca44c15833acc2195688c11/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:53.510555 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1bbc1-38db-4ce7-85c8-2b6d6cc7f711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc721cf690b474986b842eaaad32c49, user_id=d4d86ad3dca44c15833acc2195688c11, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:53.512195 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1bbc1-38db-4ce7-85c8-2b6d6cc7f711 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:53.522985 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf869d4-d696-4dbc-97e0-8689063b80ed admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:53.531932 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680878e-be65-4cbf-b173-8f3c082bdd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:53.532643 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680878e-be65-4cbf-b173-8f3c082bdd2e admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:53.532932 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680878e-be65-4cbf-b173-8f3c082bdd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:53.533212 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680878e-be65-4cbf-b173-8f3c082bdd2e admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:53.533951 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c680878e-be65-4cbf-b173-8f3c082bdd2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:53.537876 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c680878e-be65-4cbf-b173-8f3c082bdd2e admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:53.646250 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 990/1954] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:56:53 2022] PUT /identity/v3/projects/1cc721cf690b474986b842eaaad32c49/users/d4d86ad3dca44c15833acc2195688c11/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:53.649937 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1bbc1-38db-4ce7-85c8-2b6d6cc7f711 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:53.658565 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:53.668229 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 965/1955] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:56:53 2022] POST /identity/v3/users => generated 289 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:56:53.671962 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680878e-be65-4cbf-b173-8f3c082bdd2e admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:53.682324 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680878e-be65-4cbf-b173-8f3c082bdd2e admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:53.753586 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1bbc1-38db-4ce7-85c8-2b6d6cc7f711 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:53.766080 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a94837-3687-4e5b-8069-198aaa99b837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:53.766547 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a94837-3687-4e5b-8069-198aaa99b837 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:53.766925 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a94837-3687-4e5b-8069-198aaa99b837 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:53.767290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a94837-3687-4e5b-8069-198aaa99b837 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:53.768230 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a94837-3687-4e5b-8069-198aaa99b837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:53.770067 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a94837-3687-4e5b-8069-198aaa99b837 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:53.770976 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827af26e-91c9-498c-9469-3b2ade9d99c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:53.771774 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827af26e-91c9-498c-9469-3b2ade9d99c1 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:53.772894 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827af26e-91c9-498c-9469-3b2ade9d99c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:53.772894 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827af26e-91c9-498c-9469-3b2ade9d99c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:53.773362 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827af26e-91c9-498c-9469-3b2ade9d99c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:53.775115 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827af26e-91c9-498c-9469-3b2ade9d99c1 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:53.782154 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 966/1956] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:56:53.786407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a94837-3687-4e5b-8069-198aaa99b837 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:53.790361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 991/1957] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:56:53.794300 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827af26e-91c9-498c-9469-3b2ade9d99c1 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:53.798958 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a94837-3687-4e5b-8069-198aaa99b837 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:53.807569 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e4b36-40c3-4eee-9145-f4b3eb49767f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:53.807569 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e4b36-40c3-4eee-9145-f4b3eb49767f admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:53.807569 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e4b36-40c3-4eee-9145-f4b3eb49767f admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:53.807996 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827af26e-91c9-498c-9469-3b2ade9d99c1 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:53.808095 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e4b36-40c3-4eee-9145-f4b3eb49767f admin admin] PATH_INFO: `/v3/projects/4043a09699b14fdfaa056579f6041740/users/555090e6fd2449b8bb709abfbc7a02be/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:53.811121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef062f-be85-44d8-9436-97cceaee3549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:53.812824 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef062f-be85-44d8-9436-97cceaee3549 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:53.813058 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef062f-be85-44d8-9436-97cceaee3549 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:53.813354 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef062f-be85-44d8-9436-97cceaee3549 admin admin] PATH_INFO: `/v3/projects/1cc721cf690b474986b842eaaad32c49/users/d4d86ad3dca44c15833acc2195688c11/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:53.816478 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef062f-be85-44d8-9436-97cceaee3549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc721cf690b474986b842eaaad32c49, user_id=d4d86ad3dca44c15833acc2195688c11, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:53.818385 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef062f-be85-44d8-9436-97cceaee3549 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:53.832956 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 992/1958] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:56:53 2022] PUT /identity/v3/projects/1cc721cf690b474986b842eaaad32c49/users/d4d86ad3dca44c15833acc2195688c11/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:53.843399 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8bc40-f5ea-42ad-925c-d6db7706ae63 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:53.843807 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8bc40-f5ea-42ad-925c-d6db7706ae63 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:53.843977 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e4b36-40c3-4eee-9145-f4b3eb49767f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4043a09699b14fdfaa056579f6041740, user_id=555090e6fd2449b8bb709abfbc7a02be, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:53.844228 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8bc40-f5ea-42ad-925c-d6db7706ae63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:53.848345 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e4b36-40c3-4eee-9145-f4b3eb49767f admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:53.861470 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:53.881015 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-35c8bc40-f5ea-42ad-925c-d6db7706ae63 None None] MFA Rules not processed for user `d4d86ad3dca44c15833acc2195688c11`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:53.882322 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-35c8bc40-f5ea-42ad-925c-d6db7706ae63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:53.929111 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 967/1959] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:56:53 2022] PUT /identity/v3/projects/4043a09699b14fdfaa056579f6041740/users/555090e6fd2449b8bb709abfbc7a02be/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:56:53.935619 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e4b36-40c3-4eee-9145-f4b3eb49767f admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:54.004522 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 993/1960] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:54.022279 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e4b36-40c3-4eee-9145-f4b3eb49767f admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:54.025174 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8bc40-f5ea-42ad-925c-d6db7706ae63 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:54.028396 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-35c8bc40-f5ea-42ad-925c-d6db7706ae63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:54.038850 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60800e-2e72-4f9c-bb39-5c542de581fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:54.040192 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60800e-2e72-4f9c-bb39-5c542de581fc admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:54.040904 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60800e-2e72-4f9c-bb39-5c542de581fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:54.041340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60800e-2e72-4f9c-bb39-5c542de581fc admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:54.042272 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60800e-2e72-4f9c-bb39-5c542de581fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:54.044325 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60800e-2e72-4f9c-bb39-5c542de581fc admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:54.059769 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 968/1961] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:56:54.065043 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60800e-2e72-4f9c-bb39-5c542de581fc admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:54.076570 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60800e-2e72-4f9c-bb39-5c542de581fc admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:54.082792 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468fa13-2b9e-4bc6-a22e-c6d09d9528de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:54.083893 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468fa13-2b9e-4bc6-a22e-c6d09d9528de admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:54.084169 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468fa13-2b9e-4bc6-a22e-c6d09d9528de admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:54.084522 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468fa13-2b9e-4bc6-a22e-c6d09d9528de admin admin] PATH_INFO: `/v3/projects/4043a09699b14fdfaa056579f6041740/users/555090e6fd2449b8bb709abfbc7a02be/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:54.086619 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468fa13-2b9e-4bc6-a22e-c6d09d9528de admin admin] RBAC: Authorizing `identity:create_grant(project_id=4043a09699b14fdfaa056579f6041740, user_id=555090e6fd2449b8bb709abfbc7a02be, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:54.089506 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468fa13-2b9e-4bc6-a22e-c6d09d9528de admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:54.103279 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 969/1962] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:56:54 2022] PUT /identity/v3/projects/4043a09699b14fdfaa056579f6041740/users/555090e6fd2449b8bb709abfbc7a02be/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:56:54.115197 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8bc40-f5ea-42ad-925c-d6db7706ae63 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:54.118963 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17844d9c-5efd-4ba6-9ad4-dfaa594d51a6 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:54.119456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17844d9c-5efd-4ba6-9ad4-dfaa594d51a6 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:54.119783 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17844d9c-5efd-4ba6-9ad4-dfaa594d51a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:54.155948 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-17844d9c-5efd-4ba6-9ad4-dfaa594d51a6 None None] MFA Rules not processed for user `555090e6fd2449b8bb709abfbc7a02be`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:54.157642 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-17844d9c-5efd-4ba6-9ad4-dfaa594d51a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:54.181883 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218094e-6aca-4c88-911f-486cc12bdcc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:54.182535 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218094e-6aca-4c88-911f-486cc12bdcc3 service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:54.182952 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218094e-6aca-4c88-911f-486cc12bdcc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:54.183330 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218094e-6aca-4c88-911f-486cc12bdcc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:54.267040 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218094e-6aca-4c88-911f-486cc12bdcc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:54.269175 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218094e-6aca-4c88-911f-486cc12bdcc3 service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:54.271067 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 970/1963] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:54 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:56:54.280294 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17844d9c-5efd-4ba6-9ad4-dfaa594d51a6 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:54.282612 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-17844d9c-5efd-4ba6-9ad4-dfaa594d51a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:54.293325 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 994/1964] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:56:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:56:54.319087 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17844d9c-5efd-4ba6-9ad4-dfaa594d51a6 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:54.323177 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6279b47-f38b-44d7-9da7-9f7a9aee2a93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:54.323997 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6279b47-f38b-44d7-9da7-9f7a9aee2a93 service cinder] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:54.324150 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6279b47-f38b-44d7-9da7-9f7a9aee2a93 service cinder] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:54.324409 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6279b47-f38b-44d7-9da7-9f7a9aee2a93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:54.351992 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6279b47-f38b-44d7-9da7-9f7a9aee2a93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:54.351992 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6279b47-f38b-44d7-9da7-9f7a9aee2a93 service cinder] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:54.360439 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 971/1965] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:56:54 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:56:54.506422 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:55.130417 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218094e-6aca-4c88-911f-486cc12bdcc3 service cinder] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:55.140823 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218094e-6aca-4c88-911f-486cc12bdcc3 service cinder] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:55.144090 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edc076-e3c8-4572-9b89-94eb664ab15e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:55.144834 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edc076-e3c8-4572-9b89-94eb664ab15e service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:55.145241 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edc076-e3c8-4572-9b89-94eb664ab15e service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:55.145591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edc076-e3c8-4572-9b89-94eb664ab15e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:55.225842 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83edc076-e3c8-4572-9b89-94eb664ab15e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:55.227364 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83edc076-e3c8-4572-9b89-94eb664ab15e service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:55.237917 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 995/1966] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:56:55 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:56:55.320422 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:56.344681 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a685194-6ae7-416b-8ad1-53f1f47c4b90 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:56.345375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a685194-6ae7-416b-8ad1-53f1f47c4b90 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:56.345375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a685194-6ae7-416b-8ad1-53f1f47c4b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:56.378610 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-8a685194-6ae7-416b-8ad1-53f1f47c4b90 None None] MFA Rules not processed for user `c951fd797a694516ac54a92d26421389`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:56.379928 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-8a685194-6ae7-416b-8ad1-53f1f47c4b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:56.476017 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 972/1967] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:56.481943 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edc076-e3c8-4572-9b89-94eb664ab15e service cinder] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:56.501509 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edc076-e3c8-4572-9b89-94eb664ab15e service cinder] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:56.514686 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4ae0d-c369-4c25-aa13-cacf06147bc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:56.514686 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4ae0d-c369-4c25-aa13-cacf06147bc3 service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:56.514686 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4ae0d-c369-4c25-aa13-cacf06147bc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:56.514686 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4ae0d-c369-4c25-aa13-cacf06147bc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:56.519780 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-00e4ae0d-c369-4c25-aa13-cacf06147bc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:56.585730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e4ae0d-c369-4c25-aa13-cacf06147bc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:56.587320 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e4ae0d-c369-4c25-aa13-cacf06147bc3 service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:56.605161 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 996/1968] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:56:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:56:56.746218 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:56.988707 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:58.145383 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:58.497613 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:59.117434 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:59.160088 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a685194-6ae7-416b-8ad1-53f1f47c4b90 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:59.162173 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-8a685194-6ae7-416b-8ad1-53f1f47c4b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:59.238986 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a685194-6ae7-416b-8ad1-53f1f47c4b90 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:59.244923 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a2aaa-7f95-4235-b705-475719d3d4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:59.245898 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a2aaa-7f95-4235-b705-475719d3d4c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:59.246205 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a2aaa-7f95-4235-b705-475719d3d4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:59.246481 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a2aaa-7f95-4235-b705-475719d3d4c5 admin admin] PATH_INFO: `/v3/users/31687967e02845a4853f70ee042aab0e` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:59.247807 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a2aaa-7f95-4235-b705-475719d3d4c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31687967e02845a4853f70ee042aab0e)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:59.250873 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a2aaa-7f95-4235-b705-475719d3d4c5 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:59.430907 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:56:59.548293 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-c24a2aaa-7f95-4235-b705-475719d3d4c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31687967e02845a4853f70ee042aab0e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:59.555795 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-c24a2aaa-7f95-4235-b705-475719d3d4c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31687967e02845a4853f70ee042aab0e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:59.556485 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-c24a2aaa-7f95-4235-b705-475719d3d4c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31687967e02845a4853f70ee042aab0e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:59.569667 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-c24a2aaa-7f95-4235-b705-475719d3d4c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31687967e02845a4853f70ee042aab0e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:59.628178 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-c24a2aaa-7f95-4235-b705-475719d3d4c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31687967e02845a4853f70ee042aab0e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:56:59.634971 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 973/1969] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:56:59 2022] DELETE /identity/v3/users/31687967e02845a4853f70ee042aab0e => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:56:59.639620 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331b8e7-35c3-434e-b6e6-d9ea16e106a5 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:59.640145 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331b8e7-35c3-434e-b6e6-d9ea16e106a5 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:59.640244 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331b8e7-35c3-434e-b6e6-d9ea16e106a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:59.659208 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-d331b8e7-35c3-434e-b6e6-d9ea16e106a5 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:56:59.660494 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-d331b8e7-35c3-434e-b6e6-d9ea16e106a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:59.725291 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 997/1970] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:56:59.736854 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a2aaa-7f95-4235-b705-475719d3d4c5 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:56:59.737597 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-c24a2aaa-7f95-4235-b705-475719d3d4c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:56:59.803821 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a2aaa-7f95-4235-b705-475719d3d4c5 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:56:59.808000 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdb58e-0738-436a-afe7-4b2f66d51b44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:56:59.808724 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdb58e-0738-436a-afe7-4b2f66d51b44 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:56:59.809049 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdb58e-0738-436a-afe7-4b2f66d51b44 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:56:59.809332 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdb58e-0738-436a-afe7-4b2f66d51b44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:56:59.822511 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbdb58e-0738-436a-afe7-4b2f66d51b44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:56:59.824282 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbdb58e-0738-436a-afe7-4b2f66d51b44 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:56:59.836742 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 974/1971] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:56:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:57:00.001121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:00.256180 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:00.494180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331b8e7-35c3-434e-b6e6-d9ea16e106a5 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:00.495870 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-d331b8e7-35c3-434e-b6e6-d9ea16e106a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:00.509803 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331b8e7-35c3-434e-b6e6-d9ea16e106a5 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:00.517003 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c92e95-3a6e-419d-b2a9-b3d8f5e5ff53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:00.518040 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c92e95-3a6e-419d-b2a9-b3d8f5e5ff53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:00.518384 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c92e95-3a6e-419d-b2a9-b3d8f5e5ff53 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:00.518705 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c92e95-3a6e-419d-b2a9-b3d8f5e5ff53 admin admin] PATH_INFO: `/v3/projects/c2acc6945e8c477f803253d01b0db927` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:00.520327 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c92e95-3a6e-419d-b2a9-b3d8f5e5ff53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2acc6945e8c477f803253d01b0db927)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:00.521979 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c92e95-3a6e-419d-b2a9-b3d8f5e5ff53 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:00.623961 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6599b00-55cd-426b-9fa7-d8e90485ec5a None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:00.624854 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6599b00-55cd-426b-9fa7-d8e90485ec5a None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:00.625158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6599b00-55cd-426b-9fa7-d8e90485ec5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:00.662735 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-a6599b00-55cd-426b-9fa7-d8e90485ec5a None None] MFA Rules not processed for user `048fc48dd55a43f7b342533a9484c3ad`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:00.664158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-a6599b00-55cd-426b-9fa7-d8e90485ec5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:00.728815 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:00.730835 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-72c92e95-3a6e-419d-b2a9-b3d8f5e5ff53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2acc6945e8c477f803253d01b0db927', 'request_id': 'req-72c92e95-3a6e-419d-b2a9-b3d8f5e5ff53'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:00.738172 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 975/1972] 10.222.0.39 () {58 vars in 1009 bytes} [Mon May 23 15:57:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:57:00.751568 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-72c92e95-3a6e-419d-b2a9-b3d8f5e5ff53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2acc6945e8c477f803253d01b0db927', 'request_id': 'req-72c92e95-3a6e-419d-b2a9-b3d8f5e5ff53'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:00.752775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6599b00-55cd-426b-9fa7-d8e90485ec5a None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:00.754859 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-a6599b00-55cd-426b-9fa7-d8e90485ec5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:00.826755 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6599b00-55cd-426b-9fa7-d8e90485ec5a None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:00.829178 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-72c92e95-3a6e-419d-b2a9-b3d8f5e5ff53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2acc6945e8c477f803253d01b0db927', 'request_id': 'req-72c92e95-3a6e-419d-b2a9-b3d8f5e5ff53'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:00.855896 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-72c92e95-3a6e-419d-b2a9-b3d8f5e5ff53 admin admin] The token cache is being invalidate because project c2acc6945e8c477f803253d01b0db927 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:57:00.856902 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-72c92e95-3a6e-419d-b2a9-b3d8f5e5ff53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:00.865199 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-72c92e95-3a6e-419d-b2a9-b3d8f5e5ff53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:00.865199 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 998/1973] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:57:00 2022] DELETE /identity/v3/projects/c2acc6945e8c477f803253d01b0db927 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:00.876583 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c92e95-3a6e-419d-b2a9-b3d8f5e5ff53 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:00.879960 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-72c92e95-3a6e-419d-b2a9-b3d8f5e5ff53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:00.926436 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31389204-0462-4d36-bcc5-60724cc1a6a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b275a110936a44ce8d54793af1a34808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:00.927349 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31389204-0462-4d36-bcc5-60724cc1a6a0 service swift] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:00.927840 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31389204-0462-4d36-bcc5-60724cc1a6a0 service swift] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:00.928284 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31389204-0462-4d36-bcc5-60724cc1a6a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:00.930563 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-31389204-0462-4d36-bcc5-60724cc1a6a0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:00.983840 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c92e95-3a6e-419d-b2a9-b3d8f5e5ff53 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:00.989358 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9dbfd-1481-4861-853a-812921f52299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:00.990343 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9dbfd-1481-4861-853a-812921f52299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:00.990698 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9dbfd-1481-4861-853a-812921f52299 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:00.991043 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9dbfd-1481-4861-853a-812921f52299 admin admin] PATH_INFO: `/v3/users/9239ee6c66af46ad9c4b3d4425d63eae` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:00.992502 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9dbfd-1481-4861-853a-812921f52299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9239ee6c66af46ad9c4b3d4425d63eae)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:00.994680 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9dbfd-1481-4861-853a-812921f52299 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:00.997243 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31389204-0462-4d36-bcc5-60724cc1a6a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:00.999955 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31389204-0462-4d36-bcc5-60724cc1a6a0 service swift] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:01.013291 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 976/1974] 10.222.0.39 () {60 vars in 1384 bytes} [Mon May 23 15:57:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 15:57:01.281163 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:01.308249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-18e9dbfd-1481-4861-853a-812921f52299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9239ee6c66af46ad9c4b3d4425d63eae'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:01.309587 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-18e9dbfd-1481-4861-853a-812921f52299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9239ee6c66af46ad9c4b3d4425d63eae'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:01.312110 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-18e9dbfd-1481-4861-853a-812921f52299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9239ee6c66af46ad9c4b3d4425d63eae'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:01.424178 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-18e9dbfd-1481-4861-853a-812921f52299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9239ee6c66af46ad9c4b3d4425d63eae'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:01.435526 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-18e9dbfd-1481-4861-853a-812921f52299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9239ee6c66af46ad9c4b3d4425d63eae'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:01.485933 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 999/1975] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:57:00 2022] DELETE /identity/v3/users/9239ee6c66af46ad9c4b3d4425d63eae => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:02.342186 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31389204-0462-4d36-bcc5-60724cc1a6a0 service swift] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:02.359774 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31389204-0462-4d36-bcc5-60724cc1a6a0 service swift] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:02.523074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd81df-8690-4e4e-a3db-7615ba659cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:02.524160 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd81df-8690-4e4e-a3db-7615ba659cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:02.524554 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd81df-8690-4e4e-a3db-7615ba659cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:02.524940 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd81df-8690-4e4e-a3db-7615ba659cd4 admin admin] PATH_INFO: `/v3/projects/499e4e126b404be3b3cd361856ddf9a7` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:02.526410 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd81df-8690-4e4e-a3db-7615ba659cd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=499e4e126b404be3b3cd361856ddf9a7)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:02.532224 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd81df-8690-4e4e-a3db-7615ba659cd4 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:02.693849 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-47dd81df-8690-4e4e-a3db-7615ba659cd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '499e4e126b404be3b3cd361856ddf9a7', 'request_id': 'req-47dd81df-8690-4e4e-a3db-7615ba659cd4'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:02.716278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-47dd81df-8690-4e4e-a3db-7615ba659cd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '499e4e126b404be3b3cd361856ddf9a7', 'request_id': 'req-47dd81df-8690-4e4e-a3db-7615ba659cd4'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:02.832068 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-47dd81df-8690-4e4e-a3db-7615ba659cd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '499e4e126b404be3b3cd361856ddf9a7', 'request_id': 'req-47dd81df-8690-4e4e-a3db-7615ba659cd4'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:02.853249 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-47dd81df-8690-4e4e-a3db-7615ba659cd4 admin admin] The token cache is being invalidate because project 499e4e126b404be3b3cd361856ddf9a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:57:02.853551 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-47dd81df-8690-4e4e-a3db-7615ba659cd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:02.854373 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-47dd81df-8690-4e4e-a3db-7615ba659cd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:02.859152 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 977/1976] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:57:02 2022] DELETE /identity/v3/projects/499e4e126b404be3b3cd361856ddf9a7 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:02.861656 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23710ef-8735-4838-b338-9012ea978f7d None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:02.862133 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23710ef-8735-4838-b338-9012ea978f7d None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:02.862925 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23710ef-8735-4838-b338-9012ea978f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:02.904763 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-d23710ef-8735-4838-b338-9012ea978f7d None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:02.907507 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-d23710ef-8735-4838-b338-9012ea978f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:02.993654 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:03.026403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1000/1977] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:57:03.041049 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37824e82-d901-45ed-ae24-7c5b7edd30f1 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:03.043630 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37824e82-d901-45ed-ae24-7c5b7edd30f1 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:03.044078 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37824e82-d901-45ed-ae24-7c5b7edd30f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:03.072504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-37824e82-d901-45ed-ae24-7c5b7edd30f1 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:03.073736 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-37824e82-d901-45ed-ae24-7c5b7edd30f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:03.083576 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 978/1978] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:57:03.087980 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23710ef-8735-4838-b338-9012ea978f7d None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:03.098831 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23710ef-8735-4838-b338-9012ea978f7d None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:03.104482 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e3fc9-5f9a-4025-8e25-410e77c5373d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:03.105195 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e3fc9-5f9a-4025-8e25-410e77c5373d admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:03.105628 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e3fc9-5f9a-4025-8e25-410e77c5373d admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:03.105930 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e3fc9-5f9a-4025-8e25-410e77c5373d admin admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:03.106674 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e3fc9-5f9a-4025-8e25-410e77c5373d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:57:03.106987 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e3fc9-5f9a-4025-8e25-410e77c5373d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:03.109198 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e3fc9-5f9a-4025-8e25-410e77c5373d admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:03.130897 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1001/1979] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 15:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:57:03.136723 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37824e82-d901-45ed-ae24-7c5b7edd30f1 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:03.151052 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37824e82-d901-45ed-ae24-7c5b7edd30f1 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:03.153563 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:03.158880 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f0062-473b-4d22-a6c6-0c662a9b9ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:03.160033 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f0062-473b-4d22-a6c6-0c662a9b9ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:03.160033 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f0062-473b-4d22-a6c6-0c662a9b9ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:03.160393 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f0062-473b-4d22-a6c6-0c662a9b9ac2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:03.161245 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f0062-473b-4d22-a6c6-0c662a9b9ac2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:03.163467 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f0062-473b-4d22-a6c6-0c662a9b9ac2 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:03.329945 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 979/1980] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:57:03 2022] POST /identity/v3/projects => generated 377 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:57:03.334611 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e3fc9-5f9a-4025-8e25-410e77c5373d admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:03.346954 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e3fc9-5f9a-4025-8e25-410e77c5373d admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:03.410701 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad2328-13bf-4086-bebb-c63577d5a4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:03.411301 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad2328-13bf-4086-bebb-c63577d5a4af admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:03.411587 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad2328-13bf-4086-bebb-c63577d5a4af admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:03.411994 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad2328-13bf-4086-bebb-c63577d5a4af admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:03.412690 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad2328-13bf-4086-bebb-c63577d5a4af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:03.414628 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad2328-13bf-4086-bebb-c63577d5a4af admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:03.536951 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1002/1981] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:57:03 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:57:03.538307 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f0062-473b-4d22-a6c6-0c662a9b9ac2 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:03.550868 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f0062-473b-4d22-a6c6-0c662a9b9ac2 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:03.555892 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608e8fd-23ba-41c4-9774-4a09d2a7ce97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:03.556556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608e8fd-23ba-41c4-9774-4a09d2a7ce97 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:03.556840 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608e8fd-23ba-41c4-9774-4a09d2a7ce97 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:03.557114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608e8fd-23ba-41c4-9774-4a09d2a7ce97 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:03.557901 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608e8fd-23ba-41c4-9774-4a09d2a7ce97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:03.559520 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608e8fd-23ba-41c4-9774-4a09d2a7ce97 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:03.570378 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 980/1982] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:57:03.574441 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad2328-13bf-4086-bebb-c63577d5a4af admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:03.585088 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad2328-13bf-4086-bebb-c63577d5a4af admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:03.590080 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3507bd-05c5-47f8-8eb1-3c2cf85a87ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:03.590747 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3507bd-05c5-47f8-8eb1-3c2cf85a87ae admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:03.591031 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3507bd-05c5-47f8-8eb1-3c2cf85a87ae admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:03.591303 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3507bd-05c5-47f8-8eb1-3c2cf85a87ae admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:03.592097 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3507bd-05c5-47f8-8eb1-3c2cf85a87ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:03.594257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3507bd-05c5-47f8-8eb1-3c2cf85a87ae admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:03.609521 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1003/1983] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:57:03.610804 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608e8fd-23ba-41c4-9774-4a09d2a7ce97 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:03.621532 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608e8fd-23ba-41c4-9774-4a09d2a7ce97 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:03.626761 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb80eb-9be5-4239-9a6c-489c1caee8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:03.627679 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb80eb-9be5-4239-9a6c-489c1caee8e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:03.627986 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb80eb-9be5-4239-9a6c-489c1caee8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:03.628255 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb80eb-9be5-4239-9a6c-489c1caee8e8 admin admin] PATH_INFO: `/v3/projects/d8d68e277c744a91b017d5ba723dcea5/users/03f214ef6d3d4993b2079594dc8c4ab0/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:03.643109 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb80eb-9be5-4239-9a6c-489c1caee8e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8d68e277c744a91b017d5ba723dcea5, user_id=03f214ef6d3d4993b2079594dc8c4ab0, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:03.645873 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb80eb-9be5-4239-9a6c-489c1caee8e8 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:03.759310 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 981/1984] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:57:03 2022] PUT /identity/v3/projects/d8d68e277c744a91b017d5ba723dcea5/users/03f214ef6d3d4993b2079594dc8c4ab0/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:03.771076 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acb102-d2b6-47ef-8ea5-adfa15178f5e None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:03.771326 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acb102-d2b6-47ef-8ea5-adfa15178f5e None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:03.771757 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acb102-d2b6-47ef-8ea5-adfa15178f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:03.803760 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-28acb102-d2b6-47ef-8ea5-adfa15178f5e None None] MFA Rules not processed for user `03f214ef6d3d4993b2079594dc8c4ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:03.805058 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-28acb102-d2b6-47ef-8ea5-adfa15178f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:03.911853 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1004/1985] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:57:03.918306 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb80eb-9be5-4239-9a6c-489c1caee8e8 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:04.007680 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:04.066156 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb80eb-9be5-4239-9a6c-489c1caee8e8 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:04.081028 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a58ff2-cb61-415b-829d-7f87512594bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:04.082313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a58ff2-cb61-415b-829d-7f87512594bb admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:04.082605 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a58ff2-cb61-415b-829d-7f87512594bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:04.082883 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a58ff2-cb61-415b-829d-7f87512594bb admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:04.083841 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a58ff2-cb61-415b-829d-7f87512594bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:04.086695 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a58ff2-cb61-415b-829d-7f87512594bb admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:04.247814 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 982/1986] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:57:03 2022] POST /identity/v3/projects => generated 377 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:57:04.252344 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acb102-d2b6-47ef-8ea5-adfa15178f5e None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:04.266077 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acb102-d2b6-47ef-8ea5-adfa15178f5e None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:04.346587 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:04.367690 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732af39-fa0a-42c0-990e-2a0ec4871e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:04.373600 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732af39-fa0a-42c0-990e-2a0ec4871e10 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:04.373600 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732af39-fa0a-42c0-990e-2a0ec4871e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:04.373600 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732af39-fa0a-42c0-990e-2a0ec4871e10 admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:04.373600 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732af39-fa0a-42c0-990e-2a0ec4871e10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:04.373600 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732af39-fa0a-42c0-990e-2a0ec4871e10 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:04.439259 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a58ff2-cb61-415b-829d-7f87512594bb admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:04.441230 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-c8a58ff2-cb61-415b-829d-7f87512594bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:04.459529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1005/1987] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:57:04 2022] POST /identity/v3/users => generated 295 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:57:04.463441 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732af39-fa0a-42c0-990e-2a0ec4871e10 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:04.478668 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732af39-fa0a-42c0-990e-2a0ec4871e10 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:04.485632 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a14fe-a2fc-46ed-ab9a-f66707befe92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:04.486820 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a14fe-a2fc-46ed-ab9a-f66707befe92 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:04.487523 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a14fe-a2fc-46ed-ab9a-f66707befe92 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:04.488230 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a14fe-a2fc-46ed-ab9a-f66707befe92 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:04.489322 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a14fe-a2fc-46ed-ab9a-f66707befe92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:04.491462 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a14fe-a2fc-46ed-ab9a-f66707befe92 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:04.506580 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1006/1988] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:57:04.507794 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a14fe-a2fc-46ed-ab9a-f66707befe92 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:04.510054 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-dd2a14fe-a2fc-46ed-ab9a-f66707befe92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:04.527035 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a14fe-a2fc-46ed-ab9a-f66707befe92 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:04.533056 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a58ff2-cb61-415b-829d-7f87512594bb admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:04.535117 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33325d9-4255-4329-9ef0-bf89e5f27fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:04.536952 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0f180-b0fc-4944-ad82-5f9616477537 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:04.537752 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0f180-b0fc-4944-ad82-5f9616477537 service cinder] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:04.538216 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0f180-b0fc-4944-ad82-5f9616477537 service cinder] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:04.544085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0f180-b0fc-4944-ad82-5f9616477537 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:04.544085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-bfd0f180-b0fc-4944-ad82-5f9616477537 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:04.544797 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33325d9-4255-4329-9ef0-bf89e5f27fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:04.544797 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33325d9-4255-4329-9ef0-bf89e5f27fca admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:04.544961 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33325d9-4255-4329-9ef0-bf89e5f27fca admin admin] PATH_INFO: `/v3/users/ac229ef5b05d438a927043481781dc06` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:04.546852 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33325d9-4255-4329-9ef0-bf89e5f27fca admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac229ef5b05d438a927043481781dc06)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:04.549366 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33325d9-4255-4329-9ef0-bf89e5f27fca admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:04.614235 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0f180-b0fc-4944-ad82-5f9616477537 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:04.615743 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0f180-b0fc-4944-ad82-5f9616477537 service cinder] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:04.626195 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 983/1989] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:57:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:57:04.627087 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0f180-b0fc-4944-ad82-5f9616477537 service cinder] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:04.637609 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0f180-b0fc-4944-ad82-5f9616477537 service cinder] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:04.642444 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a8e90-ff67-40eb-9527-3af491177758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:04.643326 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a8e90-ff67-40eb-9527-3af491177758 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:04.643655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a8e90-ff67-40eb-9527-3af491177758 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:04.643938 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a8e90-ff67-40eb-9527-3af491177758 admin admin] PATH_INFO: `/v3/projects/7befc58859d644da801a82f91be5db2e/users/bc91e1ee7668467b891afb4cbf6e8dad/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:04.659736 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a8e90-ff67-40eb-9527-3af491177758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7befc58859d644da801a82f91be5db2e, user_id=bc91e1ee7668467b891afb4cbf6e8dad, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:04.662622 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a8e90-ff67-40eb-9527-3af491177758 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:04.732114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 984/1990] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:57:04 2022] PUT /identity/v3/projects/7befc58859d644da801a82f91be5db2e/users/bc91e1ee7668467b891afb4cbf6e8dad/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:04.737401 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a8e90-ff67-40eb-9527-3af491177758 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:04.792463 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-c33325d9-4255-4329-9ef0-bf89e5f27fca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac229ef5b05d438a927043481781dc06'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:04.793153 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-c33325d9-4255-4329-9ef0-bf89e5f27fca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac229ef5b05d438a927043481781dc06'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:04.793818 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-c33325d9-4255-4329-9ef0-bf89e5f27fca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac229ef5b05d438a927043481781dc06'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:04.804290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a8e90-ff67-40eb-9527-3af491177758 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:04.809140 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58496713-00af-4eca-9c50-74c1263f2319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:04.809825 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58496713-00af-4eca-9c50-74c1263f2319 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:04.810367 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58496713-00af-4eca-9c50-74c1263f2319 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:04.810651 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58496713-00af-4eca-9c50-74c1263f2319 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:04.811443 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58496713-00af-4eca-9c50-74c1263f2319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:04.817439 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58496713-00af-4eca-9c50-74c1263f2319 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:04.819067 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:04.831789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 985/1991] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:57:04.834639 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58496713-00af-4eca-9c50-74c1263f2319 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:04.836585 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-58496713-00af-4eca-9c50-74c1263f2319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:04.851411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58496713-00af-4eca-9c50-74c1263f2319 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:04.856552 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e33eb-6dbb-430f-b4ec-4a9a615ab651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:04.857526 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e33eb-6dbb-430f-b4ec-4a9a615ab651 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:04.857855 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e33eb-6dbb-430f-b4ec-4a9a615ab651 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:04.858165 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e33eb-6dbb-430f-b4ec-4a9a615ab651 admin admin] PATH_INFO: `/v3/projects/7befc58859d644da801a82f91be5db2e/users/bc91e1ee7668467b891afb4cbf6e8dad/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:04.860999 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e33eb-6dbb-430f-b4ec-4a9a615ab651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7befc58859d644da801a82f91be5db2e, user_id=bc91e1ee7668467b891afb4cbf6e8dad, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:04.864027 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e33eb-6dbb-430f-b4ec-4a9a615ab651 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:04.874522 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-c33325d9-4255-4329-9ef0-bf89e5f27fca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac229ef5b05d438a927043481781dc06'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:04.876805 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 986/1992] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:57:04 2022] PUT /identity/v3/projects/7befc58859d644da801a82f91be5db2e/users/bc91e1ee7668467b891afb4cbf6e8dad/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:57:04.883298 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-c33325d9-4255-4329-9ef0-bf89e5f27fca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac229ef5b05d438a927043481781dc06'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:04.887348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384f8ff-5b51-4fed-9d49-51beb5796c75 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:04.887682 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384f8ff-5b51-4fed-9d49-51beb5796c75 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:04.888111 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384f8ff-5b51-4fed-9d49-51beb5796c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:04.902480 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1007/1993] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:57:04 2022] DELETE /identity/v3/users/ac229ef5b05d438a927043481781dc06 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:04.908169 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b90f5-d511-40d8-9a9c-a1385e565ccb None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:04.908418 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b90f5-d511-40d8-9a9c-a1385e565ccb None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:04.908704 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b90f5-d511-40d8-9a9c-a1385e565ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:04.924262 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-3384f8ff-5b51-4fed-9d49-51beb5796c75 None None] MFA Rules not processed for user `bc91e1ee7668467b891afb4cbf6e8dad`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:04.925582 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-3384f8ff-5b51-4fed-9d49-51beb5796c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:04.939268 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-9e5b90f5-d511-40d8-9a9c-a1385e565ccb None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:04.941760 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-9e5b90f5-d511-40d8-9a9c-a1385e565ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:05.023794 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 987/1994] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:57:05.036263 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1008/1995] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:57:05.052451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b90f5-d511-40d8-9a9c-a1385e565ccb None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:05.052716 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384f8ff-5b51-4fed-9d49-51beb5796c75 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:05.052716 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-3384f8ff-5b51-4fed-9d49-51beb5796c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:05.053016 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-9e5b90f5-d511-40d8-9a9c-a1385e565ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:05.100001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:05.143173 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b90f5-d511-40d8-9a9c-a1385e565ccb None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:05.150844 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e5f6c-2629-4061-a4bf-8245edc9ec20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:05.151814 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e5f6c-2629-4061-a4bf-8245edc9ec20 service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:05.153361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e5f6c-2629-4061-a4bf-8245edc9ec20 service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:05.154564 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384f8ff-5b51-4fed-9d49-51beb5796c75 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:05.154932 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e5f6c-2629-4061-a4bf-8245edc9ec20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:05.157296 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-048e5f6c-2629-4061-a4bf-8245edc9ec20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:05.160779 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9ee68-f22d-4b93-94cc-d1e8f7f61d67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:05.161809 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9ee68-f22d-4b93-94cc-d1e8f7f61d67 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:05.162330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9ee68-f22d-4b93-94cc-d1e8f7f61d67 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:05.162844 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9ee68-f22d-4b93-94cc-d1e8f7f61d67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:05.174262 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d9ee68-f22d-4b93-94cc-d1e8f7f61d67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:05.176180 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d9ee68-f22d-4b93-94cc-d1e8f7f61d67 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:05.199795 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 988/1996] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:57:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:57:05.237682 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e5f6c-2629-4061-a4bf-8245edc9ec20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:05.237682 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e5f6c-2629-4061-a4bf-8245edc9ec20 service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:05.247388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1009/1997] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:57:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:57:05.992795 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9ee68-f22d-4b93-94cc-d1e8f7f61d67 service neutron] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:05.993554 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-36d9ee68-f22d-4b93-94cc-d1e8f7f61d67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:06.008025 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9ee68-f22d-4b93-94cc-d1e8f7f61d67 service neutron] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:06.015083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19bd1b-28bd-4e1f-b85a-4697e215e93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:06.016271 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19bd1b-28bd-4e1f-b85a-4697e215e93c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:06.021350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19bd1b-28bd-4e1f-b85a-4697e215e93c admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:06.021350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19bd1b-28bd-4e1f-b85a-4697e215e93c admin admin] PATH_INFO: `/v3/projects/eb4b269fa1894a09a27085e11ed28e67` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:06.021350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef19bd1b-28bd-4e1f-b85a-4697e215e93c admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb4b269fa1894a09a27085e11ed28e67)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:06.021350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef19bd1b-28bd-4e1f-b85a-4697e215e93c admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:06.152920 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-ef19bd1b-28bd-4e1f-b85a-4697e215e93c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb4b269fa1894a09a27085e11ed28e67', 'request_id': 'req-ef19bd1b-28bd-4e1f-b85a-4697e215e93c'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:06.160690 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-ef19bd1b-28bd-4e1f-b85a-4697e215e93c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb4b269fa1894a09a27085e11ed28e67', 'request_id': 'req-ef19bd1b-28bd-4e1f-b85a-4697e215e93c'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:06.276077 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-ef19bd1b-28bd-4e1f-b85a-4697e215e93c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb4b269fa1894a09a27085e11ed28e67', 'request_id': 'req-ef19bd1b-28bd-4e1f-b85a-4697e215e93c'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:06.277935 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:06.289966 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-ef19bd1b-28bd-4e1f-b85a-4697e215e93c admin admin] The token cache is being invalidate because project eb4b269fa1894a09a27085e11ed28e67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:57:06.290385 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-ef19bd1b-28bd-4e1f-b85a-4697e215e93c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:06.291144 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-ef19bd1b-28bd-4e1f-b85a-4697e215e93c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:06.293012 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 989/1998] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:57:05 2022] DELETE /identity/v3/projects/eb4b269fa1894a09a27085e11ed28e67 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:57:06.297176 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e5f6c-2629-4061-a4bf-8245edc9ec20 service cinder] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:06.308565 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e5f6c-2629-4061-a4bf-8245edc9ec20 service cinder] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:06.414781 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb777566-ae53-4c9c-a34a-c58c2c92b513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:06.415631 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb777566-ae53-4c9c-a34a-c58c2c92b513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:06.416014 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb777566-ae53-4c9c-a34a-c58c2c92b513 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:06.416286 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb777566-ae53-4c9c-a34a-c58c2c92b513 admin admin] PATH_INFO: `/v3/users/555090e6fd2449b8bb709abfbc7a02be` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:06.420652 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb777566-ae53-4c9c-a34a-c58c2c92b513 admin admin] RBAC: Authorizing `identity:delete_user(user_id=555090e6fd2449b8bb709abfbc7a02be)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:06.420652 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb777566-ae53-4c9c-a34a-c58c2c92b513 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:06.644685 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-eb777566-ae53-4c9c-a34a-c58c2c92b513 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '555090e6fd2449b8bb709abfbc7a02be'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:06.645455 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-eb777566-ae53-4c9c-a34a-c58c2c92b513 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '555090e6fd2449b8bb709abfbc7a02be'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:06.646476 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-eb777566-ae53-4c9c-a34a-c58c2c92b513 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '555090e6fd2449b8bb709abfbc7a02be'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:06.716835 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-eb777566-ae53-4c9c-a34a-c58c2c92b513 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '555090e6fd2449b8bb709abfbc7a02be'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:06.727169 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-eb777566-ae53-4c9c-a34a-c58c2c92b513 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '555090e6fd2449b8bb709abfbc7a02be'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:06.756952 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1010/1999] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:57:06 2022] DELETE /identity/v3/users/555090e6fd2449b8bb709abfbc7a02be => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:57:07.296847 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19bd1b-28bd-4e1f-b85a-4697e215e93c admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:07.298289 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-ef19bd1b-28bd-4e1f-b85a-4697e215e93c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:07.331057 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19bd1b-28bd-4e1f-b85a-4697e215e93c admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:07.432352 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3faba-3858-4336-9e88-4f450f8bfadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:07.433430 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3faba-3858-4336-9e88-4f450f8bfadf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:07.433778 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3faba-3858-4336-9e88-4f450f8bfadf admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:07.434139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3faba-3858-4336-9e88-4f450f8bfadf admin admin] PATH_INFO: `/v3/projects/4043a09699b14fdfaa056579f6041740` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:07.437161 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3faba-3858-4336-9e88-4f450f8bfadf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4043a09699b14fdfaa056579f6041740)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:07.442229 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3faba-3858-4336-9e88-4f450f8bfadf admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:07.559244 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-85b3faba-3858-4336-9e88-4f450f8bfadf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4043a09699b14fdfaa056579f6041740', 'request_id': 'req-85b3faba-3858-4336-9e88-4f450f8bfadf'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:07.566327 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-85b3faba-3858-4336-9e88-4f450f8bfadf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4043a09699b14fdfaa056579f6041740', 'request_id': 'req-85b3faba-3858-4336-9e88-4f450f8bfadf'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:07.666963 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-85b3faba-3858-4336-9e88-4f450f8bfadf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4043a09699b14fdfaa056579f6041740', 'request_id': 'req-85b3faba-3858-4336-9e88-4f450f8bfadf'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:07.685894 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-85b3faba-3858-4336-9e88-4f450f8bfadf admin admin] The token cache is being invalidate because project 4043a09699b14fdfaa056579f6041740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:57:07.686245 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-85b3faba-3858-4336-9e88-4f450f8bfadf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:07.687664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-85b3faba-3858-4336-9e88-4f450f8bfadf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:07.689249 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 990/2000] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:57:07 2022] DELETE /identity/v3/projects/4043a09699b14fdfaa056579f6041740 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:57:07.694859 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb1eda-420a-410a-b018-51bd5ee988d7 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:07.695899 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb1eda-420a-410a-b018-51bd5ee988d7 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:07.696315 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb1eda-420a-410a-b018-51bd5ee988d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:07.710125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:07.716987 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-2dbb1eda-420a-410a-b018-51bd5ee988d7 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:07.719488 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-2dbb1eda-420a-410a-b018-51bd5ee988d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:07.791889 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1011/2001] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:57:07.801012 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a290a6c-0694-44c4-88ab-ca642d98d7a8 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:07.801452 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a290a6c-0694-44c4-88ab-ca642d98d7a8 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:07.801905 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a290a6c-0694-44c4-88ab-ca642d98d7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:07.834573 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-3a290a6c-0694-44c4-88ab-ca642d98d7a8 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:07.836298 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-3a290a6c-0694-44c4-88ab-ca642d98d7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:07.847694 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 991/2002] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:57:07.852705 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb1eda-420a-410a-b018-51bd5ee988d7 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:07.868421 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb1eda-420a-410a-b018-51bd5ee988d7 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:07.873105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b287604-5a33-43ff-bddb-9e5bd0290ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:07.873798 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b287604-5a33-43ff-bddb-9e5bd0290ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:07.874608 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b287604-5a33-43ff-bddb-9e5bd0290ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:07.875191 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b287604-5a33-43ff-bddb-9e5bd0290ba7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:07.876231 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b287604-5a33-43ff-bddb-9e5bd0290ba7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:57:07.876548 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b287604-5a33-43ff-bddb-9e5bd0290ba7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:07.879182 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b287604-5a33-43ff-bddb-9e5bd0290ba7 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:07.909462 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1012/2003] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 15:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:57:07.915465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a290a6c-0694-44c4-88ab-ca642d98d7a8 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:07.951458 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a290a6c-0694-44c4-88ab-ca642d98d7a8 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:07.959381 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05892d-dc81-4e80-a3bf-b531b72d7a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:07.960814 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05892d-dc81-4e80-a3bf-b531b72d7a0e admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:07.961489 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05892d-dc81-4e80-a3bf-b531b72d7a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:07.962173 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05892d-dc81-4e80-a3bf-b531b72d7a0e admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:07.963638 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05892d-dc81-4e80-a3bf-b531b72d7a0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:07.967265 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05892d-dc81-4e80-a3bf-b531b72d7a0e admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:08.071631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 992/2004] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:57:07 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:57:08.074958 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b287604-5a33-43ff-bddb-9e5bd0290ba7 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:08.095230 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b287604-5a33-43ff-bddb-9e5bd0290ba7 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:08.243139 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089415b-417b-4ad3-bf8f-86f33b39944d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:08.244583 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089415b-417b-4ad3-bf8f-86f33b39944d admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:08.245222 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089415b-417b-4ad3-bf8f-86f33b39944d admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:08.245856 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089415b-417b-4ad3-bf8f-86f33b39944d admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:08.247092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2089415b-417b-4ad3-bf8f-86f33b39944d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:08.249406 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2089415b-417b-4ad3-bf8f-86f33b39944d admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:08.333740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05892d-dc81-4e80-a3bf-b531b72d7a0e admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:08.336225 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-7d05892d-dc81-4e80-a3bf-b531b72d7a0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:08.348616 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1013/2005] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:57:08 2022] POST /identity/v3/users => generated 293 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:57:08.350665 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089415b-417b-4ad3-bf8f-86f33b39944d admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:08.370187 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089415b-417b-4ad3-bf8f-86f33b39944d admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:08.381797 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723cf62-bdd8-4b68-87de-5fa646b444c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:08.382871 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723cf62-bdd8-4b68-87de-5fa646b444c5 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:08.383650 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723cf62-bdd8-4b68-87de-5fa646b444c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:08.384215 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723cf62-bdd8-4b68-87de-5fa646b444c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:08.385273 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723cf62-bdd8-4b68-87de-5fa646b444c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:08.388347 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723cf62-bdd8-4b68-87de-5fa646b444c5 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:08.413636 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1014/2006] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:57:08.419622 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723cf62-bdd8-4b68-87de-5fa646b444c5 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:08.441304 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723cf62-bdd8-4b68-87de-5fa646b444c5 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:08.449106 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05892d-dc81-4e80-a3bf-b531b72d7a0e admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:08.449748 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92225d4-b6b0-4c7d-bb38-481ecde7265f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:08.451219 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92225d4-b6b0-4c7d-bb38-481ecde7265f admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:08.451767 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92225d4-b6b0-4c7d-bb38-481ecde7265f admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:08.458309 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92225d4-b6b0-4c7d-bb38-481ecde7265f admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:08.458309 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92225d4-b6b0-4c7d-bb38-481ecde7265f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:08.458309 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92225d4-b6b0-4c7d-bb38-481ecde7265f admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:08.459546 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f3ce9-8305-43fd-bb06-8671cd36fb49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:08.463040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f3ce9-8305-43fd-bb06-8671cd36fb49 service cinder] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:08.463769 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f3ce9-8305-43fd-bb06-8671cd36fb49 service cinder] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:08.464319 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f3ce9-8305-43fd-bb06-8671cd36fb49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:08.472726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-7e5f3ce9-8305-43fd-bb06-8671cd36fb49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:08.482215 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1015/2007] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:57:08.488210 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:08.489751 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92225d4-b6b0-4c7d-bb38-481ecde7265f admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:08.510691 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92225d4-b6b0-4c7d-bb38-481ecde7265f admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:08.529628 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1dffec-4209-4b02-aefe-0e1d4c2a93c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:08.532546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1dffec-4209-4b02-aefe-0e1d4c2a93c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:08.532546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1dffec-4209-4b02-aefe-0e1d4c2a93c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:08.532546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1dffec-4209-4b02-aefe-0e1d4c2a93c4 admin admin] PATH_INFO: `/v3/projects/12ddd2e5dc104f109eab79c66b8dfeb4/users/80434b88a8c84641ad551c5b68a9e41e/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:08.565032 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1dffec-4209-4b02-aefe-0e1d4c2a93c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12ddd2e5dc104f109eab79c66b8dfeb4, user_id=80434b88a8c84641ad551c5b68a9e41e, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:08.570140 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1dffec-4209-4b02-aefe-0e1d4c2a93c4 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:08.574707 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f3ce9-8305-43fd-bb06-8671cd36fb49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:08.576547 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f3ce9-8305-43fd-bb06-8671cd36fb49 service cinder] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:08.594859 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 993/2008] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:57:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:57:08.684472 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1016/2009] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:57:08 2022] PUT /identity/v3/projects/12ddd2e5dc104f109eab79c66b8dfeb4/users/80434b88a8c84641ad551c5b68a9e41e/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:08.687199 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a8566-d320-434c-b8dc-3127c14e22bb None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:08.687957 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a8566-d320-434c-b8dc-3127c14e22bb None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:08.688243 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a8566-d320-434c-b8dc-3127c14e22bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:08.733037 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-3d0a8566-d320-434c-b8dc-3127c14e22bb None None] MFA Rules not processed for user `80434b88a8c84641ad551c5b68a9e41e`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:08.735035 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-3d0a8566-d320-434c-b8dc-3127c14e22bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:08.820932 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 994/2010] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:57:08.839133 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1dffec-4209-4b02-aefe-0e1d4c2a93c4 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:08.894844 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:08.918117 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1dffec-4209-4b02-aefe-0e1d4c2a93c4 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:08.932122 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf57da83-9e88-4110-be0c-470b3d26e74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:08.933050 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57da83-9e88-4110-be0c-470b3d26e74b admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:08.933371 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57da83-9e88-4110-be0c-470b3d26e74b admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:08.933655 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57da83-9e88-4110-be0c-470b3d26e74b admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:08.934384 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf57da83-9e88-4110-be0c-470b3d26e74b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:08.937191 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf57da83-9e88-4110-be0c-470b3d26e74b admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:09.028427 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1017/2011] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:57:08 2022] POST /identity/v3/projects => generated 387 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:57:09.033119 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a8566-d320-434c-b8dc-3127c14e22bb None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:09.044879 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a8566-d320-434c-b8dc-3127c14e22bb None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:09.120689 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b961c92-ccce-4adb-a302-9334bd57f387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:09.121385 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b961c92-ccce-4adb-a302-9334bd57f387 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:09.121671 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b961c92-ccce-4adb-a302-9334bd57f387 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:09.121955 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b961c92-ccce-4adb-a302-9334bd57f387 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:09.123928 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b961c92-ccce-4adb-a302-9334bd57f387 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:09.125212 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b961c92-ccce-4adb-a302-9334bd57f387 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:09.235556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 995/2012] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:57:09 2022] POST /identity/v3/users => generated 300 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:57:09.239824 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf57da83-9e88-4110-be0c-470b3d26e74b admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:09.252359 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf57da83-9e88-4110-be0c-470b3d26e74b admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:09.259033 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315b082-6835-41e8-80a9-b759c0440538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:09.265581 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315b082-6835-41e8-80a9-b759c0440538 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:09.265581 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315b082-6835-41e8-80a9-b759c0440538 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:09.265581 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315b082-6835-41e8-80a9-b759c0440538 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:09.265581 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e315b082-6835-41e8-80a9-b759c0440538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:09.265581 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e315b082-6835-41e8-80a9-b759c0440538 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:09.300306 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1018/2013] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:57:09.304456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b961c92-ccce-4adb-a302-9334bd57f387 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:09.320980 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b961c92-ccce-4adb-a302-9334bd57f387 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:09.331067 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf856e-22d3-414a-bc2b-4526c14d00f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:09.343382 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf856e-22d3-414a-bc2b-4526c14d00f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:09.345476 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf856e-22d3-414a-bc2b-4526c14d00f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:09.345476 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf856e-22d3-414a-bc2b-4526c14d00f3 admin admin] PATH_INFO: `/v3/projects/edbe0e006baa490c99115d5c82b2e31a/users/997622ec003246f7a8abf4d3d9e50819/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:09.372731 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf856e-22d3-414a-bc2b-4526c14d00f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edbe0e006baa490c99115d5c82b2e31a, user_id=997622ec003246f7a8abf4d3d9e50819, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:09.378718 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf856e-22d3-414a-bc2b-4526c14d00f3 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:09.461756 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 996/2014] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:57:09 2022] PUT /identity/v3/projects/edbe0e006baa490c99115d5c82b2e31a/users/997622ec003246f7a8abf4d3d9e50819/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:09.464919 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:09.466537 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315b082-6835-41e8-80a9-b759c0440538 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:09.496810 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315b082-6835-41e8-80a9-b759c0440538 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:09.612317 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a9fbf-d226-41eb-94b6-785b8f7e325c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:09.612997 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a9fbf-d226-41eb-94b6-785b8f7e325c admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:09.613286 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a9fbf-d226-41eb-94b6-785b8f7e325c admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:09.613564 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a9fbf-d226-41eb-94b6-785b8f7e325c admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:09.614300 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a9fbf-d226-41eb-94b6-785b8f7e325c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:09.615985 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a9fbf-d226-41eb-94b6-785b8f7e325c admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:09.628644 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1019/2015] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:57:09.631854 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf856e-22d3-414a-bc2b-4526c14d00f3 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:09.644421 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf856e-22d3-414a-bc2b-4526c14d00f3 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:09.649517 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb36ba-4c42-4eb1-9b1f-f43cb0969b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:09.650419 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb36ba-4c42-4eb1-9b1f-f43cb0969b8b admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:09.650704 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb36ba-4c42-4eb1-9b1f-f43cb0969b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:09.650983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb36ba-4c42-4eb1-9b1f-f43cb0969b8b admin admin] PATH_INFO: `/v3/projects/edbe0e006baa490c99115d5c82b2e31a/users/997622ec003246f7a8abf4d3d9e50819/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:09.653037 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb36ba-4c42-4eb1-9b1f-f43cb0969b8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=edbe0e006baa490c99115d5c82b2e31a, user_id=997622ec003246f7a8abf4d3d9e50819, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:09.655928 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb36ba-4c42-4eb1-9b1f-f43cb0969b8b admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:09.671549 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 997/2016] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:57:09 2022] PUT /identity/v3/projects/edbe0e006baa490c99115d5c82b2e31a/users/997622ec003246f7a8abf4d3d9e50819/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:09.679294 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579dbc5-df5b-444c-8b46-570c414cda42 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:09.679734 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579dbc5-df5b-444c-8b46-570c414cda42 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:09.680060 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579dbc5-df5b-444c-8b46-570c414cda42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:09.714336 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-9579dbc5-df5b-444c-8b46-570c414cda42 None None] MFA Rules not processed for user `997622ec003246f7a8abf4d3d9e50819`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:09.715673 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-9579dbc5-df5b-444c-8b46-570c414cda42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:09.810240 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1020/2017] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:57:09.821084 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb36ba-4c42-4eb1-9b1f-f43cb0969b8b admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:09.822877 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-b3bb36ba-4c42-4eb1-9b1f-f43cb0969b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:09.905742 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb36ba-4c42-4eb1-9b1f-f43cb0969b8b admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:09.914275 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab2780-ba3d-4c58-98de-9996a8f8b1b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:09.915894 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab2780-ba3d-4c58-98de-9996a8f8b1b4 service cinder] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:09.916610 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab2780-ba3d-4c58-98de-9996a8f8b1b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:09.917297 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab2780-ba3d-4c58-98de-9996a8f8b1b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:09.940922 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab2780-ba3d-4c58-98de-9996a8f8b1b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:09.942565 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab2780-ba3d-4c58-98de-9996a8f8b1b4 service cinder] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:09.954477 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 998/2018] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:57:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:57:10.376367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579dbc5-df5b-444c-8b46-570c414cda42 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:10.378016 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-9579dbc5-df5b-444c-8b46-570c414cda42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:10.459688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:10.507789 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579dbc5-df5b-444c-8b46-570c414cda42 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:10.513286 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab9ae8-0f4e-4915-b9da-d3bed7629168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:10.520480 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab9ae8-0f4e-4915-b9da-d3bed7629168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:10.520480 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab9ae8-0f4e-4915-b9da-d3bed7629168 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:10.520480 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab9ae8-0f4e-4915-b9da-d3bed7629168 admin admin] PATH_INFO: `/v3/users/9092f3fd53e74ba48d9aa0215dd00d4e` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:10.520480 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab9ae8-0f4e-4915-b9da-d3bed7629168 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9092f3fd53e74ba48d9aa0215dd00d4e)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:10.520480 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab9ae8-0f4e-4915-b9da-d3bed7629168 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:10.748074 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-2aab9ae8-0f4e-4915-b9da-d3bed7629168 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9092f3fd53e74ba48d9aa0215dd00d4e'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:10.750179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-2aab9ae8-0f4e-4915-b9da-d3bed7629168 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9092f3fd53e74ba48d9aa0215dd00d4e'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:10.750939 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-2aab9ae8-0f4e-4915-b9da-d3bed7629168 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9092f3fd53e74ba48d9aa0215dd00d4e'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:10.896147 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-2aab9ae8-0f4e-4915-b9da-d3bed7629168 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9092f3fd53e74ba48d9aa0215dd00d4e'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:10.934695 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-2aab9ae8-0f4e-4915-b9da-d3bed7629168 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9092f3fd53e74ba48d9aa0215dd00d4e'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:10.973286 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1021/2019] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:57:10 2022] DELETE /identity/v3/users/9092f3fd53e74ba48d9aa0215dd00d4e => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:10.984154 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95b44a-2300-4611-894f-8cb4d27880a7 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:10.988105 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95b44a-2300-4611-894f-8cb4d27880a7 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:10.989065 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95b44a-2300-4611-894f-8cb4d27880a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:11.027968 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-cb95b44a-2300-4611-894f-8cb4d27880a7 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:11.029539 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-cb95b44a-2300-4611-894f-8cb4d27880a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:11.157820 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 999/2020] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:57:11.175992 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab9ae8-0f4e-4915-b9da-d3bed7629168 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:11.179666 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-2aab9ae8-0f4e-4915-b9da-d3bed7629168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:11.287643 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab9ae8-0f4e-4915-b9da-d3bed7629168 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:11.292116 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd65d2-6ae2-4d1c-9c09-f2c07d790595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:11.293324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd65d2-6ae2-4d1c-9c09-f2c07d790595 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:11.293324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd65d2-6ae2-4d1c-9c09-f2c07d790595 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:11.293628 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd65d2-6ae2-4d1c-9c09-f2c07d790595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:11.307657 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd65d2-6ae2-4d1c-9c09-f2c07d790595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:11.308946 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd65d2-6ae2-4d1c-9c09-f2c07d790595 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:11.339379 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1022/2021] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:57:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:57:11.768714 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95b44a-2300-4611-894f-8cb4d27880a7 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:11.770227 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-cb95b44a-2300-4611-894f-8cb4d27880a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:11.783188 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95b44a-2300-4611-894f-8cb4d27880a7 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:11.788937 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484fbd4-69c7-48c1-887e-0bef6613c4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:11.789917 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484fbd4-69c7-48c1-887e-0bef6613c4f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:11.790266 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484fbd4-69c7-48c1-887e-0bef6613c4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:11.790612 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484fbd4-69c7-48c1-887e-0bef6613c4f1 admin admin] PATH_INFO: `/v3/users/80434b88a8c84641ad551c5b68a9e41e` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:11.791932 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484fbd4-69c7-48c1-887e-0bef6613c4f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80434b88a8c84641ad551c5b68a9e41e)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:11.793957 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484fbd4-69c7-48c1-887e-0bef6613c4f1 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:11.990652 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd65d2-6ae2-4d1c-9c09-f2c07d790595 service neutron] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:11.992509 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-febd65d2-6ae2-4d1c-9c09-f2c07d790595 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:12.008719 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd65d2-6ae2-4d1c-9c09-f2c07d790595 service neutron] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:12.021629 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db9a38-af93-408f-86b1-20a175517765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:12.021629 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db9a38-af93-408f-86b1-20a175517765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:12.021629 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db9a38-af93-408f-86b1-20a175517765 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:12.021629 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db9a38-af93-408f-86b1-20a175517765 admin admin] PATH_INFO: `/v3/projects/3281b581283a41619031200fc6f5ed78` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:12.022344 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db9a38-af93-408f-86b1-20a175517765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3281b581283a41619031200fc6f5ed78)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:12.022344 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db9a38-af93-408f-86b1-20a175517765 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:12.085144 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e484fbd4-69c7-48c1-887e-0bef6613c4f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80434b88a8c84641ad551c5b68a9e41e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:12.098067 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e484fbd4-69c7-48c1-887e-0bef6613c4f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80434b88a8c84641ad551c5b68a9e41e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:12.099097 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e484fbd4-69c7-48c1-887e-0bef6613c4f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80434b88a8c84641ad551c5b68a9e41e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:12.134640 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e484fbd4-69c7-48c1-887e-0bef6613c4f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80434b88a8c84641ad551c5b68a9e41e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:12.203699 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-40db9a38-af93-408f-86b1-20a175517765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3281b581283a41619031200fc6f5ed78', 'request_id': 'req-40db9a38-af93-408f-86b1-20a175517765'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:12.205796 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:12.234973 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-40db9a38-af93-408f-86b1-20a175517765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3281b581283a41619031200fc6f5ed78', 'request_id': 'req-40db9a38-af93-408f-86b1-20a175517765'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:12.263211 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e484fbd4-69c7-48c1-887e-0bef6613c4f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80434b88a8c84641ad551c5b68a9e41e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:12.286444 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1000/2022] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:57:11 2022] DELETE /identity/v3/users/80434b88a8c84641ad551c5b68a9e41e => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:12.286444 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c910442-9b9a-4c6f-b7f3-51d880e15868 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:12.286444 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c910442-9b9a-4c6f-b7f3-51d880e15868 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:12.286444 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c910442-9b9a-4c6f-b7f3-51d880e15868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:12.296106 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:12.310962 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-6c910442-9b9a-4c6f-b7f3-51d880e15868 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:12.313031 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-6c910442-9b9a-4c6f-b7f3-51d880e15868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:12.355381 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-40db9a38-af93-408f-86b1-20a175517765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3281b581283a41619031200fc6f5ed78', 'request_id': 'req-40db9a38-af93-408f-86b1-20a175517765'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:12.377077 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-40db9a38-af93-408f-86b1-20a175517765 admin admin] The token cache is being invalidate because project 3281b581283a41619031200fc6f5ed78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:57:12.377744 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-40db9a38-af93-408f-86b1-20a175517765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:12.378747 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-40db9a38-af93-408f-86b1-20a175517765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:12.381215 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1023/2023] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:57:11 2022] DELETE /identity/v3/projects/3281b581283a41619031200fc6f5ed78 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:12.386336 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1001/2024] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:57:12.386777 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db9a38-af93-408f-86b1-20a175517765 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:12.390959 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-40db9a38-af93-408f-86b1-20a175517765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:12.402501 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c910442-9b9a-4c6f-b7f3-51d880e15868 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:12.404661 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-6c910442-9b9a-4c6f-b7f3-51d880e15868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:12.491005 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c910442-9b9a-4c6f-b7f3-51d880e15868 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:12.496914 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7c478-fee6-4419-8a84-4c1b8c20279c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:12.497990 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7c478-fee6-4419-8a84-4c1b8c20279c service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:12.498551 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7c478-fee6-4419-8a84-4c1b8c20279c service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:12.499585 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7c478-fee6-4419-8a84-4c1b8c20279c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:12.507680 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db9a38-af93-408f-86b1-20a175517765 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:12.515394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7c478-fee6-4419-8a84-4c1b8c20279c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:12.521415 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f86d10-a595-4fbe-b167-6372112a71b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:12.521415 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f86d10-a595-4fbe-b167-6372112a71b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:12.521638 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7c478-fee6-4419-8a84-4c1b8c20279c service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:12.521726 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f86d10-a595-4fbe-b167-6372112a71b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:12.521726 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f86d10-a595-4fbe-b167-6372112a71b1 admin admin] PATH_INFO: `/v3/users/7f3c794f3c83463bb71f6f8f4708443c` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:12.521726 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f86d10-a595-4fbe-b167-6372112a71b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f3c794f3c83463bb71f6f8f4708443c)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:12.524485 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f86d10-a595-4fbe-b167-6372112a71b1 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:12.537931 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1002/2025] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:57:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:57:12.771887 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-57f86d10-a595-4fbe-b167-6372112a71b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f3c794f3c83463bb71f6f8f4708443c'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:12.773132 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-57f86d10-a595-4fbe-b167-6372112a71b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f3c794f3c83463bb71f6f8f4708443c'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:12.774181 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-57f86d10-a595-4fbe-b167-6372112a71b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f3c794f3c83463bb71f6f8f4708443c'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:12.879894 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-57f86d10-a595-4fbe-b167-6372112a71b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f3c794f3c83463bb71f6f8f4708443c'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:12.889298 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-57f86d10-a595-4fbe-b167-6372112a71b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f3c794f3c83463bb71f6f8f4708443c'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:12.908097 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1024/2026] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:57:12 2022] DELETE /identity/v3/users/7f3c794f3c83463bb71f6f8f4708443c => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:13.036104 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7c478-fee6-4419-8a84-4c1b8c20279c service neutron] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:13.038451 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-6df7c478-fee6-4419-8a84-4c1b8c20279c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:13.060710 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7c478-fee6-4419-8a84-4c1b8c20279c service neutron] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:13.128163 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db7a2d-2f35-4226-b3d8-bee1ff21b509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:13.129131 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db7a2d-2f35-4226-b3d8-bee1ff21b509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:13.129407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db7a2d-2f35-4226-b3d8-bee1ff21b509 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:13.129679 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db7a2d-2f35-4226-b3d8-bee1ff21b509 admin admin] PATH_INFO: `/v3/projects/12ddd2e5dc104f109eab79c66b8dfeb4` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:13.130866 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db7a2d-2f35-4226-b3d8-bee1ff21b509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12ddd2e5dc104f109eab79c66b8dfeb4)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:13.133181 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db7a2d-2f35-4226-b3d8-bee1ff21b509 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:13.282496 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:13.283988 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e3db7a2d-2f35-4226-b3d8-bee1ff21b509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12ddd2e5dc104f109eab79c66b8dfeb4', 'request_id': 'req-e3db7a2d-2f35-4226-b3d8-bee1ff21b509'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:13.292061 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e3db7a2d-2f35-4226-b3d8-bee1ff21b509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12ddd2e5dc104f109eab79c66b8dfeb4', 'request_id': 'req-e3db7a2d-2f35-4226-b3d8-bee1ff21b509'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:13.425280 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e3db7a2d-2f35-4226-b3d8-bee1ff21b509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12ddd2e5dc104f109eab79c66b8dfeb4', 'request_id': 'req-e3db7a2d-2f35-4226-b3d8-bee1ff21b509'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:13.436737 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f86d10-a595-4fbe-b167-6372112a71b1 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:13.439096 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-57f86d10-a595-4fbe-b167-6372112a71b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:13.465234 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f86d10-a595-4fbe-b167-6372112a71b1 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:13.471626 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e3db7a2d-2f35-4226-b3d8-bee1ff21b509 admin admin] The token cache is being invalidate because project 12ddd2e5dc104f109eab79c66b8dfeb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:57:13.472223 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e3db7a2d-2f35-4226-b3d8-bee1ff21b509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:13.474158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e3db7a2d-2f35-4226-b3d8-bee1ff21b509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:13.484386 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1003/2027] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:57:13 2022] DELETE /identity/v3/projects/12ddd2e5dc104f109eab79c66b8dfeb4 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:13.485639 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db7a2d-2f35-4226-b3d8-bee1ff21b509 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:13.487988 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-e3db7a2d-2f35-4226-b3d8-bee1ff21b509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:13.563658 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:13.582556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732aba99-aa31-4f93-821d-1cd683bbda6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:13.587205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732aba99-aa31-4f93-821d-1cd683bbda6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:13.587205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732aba99-aa31-4f93-821d-1cd683bbda6a admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:13.587205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732aba99-aa31-4f93-821d-1cd683bbda6a admin admin] PATH_INFO: `/v3/projects/8b5e194e87f84bddbe15afa85701e502` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:13.588398 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732aba99-aa31-4f93-821d-1cd683bbda6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b5e194e87f84bddbe15afa85701e502)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:13.593498 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732aba99-aa31-4f93-821d-1cd683bbda6a admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:13.605112 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db7a2d-2f35-4226-b3d8-bee1ff21b509 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:13.611721 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4639c5-f3a1-41fe-be02-da846adfbb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:13.612633 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4639c5-f3a1-41fe-be02-da846adfbb2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:13.612911 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4639c5-f3a1-41fe-be02-da846adfbb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:13.613183 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4639c5-f3a1-41fe-be02-da846adfbb2b admin admin] PATH_INFO: `/v3/users/997622ec003246f7a8abf4d3d9e50819` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:13.614469 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4639c5-f3a1-41fe-be02-da846adfbb2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=997622ec003246f7a8abf4d3d9e50819)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:13.616518 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4639c5-f3a1-41fe-be02-da846adfbb2b admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:13.850584 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-3c4639c5-f3a1-41fe-be02-da846adfbb2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '997622ec003246f7a8abf4d3d9e50819'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:13.851521 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-732aba99-aa31-4f93-821d-1cd683bbda6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b5e194e87f84bddbe15afa85701e502', 'request_id': 'req-732aba99-aa31-4f93-821d-1cd683bbda6a'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:13.858005 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-3c4639c5-f3a1-41fe-be02-da846adfbb2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '997622ec003246f7a8abf4d3d9e50819'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:13.859250 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-3c4639c5-f3a1-41fe-be02-da846adfbb2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '997622ec003246f7a8abf4d3d9e50819'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:13.859433 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-732aba99-aa31-4f93-821d-1cd683bbda6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b5e194e87f84bddbe15afa85701e502', 'request_id': 'req-732aba99-aa31-4f93-821d-1cd683bbda6a'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:13.872443 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-3c4639c5-f3a1-41fe-be02-da846adfbb2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '997622ec003246f7a8abf4d3d9e50819'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:13.942381 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-732aba99-aa31-4f93-821d-1cd683bbda6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b5e194e87f84bddbe15afa85701e502', 'request_id': 'req-732aba99-aa31-4f93-821d-1cd683bbda6a'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:13.953814 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-732aba99-aa31-4f93-821d-1cd683bbda6a admin admin] The token cache is being invalidate because project 8b5e194e87f84bddbe15afa85701e502 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:57:13.954128 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-732aba99-aa31-4f93-821d-1cd683bbda6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:13.954761 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-732aba99-aa31-4f93-821d-1cd683bbda6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:13.956431 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1025/2028] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:57:13 2022] DELETE /identity/v3/projects/8b5e194e87f84bddbe15afa85701e502 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:13.960338 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732aba99-aa31-4f93-821d-1cd683bbda6a admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:13.961656 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-732aba99-aa31-4f93-821d-1cd683bbda6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:14.027295 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732aba99-aa31-4f93-821d-1cd683bbda6a admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:14.028049 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-3c4639c5-f3a1-41fe-be02-da846adfbb2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '997622ec003246f7a8abf4d3d9e50819'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:14.033459 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bffe65f-eaa9-4c7a-bdaa-a8ac5b39630e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:14.034376 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffe65f-eaa9-4c7a-bdaa-a8ac5b39630e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:14.038437 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffe65f-eaa9-4c7a-bdaa-a8ac5b39630e admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:14.038437 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffe65f-eaa9-4c7a-bdaa-a8ac5b39630e admin admin] PATH_INFO: `/v3/users/d4d86ad3dca44c15833acc2195688c11` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:14.038437 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bffe65f-eaa9-4c7a-bdaa-a8ac5b39630e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4d86ad3dca44c15833acc2195688c11)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:14.038732 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1004/2029] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:57:13 2022] DELETE /identity/v3/users/997622ec003246f7a8abf4d3d9e50819 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:14.038810 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bffe65f-eaa9-4c7a-bdaa-a8ac5b39630e admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:14.237677 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-8bffe65f-eaa9-4c7a-bdaa-a8ac5b39630e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4d86ad3dca44c15833acc2195688c11'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:14.238348 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-8bffe65f-eaa9-4c7a-bdaa-a8ac5b39630e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4d86ad3dca44c15833acc2195688c11'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:14.239115 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-8bffe65f-eaa9-4c7a-bdaa-a8ac5b39630e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4d86ad3dca44c15833acc2195688c11'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:14.311105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-8bffe65f-eaa9-4c7a-bdaa-a8ac5b39630e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4d86ad3dca44c15833acc2195688c11'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:14.321047 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-8bffe65f-eaa9-4c7a-bdaa-a8ac5b39630e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4d86ad3dca44c15833acc2195688c11'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:14.341486 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1026/2030] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:57:13 2022] DELETE /identity/v3/users/d4d86ad3dca44c15833acc2195688c11 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:57:14.450404 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4639c5-f3a1-41fe-be02-da846adfbb2b admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:14.453117 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-3c4639c5-f3a1-41fe-be02-da846adfbb2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:14.544506 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:14.550753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4639c5-f3a1-41fe-be02-da846adfbb2b admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:14.658119 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b738a7c-0641-4998-ad96-1e34b06977c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:14.660748 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b738a7c-0641-4998-ad96-1e34b06977c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:14.661236 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b738a7c-0641-4998-ad96-1e34b06977c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:14.669110 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b738a7c-0641-4998-ad96-1e34b06977c4 admin admin] PATH_INFO: `/v3/projects/edbe0e006baa490c99115d5c82b2e31a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:14.673442 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b738a7c-0641-4998-ad96-1e34b06977c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edbe0e006baa490c99115d5c82b2e31a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:14.675438 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b738a7c-0641-4998-ad96-1e34b06977c4 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:14.739676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bffe65f-eaa9-4c7a-bdaa-a8ac5b39630e admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:14.741472 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-8bffe65f-eaa9-4c7a-bdaa-a8ac5b39630e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:14.756045 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bffe65f-eaa9-4c7a-bdaa-a8ac5b39630e admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:14.760795 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a800fa-3fb6-4422-b26c-ebc34b64ad45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:14.761666 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a800fa-3fb6-4422-b26c-ebc34b64ad45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:14.761943 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a800fa-3fb6-4422-b26c-ebc34b64ad45 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:14.762220 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a800fa-3fb6-4422-b26c-ebc34b64ad45 admin admin] PATH_INFO: `/v3/users/03f214ef6d3d4993b2079594dc8c4ab0` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:14.763453 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a800fa-3fb6-4422-b26c-ebc34b64ad45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03f214ef6d3d4993b2079594dc8c4ab0)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:14.765701 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a800fa-3fb6-4422-b26c-ebc34b64ad45 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:14.767470 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:14.805145 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-6b738a7c-0641-4998-ad96-1e34b06977c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edbe0e006baa490c99115d5c82b2e31a', 'request_id': 'req-6b738a7c-0641-4998-ad96-1e34b06977c4'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:14.811308 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-6b738a7c-0641-4998-ad96-1e34b06977c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edbe0e006baa490c99115d5c82b2e31a', 'request_id': 'req-6b738a7c-0641-4998-ad96-1e34b06977c4'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:14.887810 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-6b738a7c-0641-4998-ad96-1e34b06977c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edbe0e006baa490c99115d5c82b2e31a', 'request_id': 'req-6b738a7c-0641-4998-ad96-1e34b06977c4'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:14.900496 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-6b738a7c-0641-4998-ad96-1e34b06977c4 admin admin] The token cache is being invalidate because project edbe0e006baa490c99115d5c82b2e31a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:57:14.900799 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-6b738a7c-0641-4998-ad96-1e34b06977c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:14.901643 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-6b738a7c-0641-4998-ad96-1e34b06977c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:14.903479 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1005/2031] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:57:14 2022] DELETE /identity/v3/projects/edbe0e006baa490c99115d5c82b2e31a => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:14.909242 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa3254-cedd-44e4-9d06-16320d481ac0 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:14.909539 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa3254-cedd-44e4-9d06-16320d481ac0 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:14.909845 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa3254-cedd-44e4-9d06-16320d481ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:14.929196 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-69fa3254-cedd-44e4-9d06-16320d481ac0 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:14.937013 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-69fa3254-cedd-44e4-9d06-16320d481ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:14.998238 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-28a800fa-3fb6-4422-b26c-ebc34b64ad45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03f214ef6d3d4993b2079594dc8c4ab0'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:14.998906 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-28a800fa-3fb6-4422-b26c-ebc34b64ad45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03f214ef6d3d4993b2079594dc8c4ab0'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:14.999516 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-28a800fa-3fb6-4422-b26c-ebc34b64ad45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03f214ef6d3d4993b2079594dc8c4ab0'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:15.006386 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1006/2032] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:57:15.006386 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa3254-cedd-44e4-9d06-16320d481ac0 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:15.006386 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-69fa3254-cedd-44e4-9d06-16320d481ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:15.014172 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa3254-cedd-44e4-9d06-16320d481ac0 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:15.019667 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5de2d-a201-420e-a5d3-81a83060df1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:15.020527 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5de2d-a201-420e-a5d3-81a83060df1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:15.020809 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5de2d-a201-420e-a5d3-81a83060df1e admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:15.021083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5de2d-a201-420e-a5d3-81a83060df1e admin admin] PATH_INFO: `/v3/projects/1cc721cf690b474986b842eaaad32c49` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:15.022248 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5de2d-a201-420e-a5d3-81a83060df1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cc721cf690b474986b842eaaad32c49)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:15.024195 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5de2d-a201-420e-a5d3-81a83060df1e admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:15.110331 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-28a800fa-3fb6-4422-b26c-ebc34b64ad45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03f214ef6d3d4993b2079594dc8c4ab0'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:15.118007 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-28a800fa-3fb6-4422-b26c-ebc34b64ad45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03f214ef6d3d4993b2079594dc8c4ab0'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:15.136211 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1027/2033] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:57:14 2022] DELETE /identity/v3/users/03f214ef6d3d4993b2079594dc8c4ab0 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:15.137616 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3a743-c1d8-4dbb-96fa-d0694776f129 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:15.137907 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3a743-c1d8-4dbb-96fa-d0694776f129 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:15.138184 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3a743-c1d8-4dbb-96fa-d0694776f129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:15.158191 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-e3c3a743-c1d8-4dbb-96fa-d0694776f129 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:15.159394 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-e3c3a743-c1d8-4dbb-96fa-d0694776f129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:15.159875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:15.176821 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-dec5de2d-a201-420e-a5d3-81a83060df1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cc721cf690b474986b842eaaad32c49', 'request_id': 'req-dec5de2d-a201-420e-a5d3-81a83060df1e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:15.182618 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-dec5de2d-a201-420e-a5d3-81a83060df1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cc721cf690b474986b842eaaad32c49', 'request_id': 'req-dec5de2d-a201-420e-a5d3-81a83060df1e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:15.222644 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1028/2034] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:57:15.228022 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b8e2c-f9ef-4c7b-a07f-a32517bfb1a9 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:15.228318 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b8e2c-f9ef-4c7b-a07f-a32517bfb1a9 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:15.228590 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b8e2c-f9ef-4c7b-a07f-a32517bfb1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:15.247261 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-330b8e2c-f9ef-4c7b-a07f-a32517bfb1a9 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:15.248508 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-330b8e2c-f9ef-4c7b-a07f-a32517bfb1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:15.310540 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1029/2035] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:57:15.311580 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b8e2c-f9ef-4c7b-a07f-a32517bfb1a9 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:15.321382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b8e2c-f9ef-4c7b-a07f-a32517bfb1a9 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:15.326067 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbd2fe-ca2a-4aca-8c59-7f73e5c3a8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:15.326714 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbd2fe-ca2a-4aca-8c59-7f73e5c3a8d6 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:15.327538 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbd2fe-ca2a-4aca-8c59-7f73e5c3a8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:15.328149 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbd2fe-ca2a-4aca-8c59-7f73e5c3a8d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:15.328886 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbd2fe-ca2a-4aca-8c59-7f73e5c3a8d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:57:15.329193 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbd2fe-ca2a-4aca-8c59-7f73e5c3a8d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:15.330779 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbd2fe-ca2a-4aca-8c59-7f73e5c3a8d6 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:15.333596 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-dec5de2d-a201-420e-a5d3-81a83060df1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cc721cf690b474986b842eaaad32c49', 'request_id': 'req-dec5de2d-a201-420e-a5d3-81a83060df1e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:15.343731 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1030/2036] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 15:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:57:15.344549 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbd2fe-ca2a-4aca-8c59-7f73e5c3a8d6 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:15.346191 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-dec5de2d-a201-420e-a5d3-81a83060df1e admin admin] The token cache is being invalidate because project 1cc721cf690b474986b842eaaad32c49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:57:15.346499 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-dec5de2d-a201-420e-a5d3-81a83060df1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:15.347399 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-dec5de2d-a201-420e-a5d3-81a83060df1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:15.348261 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-a4cbd2fe-ca2a-4aca-8c59-7f73e5c3a8d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:15.349219 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1007/2037] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:57:14 2022] DELETE /identity/v3/projects/1cc721cf690b474986b842eaaad32c49 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:15.353761 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5de2d-a201-420e-a5d3-81a83060df1e admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:15.353761 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-dec5de2d-a201-420e-a5d3-81a83060df1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:15.358768 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:15.364688 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5de2d-a201-420e-a5d3-81a83060df1e admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:15.369537 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06526314-688d-4327-b720-7090d63483d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:15.370186 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06526314-688d-4327-b720-7090d63483d0 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:15.370471 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06526314-688d-4327-b720-7090d63483d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:15.370745 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06526314-688d-4327-b720-7090d63483d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:15.371427 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06526314-688d-4327-b720-7090d63483d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:15.373566 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06526314-688d-4327-b720-7090d63483d0 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:15.408071 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbd2fe-ca2a-4aca-8c59-7f73e5c3a8d6 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:15.412432 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f89450-69d5-4682-a859-c447e96b994f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:15.413183 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f89450-69d5-4682-a859-c447e96b994f service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:15.413463 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f89450-69d5-4682-a859-c447e96b994f service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:15.413738 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f89450-69d5-4682-a859-c447e96b994f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:15.415507 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-30f89450-69d5-4682-a859-c447e96b994f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:15.428041 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f89450-69d5-4682-a859-c447e96b994f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:15.429812 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f89450-69d5-4682-a859-c447e96b994f service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:15.440457 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1031/2038] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:57:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:57:15.441716 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d967b64-a413-4d9a-a9e9-1a693dc27f27 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:15.442005 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d967b64-a413-4d9a-a9e9-1a693dc27f27 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:15.442281 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d967b64-a413-4d9a-a9e9-1a693dc27f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:15.460799 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-1d967b64-a413-4d9a-a9e9-1a693dc27f27 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:15.462000 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-1d967b64-a413-4d9a-a9e9-1a693dc27f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:15.470466 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1032/2039] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:57:15.479607 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773251e-da2f-4798-978a-ef3b84f05113 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:15.479919 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773251e-da2f-4798-978a-ef3b84f05113 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:15.480198 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773251e-da2f-4798-978a-ef3b84f05113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:15.500080 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-1773251e-da2f-4798-978a-ef3b84f05113 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:15.501289 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-1773251e-da2f-4798-978a-ef3b84f05113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:15.509454 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1033/2040] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:57:15.525122 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773251e-da2f-4798-978a-ef3b84f05113 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:15.534799 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773251e-da2f-4798-978a-ef3b84f05113 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:15.540093 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0963c-cca6-48b6-8910-24bee711dc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:15.540770 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0963c-cca6-48b6-8910-24bee711dc05 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:15.541056 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0963c-cca6-48b6-8910-24bee711dc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:15.541334 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0963c-cca6-48b6-8910-24bee711dc05 admin admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:15.542065 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e0963c-cca6-48b6-8910-24bee711dc05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:57:15.542376 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e0963c-cca6-48b6-8910-24bee711dc05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:15.544017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e0963c-cca6-48b6-8910-24bee711dc05 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:15.556482 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1008/2041] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:57:15 2022] POST /identity/v3/projects => generated 383 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:57:15.560341 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1034/2042] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 15:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:57:15.563811 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06526314-688d-4327-b720-7090d63483d0 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:15.563950 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0963c-cca6-48b6-8910-24bee711dc05 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:15.573999 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0963c-cca6-48b6-8910-24bee711dc05 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:15.629539 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06526314-688d-4327-b720-7090d63483d0 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:15.634679 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbbd9ce-b50d-4c4e-93b2-8ea7f283e9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:15.635363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbd9ce-b50d-4c4e-93b2-8ea7f283e9e2 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:15.635653 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c2ce7-fef5-4f7d-b0b9-56aa1908665c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:15.635778 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbd9ce-b50d-4c4e-93b2-8ea7f283e9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:15.636021 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbd9ce-b50d-4c4e-93b2-8ea7f283e9e2 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:15.636376 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c2ce7-fef5-4f7d-b0b9-56aa1908665c admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:15.636667 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c2ce7-fef5-4f7d-b0b9-56aa1908665c admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:15.636840 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbbd9ce-b50d-4c4e-93b2-8ea7f283e9e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:15.636949 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c2ce7-fef5-4f7d-b0b9-56aa1908665c admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:15.637649 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c2ce7-fef5-4f7d-b0b9-56aa1908665c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:15.638705 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbbd9ce-b50d-4c4e-93b2-8ea7f283e9e2 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:15.642053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c2ce7-fef5-4f7d-b0b9-56aa1908665c admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:15.758485 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1035/2043] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:57:15 2022] POST /identity/v3/projects => generated 377 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:57:15.760626 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1009/2044] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:57:15 2022] POST /identity/v3/users => generated 292 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:57:15.764045 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbbd9ce-b50d-4c4e-93b2-8ea7f283e9e2 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:15.764842 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c2ce7-fef5-4f7d-b0b9-56aa1908665c admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:15.777583 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbbd9ce-b50d-4c4e-93b2-8ea7f283e9e2 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:15.855242 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c2ce7-fef5-4f7d-b0b9-56aa1908665c admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:15.861388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56b716-69fc-48a3-a192-68660a65102f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:15.862112 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56b716-69fc-48a3-a192-68660a65102f admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:15.868478 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56b716-69fc-48a3-a192-68660a65102f admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:15.868478 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56b716-69fc-48a3-a192-68660a65102f admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:15.868478 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e56b716-69fc-48a3-a192-68660a65102f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:15.868478 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e56b716-69fc-48a3-a192-68660a65102f admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:15.873376 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95472721-5f34-4d22-a43d-68de252f0460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:15.875623 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95472721-5f34-4d22-a43d-68de252f0460 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:15.875993 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95472721-5f34-4d22-a43d-68de252f0460 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:15.876275 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95472721-5f34-4d22-a43d-68de252f0460 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:15.877217 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95472721-5f34-4d22-a43d-68de252f0460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:15.878875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95472721-5f34-4d22-a43d-68de252f0460 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:15.895714 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1010/2045] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:57:15.905741 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95472721-5f34-4d22-a43d-68de252f0460 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:15.912693 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95472721-5f34-4d22-a43d-68de252f0460 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:15.919592 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0d85b-5740-4e25-91c3-2595fd22587b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:15.921356 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0d85b-5740-4e25-91c3-2595fd22587b admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:15.921721 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0d85b-5740-4e25-91c3-2595fd22587b admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:15.922232 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0d85b-5740-4e25-91c3-2595fd22587b admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:15.928570 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe0d85b-5740-4e25-91c3-2595fd22587b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:15.930333 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe0d85b-5740-4e25-91c3-2595fd22587b admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:15.945235 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1011/2046] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:57:15.946193 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0d85b-5740-4e25-91c3-2595fd22587b admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:15.948135 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-abe0d85b-5740-4e25-91c3-2595fd22587b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:15.951509 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:15.960561 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1036/2047] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:57:15 2022] POST /identity/v3/users => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:57:15.965526 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56b716-69fc-48a3-a192-68660a65102f admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:15.968911 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0d85b-5740-4e25-91c3-2595fd22587b admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:15.976804 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468fe5cd-8675-451e-8c6f-a00ad8051827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:15.978192 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fe5cd-8675-451e-8c6f-a00ad8051827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:15.978637 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fe5cd-8675-451e-8c6f-a00ad8051827 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:15.979031 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fe5cd-8675-451e-8c6f-a00ad8051827 admin admin] PATH_INFO: `/v3/projects/d8d68e277c744a91b017d5ba723dcea5` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:15.979450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56b716-69fc-48a3-a192-68660a65102f admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:15.981108 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468fe5cd-8675-451e-8c6f-a00ad8051827 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8d68e277c744a91b017d5ba723dcea5)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:15.985693 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468fe5cd-8675-451e-8c6f-a00ad8051827 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:15.985981 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd363e-c4e7-4870-9939-29c203331dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:15.987090 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd363e-c4e7-4870-9939-29c203331dd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:15.987881 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd363e-c4e7-4870-9939-29c203331dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:15.988182 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd363e-c4e7-4870-9939-29c203331dd2 admin admin] PATH_INFO: `/v3/projects/07aae44bdae94c58bbf5410f39566dfd/users/14fc12e1046643f1a64c37f128fc2af1/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:15.989302 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:16.009065 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd363e-c4e7-4870-9939-29c203331dd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07aae44bdae94c58bbf5410f39566dfd, user_id=14fc12e1046643f1a64c37f128fc2af1, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:16.012217 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd363e-c4e7-4870-9939-29c203331dd2 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:16.077189 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1037/2048] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:57:15 2022] PUT /identity/v3/projects/07aae44bdae94c58bbf5410f39566dfd/users/14fc12e1046643f1a64c37f128fc2af1/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:16.078032 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd363e-c4e7-4870-9939-29c203331dd2 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:16.113693 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-468fe5cd-8675-451e-8c6f-a00ad8051827 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8d68e277c744a91b017d5ba723dcea5', 'request_id': 'req-468fe5cd-8675-451e-8c6f-a00ad8051827'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:16.119150 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-468fe5cd-8675-451e-8c6f-a00ad8051827 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8d68e277c744a91b017d5ba723dcea5', 'request_id': 'req-468fe5cd-8675-451e-8c6f-a00ad8051827'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:16.144278 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd363e-c4e7-4870-9939-29c203331dd2 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:16.185220 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-468fe5cd-8675-451e-8c6f-a00ad8051827 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8d68e277c744a91b017d5ba723dcea5', 'request_id': 'req-468fe5cd-8675-451e-8c6f-a00ad8051827'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:16.197726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-468fe5cd-8675-451e-8c6f-a00ad8051827 admin admin] The token cache is being invalidate because project d8d68e277c744a91b017d5ba723dcea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:57:16.198175 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-468fe5cd-8675-451e-8c6f-a00ad8051827 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:16.198696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-468fe5cd-8675-451e-8c6f-a00ad8051827 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:16.200635 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1012/2049] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:57:15 2022] DELETE /identity/v3/projects/d8d68e277c744a91b017d5ba723dcea5 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:16.201949 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4daa06-cee7-41f4-b2f4-a56b67abb2d3 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:16.202238 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4daa06-cee7-41f4-b2f4-a56b67abb2d3 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:16.202534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4daa06-cee7-41f4-b2f4-a56b67abb2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:16.205392 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b5097-09ef-4df7-9e2a-bbebe980afd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:16.206219 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b5097-09ef-4df7-9e2a-bbebe980afd4 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:16.206479 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b5097-09ef-4df7-9e2a-bbebe980afd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:16.206778 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b5097-09ef-4df7-9e2a-bbebe980afd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:16.212026 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b5097-09ef-4df7-9e2a-bbebe980afd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:16.212026 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b5097-09ef-4df7-9e2a-bbebe980afd4 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:16.221944 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1038/2050] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:57:16.223020 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b5097-09ef-4df7-9e2a-bbebe980afd4 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:16.224911 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-445b5097-09ef-4df7-9e2a-bbebe980afd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:16.234084 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-ee4daa06-cee7-41f4-b2f4-a56b67abb2d3 None None] MFA Rules not processed for user `14fc12e1046643f1a64c37f128fc2af1`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:16.235309 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-ee4daa06-cee7-41f4-b2f4-a56b67abb2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:16.238812 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b5097-09ef-4df7-9e2a-bbebe980afd4 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:16.244848 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eab4e1-1cf4-4b31-84ec-a50f6f5e271a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:16.245733 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eab4e1-1cf4-4b31-84ec-a50f6f5e271a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:16.246014 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eab4e1-1cf4-4b31-84ec-a50f6f5e271a admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:16.246290 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eab4e1-1cf4-4b31-84ec-a50f6f5e271a admin admin] PATH_INFO: `/v3/users/bc91e1ee7668467b891afb4cbf6e8dad` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:16.247530 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eab4e1-1cf4-4b31-84ec-a50f6f5e271a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc91e1ee7668467b891afb4cbf6e8dad)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:16.249925 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eab4e1-1cf4-4b31-84ec-a50f6f5e271a admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:16.301982 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1013/2051] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:57:16.302922 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4daa06-cee7-41f4-b2f4-a56b67abb2d3 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:16.304274 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-ee4daa06-cee7-41f4-b2f4-a56b67abb2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:16.318661 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4daa06-cee7-41f4-b2f4-a56b67abb2d3 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:16.323236 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d772f-86f5-48fe-9abd-e8f3698bcb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:16.323928 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d772f-86f5-48fe-9abd-e8f3698bcb19 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:16.324206 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d772f-86f5-48fe-9abd-e8f3698bcb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:16.324477 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d772f-86f5-48fe-9abd-e8f3698bcb19 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:16.325198 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d772f-86f5-48fe-9abd-e8f3698bcb19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:16.326856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d772f-86f5-48fe-9abd-e8f3698bcb19 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:16.337009 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1014/2052] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:57:16.337795 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d772f-86f5-48fe-9abd-e8f3698bcb19 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:16.339526 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-842d772f-86f5-48fe-9abd-e8f3698bcb19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:16.353384 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d772f-86f5-48fe-9abd-e8f3698bcb19 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:16.359704 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b9f7c-055d-4a9b-9b32-32c7ca519d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:16.360496 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b9f7c-055d-4a9b-9b32-32c7ca519d2f admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:16.360788 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b9f7c-055d-4a9b-9b32-32c7ca519d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:16.361069 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b9f7c-055d-4a9b-9b32-32c7ca519d2f admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:16.361772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b9f7c-055d-4a9b-9b32-32c7ca519d2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:16.363782 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b9f7c-055d-4a9b-9b32-32c7ca519d2f admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:16.463879 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1015/2053] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:57:16 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:57:16.463879 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b9f7c-055d-4a9b-9b32-32c7ca519d2f admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:16.478670 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-84eab4e1-1cf4-4b31-84ec-a50f6f5e271a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc91e1ee7668467b891afb4cbf6e8dad'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:16.479445 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-84eab4e1-1cf4-4b31-84ec-a50f6f5e271a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc91e1ee7668467b891afb4cbf6e8dad'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:16.480085 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-84eab4e1-1cf4-4b31-84ec-a50f6f5e271a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc91e1ee7668467b891afb4cbf6e8dad'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:16.516146 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:16.529323 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b9f7c-055d-4a9b-9b32-32c7ca519d2f admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:16.534631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566dff8a-ddbf-44d0-a999-d2cfe499f3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:16.535524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566dff8a-ddbf-44d0-a999-d2cfe499f3f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:16.535839 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566dff8a-ddbf-44d0-a999-d2cfe499f3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:16.542168 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566dff8a-ddbf-44d0-a999-d2cfe499f3f6 admin admin] PATH_INFO: `/v3/projects/f8845c827f5d44a7bed46884aa34a921/users/7c175b7fe73d43e48ecb7be4242d9bf1/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:16.551669 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566dff8a-ddbf-44d0-a999-d2cfe499f3f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8845c827f5d44a7bed46884aa34a921, user_id=7c175b7fe73d43e48ecb7be4242d9bf1, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:16.554347 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566dff8a-ddbf-44d0-a999-d2cfe499f3f6 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:16.584990 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-84eab4e1-1cf4-4b31-84ec-a50f6f5e271a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc91e1ee7668467b891afb4cbf6e8dad'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:16.594242 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-84eab4e1-1cf4-4b31-84ec-a50f6f5e271a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc91e1ee7668467b891afb4cbf6e8dad'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:16.602164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:16.613167 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1039/2054] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:57:16 2022] DELETE /identity/v3/users/bc91e1ee7668467b891afb4cbf6e8dad => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:16.614136 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eab4e1-1cf4-4b31-84ec-a50f6f5e271a admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:16.615486 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-84eab4e1-1cf4-4b31-84ec-a50f6f5e271a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:16.680965 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1016/2055] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:57:16 2022] PUT /identity/v3/projects/f8845c827f5d44a7bed46884aa34a921/users/7c175b7fe73d43e48ecb7be4242d9bf1/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:16.688286 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eab4e1-1cf4-4b31-84ec-a50f6f5e271a admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:16.693529 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efba05-cd83-422a-8bcb-7c2ec5f09d2f None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:16.693860 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efba05-cd83-422a-8bcb-7c2ec5f09d2f None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:16.694089 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efba05-cd83-422a-8bcb-7c2ec5f09d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:16.733541 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-49efba05-cd83-422a-8bcb-7c2ec5f09d2f None None] MFA Rules not processed for user `7c175b7fe73d43e48ecb7be4242d9bf1`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:16.735116 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-49efba05-cd83-422a-8bcb-7c2ec5f09d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:16.780859 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e276fc-0d91-41de-8a41-963f582cba87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:16.780859 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e276fc-0d91-41de-8a41-963f582cba87 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:16.780859 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e276fc-0d91-41de-8a41-963f582cba87 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:16.780859 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e276fc-0d91-41de-8a41-963f582cba87 admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:16.781625 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e276fc-0d91-41de-8a41-963f582cba87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:16.781625 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e276fc-0d91-41de-8a41-963f582cba87 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:16.806664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1017/2056] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:57:16.818916 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efba05-cd83-422a-8bcb-7c2ec5f09d2f None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:16.820428 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-49efba05-cd83-422a-8bcb-7c2ec5f09d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:16.869501 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1040/2057] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:57:16 2022] POST /identity/v3/users => generated 298 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:57:16.875352 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e276fc-0d91-41de-8a41-963f582cba87 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:16.895280 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efba05-cd83-422a-8bcb-7c2ec5f09d2f None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:16.905925 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e276fc-0d91-41de-8a41-963f582cba87 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:16.914844 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac624861-ffca-41d3-aa13-9ff700a8f808 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:16.915522 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac624861-ffca-41d3-aa13-9ff700a8f808 service cinder] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:16.917477 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac624861-ffca-41d3-aa13-9ff700a8f808 service cinder] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:16.919829 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1a72b-b574-4b89-b21a-a000a56e8be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:16.920709 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1a72b-b574-4b89-b21a-a000a56e8be4 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:16.921008 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1a72b-b574-4b89-b21a-a000a56e8be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:16.921290 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1a72b-b574-4b89-b21a-a000a56e8be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:16.922694 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1a72b-b574-4b89-b21a-a000a56e8be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:16.923699 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1a72b-b574-4b89-b21a-a000a56e8be4 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:16.923831 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac624861-ffca-41d3-aa13-9ff700a8f808 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:16.945122 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac624861-ffca-41d3-aa13-9ff700a8f808 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:16.946598 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac624861-ffca-41d3-aa13-9ff700a8f808 service cinder] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:16.955838 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1041/2058] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:57:16.960314 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1a72b-b574-4b89-b21a-a000a56e8be4 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:16.977680 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1018/2059] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:57:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:57:16.984464 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1a72b-b574-4b89-b21a-a000a56e8be4 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:16.993524 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d9283-1200-4740-84f4-23031b9c25ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:16.994695 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d9283-1200-4740-84f4-23031b9c25ad admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:16.995343 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d9283-1200-4740-84f4-23031b9c25ad admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:16.995899 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d9283-1200-4740-84f4-23031b9c25ad admin admin] PATH_INFO: `/v3/projects/0040105485f74e8093ccd9adfdc0a074/users/39a60d3107ab48ab82de6036d36e8bdb/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:17.021276 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d9283-1200-4740-84f4-23031b9c25ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=0040105485f74e8093ccd9adfdc0a074, user_id=39a60d3107ab48ab82de6036d36e8bdb, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:17.050250 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d9283-1200-4740-84f4-23031b9c25ad admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:17.132818 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1042/2060] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:57:16 2022] PUT /identity/v3/projects/0040105485f74e8093ccd9adfdc0a074/users/39a60d3107ab48ab82de6036d36e8bdb/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:17.137087 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac624861-ffca-41d3-aa13-9ff700a8f808 service cinder] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:17.149188 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac624861-ffca-41d3-aa13-9ff700a8f808 service cinder] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:17.164110 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d9283-1200-4740-84f4-23031b9c25ad admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:17.166496 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-3b1d9283-1200-4740-84f4-23031b9c25ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:17.262429 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d9283-1200-4740-84f4-23031b9c25ad admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:17.267570 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0de8d-8622-44e3-83b5-2405748d1872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:17.268474 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0de8d-8622-44e3-83b5-2405748d1872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:17.268760 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0de8d-8622-44e3-83b5-2405748d1872 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:17.269037 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0de8d-8622-44e3-83b5-2405748d1872 admin admin] PATH_INFO: `/v3/projects/7befc58859d644da801a82f91be5db2e` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:17.270326 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0de8d-8622-44e3-83b5-2405748d1872 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7befc58859d644da801a82f91be5db2e)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:17.272280 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0de8d-8622-44e3-83b5-2405748d1872 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:17.280795 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c5254-5750-471f-8e4a-b272d4afb05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:17.282277 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c5254-5750-471f-8e4a-b272d4afb05d admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:17.282277 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c5254-5750-471f-8e4a-b272d4afb05d admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:17.282472 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c5254-5750-471f-8e4a-b272d4afb05d admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:17.283311 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c5254-5750-471f-8e4a-b272d4afb05d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:17.285114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c5254-5750-471f-8e4a-b272d4afb05d admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:17.291565 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:17.298083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1019/2061] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:57:17.303622 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c5254-5750-471f-8e4a-b272d4afb05d admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:17.307406 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:17.314385 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c5254-5750-471f-8e4a-b272d4afb05d admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:17.319503 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4587b57-7c02-4331-bd4d-235a2b363cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:17.320556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4587b57-7c02-4331-bd4d-235a2b363cf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:17.320839 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4587b57-7c02-4331-bd4d-235a2b363cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:17.321116 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4587b57-7c02-4331-bd4d-235a2b363cf4 admin admin] PATH_INFO: `/v3/projects/0040105485f74e8093ccd9adfdc0a074/users/39a60d3107ab48ab82de6036d36e8bdb/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:17.323114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4587b57-7c02-4331-bd4d-235a2b363cf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0040105485f74e8093ccd9adfdc0a074, user_id=39a60d3107ab48ab82de6036d36e8bdb, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:17.325825 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4587b57-7c02-4331-bd4d-235a2b363cf4 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:17.337442 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1020/2062] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:57:17 2022] PUT /identity/v3/projects/0040105485f74e8093ccd9adfdc0a074/users/39a60d3107ab48ab82de6036d36e8bdb/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:17.349472 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b28b44-43af-4f4e-b0e2-fd991e0cf0ab None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:17.349767 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b28b44-43af-4f4e-b0e2-fd991e0cf0ab None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:17.350048 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b28b44-43af-4f4e-b0e2-fd991e0cf0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:17.379686 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-52b28b44-43af-4f4e-b0e2-fd991e0cf0ab None None] MFA Rules not processed for user `39a60d3107ab48ab82de6036d36e8bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:17.381006 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-52b28b44-43af-4f4e-b0e2-fd991e0cf0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:17.434705 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-e2a0de8d-8622-44e3-83b5-2405748d1872 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7befc58859d644da801a82f91be5db2e', 'request_id': 'req-e2a0de8d-8622-44e3-83b5-2405748d1872'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:17.448437 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-e2a0de8d-8622-44e3-83b5-2405748d1872 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7befc58859d644da801a82f91be5db2e', 'request_id': 'req-e2a0de8d-8622-44e3-83b5-2405748d1872'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:17.455808 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1021/2063] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:57:17.468258 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b28b44-43af-4f4e-b0e2-fd991e0cf0ab None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:17.468258 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-52b28b44-43af-4f4e-b0e2-fd991e0cf0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:17.524313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b28b44-43af-4f4e-b0e2-fd991e0cf0ab None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:17.548483 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-e2a0de8d-8622-44e3-83b5-2405748d1872 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7befc58859d644da801a82f91be5db2e', 'request_id': 'req-e2a0de8d-8622-44e3-83b5-2405748d1872'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:17.564713 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-e2a0de8d-8622-44e3-83b5-2405748d1872 admin admin] The token cache is being invalidate because project 7befc58859d644da801a82f91be5db2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:57:17.565008 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-e2a0de8d-8622-44e3-83b5-2405748d1872 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:17.565675 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-e2a0de8d-8622-44e3-83b5-2405748d1872 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:17.567247 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1043/2064] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:57:17 2022] DELETE /identity/v3/projects/7befc58859d644da801a82f91be5db2e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:17.572288 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c106a7-475a-4e27-a8cc-f3e3842ee733 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:17.573016 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c106a7-475a-4e27-a8cc-f3e3842ee733 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:17.573313 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c106a7-475a-4e27-a8cc-f3e3842ee733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:17.579335 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e8e4d-8f63-4825-98bc-8de245a1133a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:17.580251 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e8e4d-8f63-4825-98bc-8de245a1133a service cinder] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:17.581498 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e8e4d-8f63-4825-98bc-8de245a1133a service cinder] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:17.581782 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e8e4d-8f63-4825-98bc-8de245a1133a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:17.583655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-303e8e4d-8f63-4825-98bc-8de245a1133a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:17.592132 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-e5c106a7-475a-4e27-a8cc-f3e3842ee733 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:17.593620 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-e5c106a7-475a-4e27-a8cc-f3e3842ee733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:17.643894 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e8e4d-8f63-4825-98bc-8de245a1133a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:17.645461 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e8e4d-8f63-4825-98bc-8de245a1133a service cinder] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:17.654640 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1044/2065] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:57:17.666485 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1022/2066] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:57:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:57:17.666975 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588c935-badd-480f-ba7f-de3961a92d73 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:17.666975 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588c935-badd-480f-ba7f-de3961a92d73 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:17.666975 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588c935-badd-480f-ba7f-de3961a92d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:17.686461 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-2588c935-badd-480f-ba7f-de3961a92d73 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:17.688074 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-2588c935-badd-480f-ba7f-de3961a92d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:17.696306 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1045/2067] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:57:17.700805 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e8e4d-8f63-4825-98bc-8de245a1133a service cinder] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:17.716696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e8e4d-8f63-4825-98bc-8de245a1133a service cinder] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:17.722104 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25048e38-f713-47e0-a553-bea9436fb35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:17.727190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25048e38-f713-47e0-a553-bea9436fb35f admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:17.727190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25048e38-f713-47e0-a553-bea9436fb35f admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:17.727190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25048e38-f713-47e0-a553-bea9436fb35f admin admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:17.727190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25048e38-f713-47e0-a553-bea9436fb35f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:57:17.727190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25048e38-f713-47e0-a553-bea9436fb35f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:17.727190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25048e38-f713-47e0-a553-bea9436fb35f admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:17.741461 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1023/2068] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 15:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:57:17.746052 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588c935-badd-480f-ba7f-de3961a92d73 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:17.755895 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588c935-badd-480f-ba7f-de3961a92d73 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:17.760678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808ed04-9153-4b7f-a691-605e80388189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:17.761283 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808ed04-9153-4b7f-a691-605e80388189 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:17.761569 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808ed04-9153-4b7f-a691-605e80388189 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:17.761849 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808ed04-9153-4b7f-a691-605e80388189 admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:17.762542 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808ed04-9153-4b7f-a691-605e80388189 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:17.765417 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808ed04-9153-4b7f-a691-605e80388189 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:17.921448 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1046/2069] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:57:17 2022] POST /identity/v3/projects => generated 381 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:57:17.923138 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25048e38-f713-47e0-a553-bea9436fb35f admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:17.935138 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25048e38-f713-47e0-a553-bea9436fb35f admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:17.993909 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22191e63-7259-4f23-9661-5a2b01ab2c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:17.994588 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22191e63-7259-4f23-9661-5a2b01ab2c83 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:17.994878 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22191e63-7259-4f23-9661-5a2b01ab2c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:17.995160 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22191e63-7259-4f23-9661-5a2b01ab2c83 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:17.995890 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22191e63-7259-4f23-9661-5a2b01ab2c83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:17.997851 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22191e63-7259-4f23-9661-5a2b01ab2c83 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:18.002343 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:18.070619 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1024/2070] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:57:17 2022] POST /identity/v3/users => generated 291 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:57:18.074868 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808ed04-9153-4b7f-a691-605e80388189 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:18.086208 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808ed04-9153-4b7f-a691-605e80388189 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:18.091193 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1a7ce-db33-4c20-92ba-eb8eee32366d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:18.091910 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1a7ce-db33-4c20-92ba-eb8eee32366d admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:18.099727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1a7ce-db33-4c20-92ba-eb8eee32366d admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:18.099727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1a7ce-db33-4c20-92ba-eb8eee32366d admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:18.099727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae1a7ce-db33-4c20-92ba-eb8eee32366d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:18.099727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae1a7ce-db33-4c20-92ba-eb8eee32366d admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:18.105828 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1047/2071] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:57:18.110267 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22191e63-7259-4f23-9661-5a2b01ab2c83 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:18.120394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22191e63-7259-4f23-9661-5a2b01ab2c83 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:18.125045 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d0f0b-ead9-4722-b191-d63a0e3478ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:18.128344 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d0f0b-ead9-4722-b191-d63a0e3478ed admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:18.128344 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d0f0b-ead9-4722-b191-d63a0e3478ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:18.128344 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d0f0b-ead9-4722-b191-d63a0e3478ed admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:18.128344 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d0f0b-ead9-4722-b191-d63a0e3478ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:18.128768 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d0f0b-ead9-4722-b191-d63a0e3478ed admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:18.138871 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1025/2072] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:57:18.143583 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1a7ce-db33-4c20-92ba-eb8eee32366d admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:18.153484 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1a7ce-db33-4c20-92ba-eb8eee32366d admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:18.158738 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37448f17-8db1-439a-a47e-4df60ab6bdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:18.159645 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37448f17-8db1-439a-a47e-4df60ab6bdac admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:18.159932 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37448f17-8db1-439a-a47e-4df60ab6bdac admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:18.160207 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37448f17-8db1-439a-a47e-4df60ab6bdac admin admin] PATH_INFO: `/v3/projects/5d0fb2b9a38c4110bccb97c1b87c7f78/users/442b4b2666e54688a80b65820ac60890/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:18.174774 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37448f17-8db1-439a-a47e-4df60ab6bdac admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d0fb2b9a38c4110bccb97c1b87c7f78, user_id=442b4b2666e54688a80b65820ac60890, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:18.177481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37448f17-8db1-439a-a47e-4df60ab6bdac admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:18.269078 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1048/2073] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:57:18 2022] PUT /identity/v3/projects/5d0fb2b9a38c4110bccb97c1b87c7f78/users/442b4b2666e54688a80b65820ac60890/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:18.280583 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855f02d-350e-405d-9457-7a8f8569626c None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:18.280886 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855f02d-350e-405d-9457-7a8f8569626c None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:18.281169 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855f02d-350e-405d-9457-7a8f8569626c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:18.308865 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-3855f02d-350e-405d-9457-7a8f8569626c None None] MFA Rules not processed for user `442b4b2666e54688a80b65820ac60890`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:18.311113 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-3855f02d-350e-405d-9457-7a8f8569626c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:18.391350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1026/2074] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:57:18.392648 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37448f17-8db1-439a-a47e-4df60ab6bdac admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:18.414680 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:18.472381 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37448f17-8db1-439a-a47e-4df60ab6bdac admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:18.479519 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8eb499-5c90-4904-8684-ccb156b0d1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:18.480257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8eb499-5c90-4904-8684-ccb156b0d1ee admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:18.480540 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8eb499-5c90-4904-8684-ccb156b0d1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:18.480817 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8eb499-5c90-4904-8684-ccb156b0d1ee admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:18.481578 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8eb499-5c90-4904-8684-ccb156b0d1ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:18.483761 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8eb499-5c90-4904-8684-ccb156b0d1ee admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:18.601631 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1049/2075] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:57:18 2022] POST /identity/v3/projects => generated 381 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:57:18.608238 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855f02d-350e-405d-9457-7a8f8569626c None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:18.616661 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855f02d-350e-405d-9457-7a8f8569626c None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:18.650253 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:18.672602 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db66c7-14fb-4dd6-889a-136584c52377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:18.673318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db66c7-14fb-4dd6-889a-136584c52377 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:18.673605 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db66c7-14fb-4dd6-889a-136584c52377 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:18.673880 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db66c7-14fb-4dd6-889a-136584c52377 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:18.674571 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db66c7-14fb-4dd6-889a-136584c52377 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:18.676582 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db66c7-14fb-4dd6-889a-136584c52377 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:18.805672 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1027/2076] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:57:18 2022] POST /identity/v3/users => generated 297 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:57:18.809658 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8eb499-5c90-4904-8684-ccb156b0d1ee admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:18.820933 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8eb499-5c90-4904-8684-ccb156b0d1ee admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:18.825494 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4434a7-6412-4c4f-b42d-9f63e5387831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:18.826144 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4434a7-6412-4c4f-b42d-9f63e5387831 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:18.826427 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4434a7-6412-4c4f-b42d-9f63e5387831 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:18.826739 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4434a7-6412-4c4f-b42d-9f63e5387831 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:18.827866 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4434a7-6412-4c4f-b42d-9f63e5387831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:18.829455 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4434a7-6412-4c4f-b42d-9f63e5387831 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:18.842141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1050/2077] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:57:18.845002 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db66c7-14fb-4dd6-889a-136584c52377 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:18.855029 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db66c7-14fb-4dd6-889a-136584c52377 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:18.861361 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a78dcf-906f-4bce-92e0-e306880628cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:18.862238 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a78dcf-906f-4bce-92e0-e306880628cb admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:18.862523 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a78dcf-906f-4bce-92e0-e306880628cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:18.862815 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a78dcf-906f-4bce-92e0-e306880628cb admin admin] PATH_INFO: `/v3/projects/8b2e207f2a2f49b4a7f3e3e0c331be12/users/792128d04a764cefbbef438268875e90/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:18.878354 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a78dcf-906f-4bce-92e0-e306880628cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b2e207f2a2f49b4a7f3e3e0c331be12, user_id=792128d04a764cefbbef438268875e90, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:18.881086 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a78dcf-906f-4bce-92e0-e306880628cb admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:18.985758 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1028/2078] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:57:18 2022] PUT /identity/v3/projects/8b2e207f2a2f49b4a7f3e3e0c331be12/users/792128d04a764cefbbef438268875e90/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:18.989800 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4434a7-6412-4c4f-b42d-9f63e5387831 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:19.001131 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4434a7-6412-4c4f-b42d-9f63e5387831 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:19.067807 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d04a3-fe50-44d9-abdd-332ccb107f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:19.068485 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d04a3-fe50-44d9-abdd-332ccb107f7d admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:19.068892 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d04a3-fe50-44d9-abdd-332ccb107f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:19.069064 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d04a3-fe50-44d9-abdd-332ccb107f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:19.069794 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d04a3-fe50-44d9-abdd-332ccb107f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:19.071403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d04a3-fe50-44d9-abdd-332ccb107f7d admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:19.084840 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1051/2079] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:57:19.086012 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a78dcf-906f-4bce-92e0-e306880628cb admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:19.102060 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a78dcf-906f-4bce-92e0-e306880628cb admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:19.106827 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89867e46-334a-455e-852b-8312e29f5867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:19.107746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89867e46-334a-455e-852b-8312e29f5867 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:19.108672 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89867e46-334a-455e-852b-8312e29f5867 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:19.109023 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89867e46-334a-455e-852b-8312e29f5867 admin admin] PATH_INFO: `/v3/projects/8b2e207f2a2f49b4a7f3e3e0c331be12/users/792128d04a764cefbbef438268875e90/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:19.111785 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89867e46-334a-455e-852b-8312e29f5867 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b2e207f2a2f49b4a7f3e3e0c331be12, user_id=792128d04a764cefbbef438268875e90, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:19.114520 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89867e46-334a-455e-852b-8312e29f5867 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:19.127189 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1029/2080] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:57:19 2022] PUT /identity/v3/projects/8b2e207f2a2f49b4a7f3e3e0c331be12/users/792128d04a764cefbbef438268875e90/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:19.139136 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b233fa-5600-46fb-9ec2-5b825c6e09e0 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:19.139136 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b233fa-5600-46fb-9ec2-5b825c6e09e0 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:19.139136 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b233fa-5600-46fb-9ec2-5b825c6e09e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:19.172341 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-76b233fa-5600-46fb-9ec2-5b825c6e09e0 None None] MFA Rules not processed for user `792128d04a764cefbbef438268875e90`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:19.173647 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-76b233fa-5600-46fb-9ec2-5b825c6e09e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:19.267926 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1052/2081] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:57:19.276604 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89867e46-334a-455e-852b-8312e29f5867 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:19.279447 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-89867e46-334a-455e-852b-8312e29f5867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:19.364500 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89867e46-334a-455e-852b-8312e29f5867 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:19.368092 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7626ca-cd4c-40dc-873f-c4ea5058bcbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:19.368731 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7626ca-cd4c-40dc-873f-c4ea5058bcbe service cinder] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:19.369401 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7626ca-cd4c-40dc-873f-c4ea5058bcbe service cinder] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:19.369401 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7626ca-cd4c-40dc-873f-c4ea5058bcbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:19.379505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7626ca-cd4c-40dc-873f-c4ea5058bcbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:19.380973 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7626ca-cd4c-40dc-873f-c4ea5058bcbe service cinder] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:19.391452 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1030/2082] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:57:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:57:19.920041 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b233fa-5600-46fb-9ec2-5b825c6e09e0 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:19.934396 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:19.985946 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b233fa-5600-46fb-9ec2-5b825c6e09e0 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:19.991717 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ed26b-3fb7-417b-8a65-7e3e4c53150a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:19.993208 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ed26b-3fb7-417b-8a65-7e3e4c53150a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:19.993722 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ed26b-3fb7-417b-8a65-7e3e4c53150a admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:19.994185 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ed26b-3fb7-417b-8a65-7e3e4c53150a admin admin] PATH_INFO: `/v3/users/442b4b2666e54688a80b65820ac60890` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:19.996135 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ed26b-3fb7-417b-8a65-7e3e4c53150a admin admin] RBAC: Authorizing `identity:delete_user(user_id=442b4b2666e54688a80b65820ac60890)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:19.999552 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ed26b-3fb7-417b-8a65-7e3e4c53150a admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:20.239879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-016ed26b-3fb7-417b-8a65-7e3e4c53150a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '442b4b2666e54688a80b65820ac60890'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:20.240573 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-016ed26b-3fb7-417b-8a65-7e3e4c53150a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '442b4b2666e54688a80b65820ac60890'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:20.241177 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-016ed26b-3fb7-417b-8a65-7e3e4c53150a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '442b4b2666e54688a80b65820ac60890'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:20.325109 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-016ed26b-3fb7-417b-8a65-7e3e4c53150a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '442b4b2666e54688a80b65820ac60890'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:20.333947 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-016ed26b-3fb7-417b-8a65-7e3e4c53150a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '442b4b2666e54688a80b65820ac60890'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:20.352615 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1053/2083] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:57:19 2022] DELETE /identity/v3/users/442b4b2666e54688a80b65820ac60890 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:20.357151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c342b-9cc9-4c54-8845-4acffabdfaf9 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:20.357644 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c342b-9cc9-4c54-8845-4acffabdfaf9 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:20.357775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c342b-9cc9-4c54-8845-4acffabdfaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:20.375763 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-750c342b-9cc9-4c54-8845-4acffabdfaf9 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:20.377020 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-750c342b-9cc9-4c54-8845-4acffabdfaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:20.439362 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1031/2084] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:57:20.449193 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ed26b-3fb7-417b-8a65-7e3e4c53150a admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:20.450576 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-016ed26b-3fb7-417b-8a65-7e3e4c53150a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:20.509624 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ed26b-3fb7-417b-8a65-7e3e4c53150a admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:20.513450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f051c-538b-4613-9060-36fa3a6c3931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:20.514098 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f051c-538b-4613-9060-36fa3a6c3931 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:20.515084 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f051c-538b-4613-9060-36fa3a6c3931 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:20.515844 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f051c-538b-4613-9060-36fa3a6c3931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:20.526015 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f051c-538b-4613-9060-36fa3a6c3931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:20.527499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f051c-538b-4613-9060-36fa3a6c3931 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:20.538347 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1054/2085] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:57:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:57:21.142702 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c342b-9cc9-4c54-8845-4acffabdfaf9 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:21.144569 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-750c342b-9cc9-4c54-8845-4acffabdfaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:21.166329 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c342b-9cc9-4c54-8845-4acffabdfaf9 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:21.174085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279a6a6-7321-4c1e-b4ce-f04b9436a6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:21.174978 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279a6a6-7321-4c1e-b4ce-f04b9436a6c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:21.175406 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279a6a6-7321-4c1e-b4ce-f04b9436a6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:21.175686 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279a6a6-7321-4c1e-b4ce-f04b9436a6c0 admin admin] PATH_INFO: `/v3/projects/5d0fb2b9a38c4110bccb97c1b87c7f78` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:21.180159 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279a6a6-7321-4c1e-b4ce-f04b9436a6c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d0fb2b9a38c4110bccb97c1b87c7f78)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:21.180159 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279a6a6-7321-4c1e-b4ce-f04b9436a6c0 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:21.192634 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:21.326328 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e279a6a6-7321-4c1e-b4ce-f04b9436a6c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d0fb2b9a38c4110bccb97c1b87c7f78', 'request_id': 'req-e279a6a6-7321-4c1e-b4ce-f04b9436a6c0'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:21.331953 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e279a6a6-7321-4c1e-b4ce-f04b9436a6c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d0fb2b9a38c4110bccb97c1b87c7f78', 'request_id': 'req-e279a6a6-7321-4c1e-b4ce-f04b9436a6c0'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:21.437269 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e279a6a6-7321-4c1e-b4ce-f04b9436a6c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d0fb2b9a38c4110bccb97c1b87c7f78', 'request_id': 'req-e279a6a6-7321-4c1e-b4ce-f04b9436a6c0'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:21.449640 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e279a6a6-7321-4c1e-b4ce-f04b9436a6c0 admin admin] The token cache is being invalidate because project 5d0fb2b9a38c4110bccb97c1b87c7f78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:57:21.449931 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e279a6a6-7321-4c1e-b4ce-f04b9436a6c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:21.450552 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e279a6a6-7321-4c1e-b4ce-f04b9436a6c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:21.452298 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1032/2086] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:57:21 2022] DELETE /identity/v3/projects/5d0fb2b9a38c4110bccb97c1b87c7f78 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:21.456425 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f051c-538b-4613-9060-36fa3a6c3931 service neutron] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:21.466638 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f051c-538b-4613-9060-36fa3a6c3931 service neutron] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:21.500810 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:21.524138 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90efa5-eebf-482b-ab10-b4cf7d2af1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:21.525071 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90efa5-eebf-482b-ab10-b4cf7d2af1d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:21.525352 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90efa5-eebf-482b-ab10-b4cf7d2af1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:21.525626 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90efa5-eebf-482b-ab10-b4cf7d2af1d5 admin admin] PATH_INFO: `/v3/users/792128d04a764cefbbef438268875e90` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:21.526832 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd90efa5-eebf-482b-ab10-b4cf7d2af1d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=792128d04a764cefbbef438268875e90)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:21.528772 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd90efa5-eebf-482b-ab10-b4cf7d2af1d5 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:21.742254 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-bd90efa5-eebf-482b-ab10-b4cf7d2af1d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '792128d04a764cefbbef438268875e90'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:21.742927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-bd90efa5-eebf-482b-ab10-b4cf7d2af1d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '792128d04a764cefbbef438268875e90'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:21.743551 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-bd90efa5-eebf-482b-ab10-b4cf7d2af1d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '792128d04a764cefbbef438268875e90'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:21.816434 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-bd90efa5-eebf-482b-ab10-b4cf7d2af1d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '792128d04a764cefbbef438268875e90'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:21.823804 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-bd90efa5-eebf-482b-ab10-b4cf7d2af1d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '792128d04a764cefbbef438268875e90'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:21.841673 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1055/2087] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:57:21 2022] DELETE /identity/v3/users/792128d04a764cefbbef438268875e90 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:22.393406 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279a6a6-7321-4c1e-b4ce-f04b9436a6c0 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:22.394974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-e279a6a6-7321-4c1e-b4ce-f04b9436a6c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:22.411179 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279a6a6-7321-4c1e-b4ce-f04b9436a6c0 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:22.472355 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57afc64-8c44-4fd9-8818-d95c0ab219e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:22.473285 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57afc64-8c44-4fd9-8818-d95c0ab219e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:22.473617 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57afc64-8c44-4fd9-8818-d95c0ab219e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:22.473941 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57afc64-8c44-4fd9-8818-d95c0ab219e0 admin admin] PATH_INFO: `/v3/projects/8b2e207f2a2f49b4a7f3e3e0c331be12` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:22.475239 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57afc64-8c44-4fd9-8818-d95c0ab219e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b2e207f2a2f49b4a7f3e3e0c331be12)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:22.477486 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57afc64-8c44-4fd9-8818-d95c0ab219e0 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:22.580520 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-f57afc64-8c44-4fd9-8818-d95c0ab219e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b2e207f2a2f49b4a7f3e3e0c331be12', 'request_id': 'req-f57afc64-8c44-4fd9-8818-d95c0ab219e0'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:22.586212 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-f57afc64-8c44-4fd9-8818-d95c0ab219e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b2e207f2a2f49b4a7f3e3e0c331be12', 'request_id': 'req-f57afc64-8c44-4fd9-8818-d95c0ab219e0'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:22.630428 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-f57afc64-8c44-4fd9-8818-d95c0ab219e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b2e207f2a2f49b4a7f3e3e0c331be12', 'request_id': 'req-f57afc64-8c44-4fd9-8818-d95c0ab219e0'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:22.641913 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-f57afc64-8c44-4fd9-8818-d95c0ab219e0 admin admin] The token cache is being invalidate because project 8b2e207f2a2f49b4a7f3e3e0c331be12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:57:22.642192 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-f57afc64-8c44-4fd9-8818-d95c0ab219e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:22.642808 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-f57afc64-8c44-4fd9-8818-d95c0ab219e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:22.644408 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1033/2088] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:57:22 2022] DELETE /identity/v3/projects/8b2e207f2a2f49b4a7f3e3e0c331be12 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:22.649268 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e34d71-4b47-406b-8241-884b7222db56 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:22.649775 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e34d71-4b47-406b-8241-884b7222db56 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:22.649894 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e34d71-4b47-406b-8241-884b7222db56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:22.668154 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-c9e34d71-4b47-406b-8241-884b7222db56 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:22.669412 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-c9e34d71-4b47-406b-8241-884b7222db56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:22.738231 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1056/2089] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:57:22.741731 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd3ca6-a439-43a0-8241-dee7413c449a None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:22.742067 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd3ca6-a439-43a0-8241-dee7413c449a None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:22.742347 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd3ca6-a439-43a0-8241-dee7413c449a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:22.761360 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-95dd3ca6-a439-43a0-8241-dee7413c449a None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:22.762548 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-95dd3ca6-a439-43a0-8241-dee7413c449a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:22.771949 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1034/2090] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:57:22.776250 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e34d71-4b47-406b-8241-884b7222db56 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:22.786019 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e34d71-4b47-406b-8241-884b7222db56 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:22.790676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7356da-ada4-409e-9bf9-28598eba629d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:22.791319 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7356da-ada4-409e-9bf9-28598eba629d admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:22.791609 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7356da-ada4-409e-9bf9-28598eba629d admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:22.791907 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7356da-ada4-409e-9bf9-28598eba629d admin admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:22.792634 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7356da-ada4-409e-9bf9-28598eba629d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:57:22.792942 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7356da-ada4-409e-9bf9-28598eba629d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:22.794522 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7356da-ada4-409e-9bf9-28598eba629d admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:22.808114 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1057/2091] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 15:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:57:22.813461 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd3ca6-a439-43a0-8241-dee7413c449a None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:22.823161 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd3ca6-a439-43a0-8241-dee7413c449a None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:22.828054 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e59c0-9e7c-4e06-ad86-df0c56401f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:22.828696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e59c0-9e7c-4e06-ad86-df0c56401f39 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:22.829001 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e59c0-9e7c-4e06-ad86-df0c56401f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:22.829272 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e59c0-9e7c-4e06-ad86-df0c56401f39 admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:22.829959 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e59c0-9e7c-4e06-ad86-df0c56401f39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:22.831902 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e59c0-9e7c-4e06-ad86-df0c56401f39 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:22.939790 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:22.947273 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1035/2092] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:57:22 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:57:22.951623 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7356da-ada4-409e-9bf9-28598eba629d admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:22.962253 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7356da-ada4-409e-9bf9-28598eba629d admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:23.002985 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:23.018685 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c96f01-8b09-409a-b4db-4c4928fa21e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:23.019355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c96f01-8b09-409a-b4db-4c4928fa21e8 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:23.019667 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c96f01-8b09-409a-b4db-4c4928fa21e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:23.019945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c96f01-8b09-409a-b4db-4c4928fa21e8 admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:23.020654 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c96f01-8b09-409a-b4db-4c4928fa21e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:23.022570 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c96f01-8b09-409a-b4db-4c4928fa21e8 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:23.127829 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1058/2093] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:57:22 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:57:23.132078 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e59c0-9e7c-4e06-ad86-df0c56401f39 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:23.142628 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e59c0-9e7c-4e06-ad86-df0c56401f39 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:23.147758 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c1ba9-a28f-458e-8aa9-c12d23372b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:23.148514 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c1ba9-a28f-458e-8aa9-c12d23372b75 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:23.148656 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c1ba9-a28f-458e-8aa9-c12d23372b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:23.148933 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c1ba9-a28f-458e-8aa9-c12d23372b75 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:23.149748 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c1ba9-a28f-458e-8aa9-c12d23372b75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:23.151834 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c1ba9-a28f-458e-8aa9-c12d23372b75 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:23.164393 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1036/2094] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:57:23.169270 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c96f01-8b09-409a-b4db-4c4928fa21e8 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:23.180313 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c96f01-8b09-409a-b4db-4c4928fa21e8 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:23.185389 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc6900-01fd-40b7-9429-0b544967b9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:23.186098 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc6900-01fd-40b7-9429-0b544967b9a9 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:23.186387 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc6900-01fd-40b7-9429-0b544967b9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:23.186664 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc6900-01fd-40b7-9429-0b544967b9a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:23.187390 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc6900-01fd-40b7-9429-0b544967b9a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:23.189053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc6900-01fd-40b7-9429-0b544967b9a9 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:23.200151 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1059/2095] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:57:23.209533 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c1ba9-a28f-458e-8aa9-c12d23372b75 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:23.220637 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c1ba9-a28f-458e-8aa9-c12d23372b75 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:23.225370 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20da13-e180-41db-8abc-cbf11d12133f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:23.226244 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20da13-e180-41db-8abc-cbf11d12133f admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:23.226526 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20da13-e180-41db-8abc-cbf11d12133f admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:23.232031 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20da13-e180-41db-8abc-cbf11d12133f admin admin] PATH_INFO: `/v3/projects/b8f89a1223824957adfdc61b53db78a4/users/1a01b476dfd24d95b1a968fe99f14eb6/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:23.242305 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20da13-e180-41db-8abc-cbf11d12133f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8f89a1223824957adfdc61b53db78a4, user_id=1a01b476dfd24d95b1a968fe99f14eb6, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:23.245102 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20da13-e180-41db-8abc-cbf11d12133f admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:23.338341 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1037/2096] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:57:23 2022] PUT /identity/v3/projects/b8f89a1223824957adfdc61b53db78a4/users/1a01b476dfd24d95b1a968fe99f14eb6/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:57:23.350205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196daab-b760-409f-b468-3bcfa7ad8e09 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:23.350504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196daab-b760-409f-b468-3bcfa7ad8e09 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:23.350808 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196daab-b760-409f-b468-3bcfa7ad8e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:23.385394 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-1196daab-b760-409f-b468-3bcfa7ad8e09 None None] MFA Rules not processed for user `1a01b476dfd24d95b1a968fe99f14eb6`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:23.388157 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-1196daab-b760-409f-b468-3bcfa7ad8e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:23.493309 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1060/2097] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:57:23.504972 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20da13-e180-41db-8abc-cbf11d12133f admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:23.506686 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-8d20da13-e180-41db-8abc-cbf11d12133f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:23.572773 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20da13-e180-41db-8abc-cbf11d12133f admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:23.576574 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d4482-5394-4f1a-bbb8-ffe6e81fd707 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:23.578297 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d4482-5394-4f1a-bbb8-ffe6e81fd707 service cinder] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:23.578297 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d4482-5394-4f1a-bbb8-ffe6e81fd707 service cinder] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:23.578297 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d4482-5394-4f1a-bbb8-ffe6e81fd707 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:23.587650 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d4482-5394-4f1a-bbb8-ffe6e81fd707 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:23.589203 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d4482-5394-4f1a-bbb8-ffe6e81fd707 service cinder] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:23.600389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1038/2098] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:57:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:57:26.060310 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196daab-b760-409f-b468-3bcfa7ad8e09 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:26.071223 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196daab-b760-409f-b468-3bcfa7ad8e09 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:26.074976 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a3b22-5de0-489a-b035-c39ed5e7087b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:26.075678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a3b22-5de0-489a-b035-c39ed5e7087b service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:26.075970 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a3b22-5de0-489a-b035-c39ed5e7087b service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:26.076246 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a3b22-5de0-489a-b035-c39ed5e7087b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:26.078430 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-5c8a3b22-5de0-489a-b035-c39ed5e7087b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:26.164161 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a3b22-5de0-489a-b035-c39ed5e7087b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:26.167033 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a3b22-5de0-489a-b035-c39ed5e7087b service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:26.185790 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1061/2099] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:57:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:57:32.763644 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d4482-5394-4f1a-bbb8-ffe6e81fd707 service cinder] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:32.830878 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d4482-5394-4f1a-bbb8-ffe6e81fd707 service cinder] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:32.834435 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab555fd-0602-4c82-89bf-d0cfda65d727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:32.835309 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab555fd-0602-4c82-89bf-d0cfda65d727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:32.835586 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab555fd-0602-4c82-89bf-d0cfda65d727 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:32.835897 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab555fd-0602-4c82-89bf-d0cfda65d727 admin admin] PATH_INFO: `/v3/users/1a01b476dfd24d95b1a968fe99f14eb6` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:32.837071 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab555fd-0602-4c82-89bf-d0cfda65d727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a01b476dfd24d95b1a968fe99f14eb6)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:32.838988 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab555fd-0602-4c82-89bf-d0cfda65d727 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:33.073622 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-2ab555fd-0602-4c82-89bf-d0cfda65d727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a01b476dfd24d95b1a968fe99f14eb6'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:33.080461 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-2ab555fd-0602-4c82-89bf-d0cfda65d727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a01b476dfd24d95b1a968fe99f14eb6'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:33.081125 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-2ab555fd-0602-4c82-89bf-d0cfda65d727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a01b476dfd24d95b1a968fe99f14eb6'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:33.089113 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:33.093773 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-2ab555fd-0602-4c82-89bf-d0cfda65d727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a01b476dfd24d95b1a968fe99f14eb6'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:33.161497 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-2ab555fd-0602-4c82-89bf-d0cfda65d727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a01b476dfd24d95b1a968fe99f14eb6'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:33.168033 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1039/2100] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:57:32 2022] DELETE /identity/v3/users/1a01b476dfd24d95b1a968fe99f14eb6 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:33.172476 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a3b22-5de0-489a-b035-c39ed5e7087b service cinder] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:33.172999 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47846f-f44f-4d0f-92a4-cfacebfef46f None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:33.173318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47846f-f44f-4d0f-92a4-cfacebfef46f None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:33.173604 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47846f-f44f-4d0f-92a4-cfacebfef46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:33.174114 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-5c8a3b22-5de0-489a-b035-c39ed5e7087b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:33.190494 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a3b22-5de0-489a-b035-c39ed5e7087b service cinder] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:33.193787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-2c47846f-f44f-4d0f-92a4-cfacebfef46f None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:33.195996 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-2c47846f-f44f-4d0f-92a4-cfacebfef46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:33.242466 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:33.259145 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a17523-f56b-4830-ac12-b2ce38b68ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:33.260301 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a17523-f56b-4830-ac12-b2ce38b68ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:33.260773 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a17523-f56b-4830-ac12-b2ce38b68ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:33.261196 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a17523-f56b-4830-ac12-b2ce38b68ec8 admin admin] PATH_INFO: `/v3/users/14fc12e1046643f1a64c37f128fc2af1` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:33.262527 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a17523-f56b-4830-ac12-b2ce38b68ec8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14fc12e1046643f1a64c37f128fc2af1)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:33.266457 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1040/2101] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:57:33.266612 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a17523-f56b-4830-ac12-b2ce38b68ec8 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:33.275466 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c47846f-f44f-4d0f-92a4-cfacebfef46f None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:33.276915 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-2c47846f-f44f-4d0f-92a4-cfacebfef46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:33.360318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c47846f-f44f-4d0f-92a4-cfacebfef46f None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:33.364108 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f226d-0888-41da-9de7-ab3c13f7e1bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:33.364944 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f226d-0888-41da-9de7-ab3c13f7e1bc service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:33.365359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f226d-0888-41da-9de7-ab3c13f7e1bc service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:33.365758 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f226d-0888-41da-9de7-ab3c13f7e1bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:33.376597 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f226d-0888-41da-9de7-ab3c13f7e1bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:33.378052 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f226d-0888-41da-9de7-ab3c13f7e1bc service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:33.388021 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1041/2102] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:57:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:57:33.516885 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-81a17523-f56b-4830-ac12-b2ce38b68ec8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14fc12e1046643f1a64c37f128fc2af1'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:33.517520 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-81a17523-f56b-4830-ac12-b2ce38b68ec8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14fc12e1046643f1a64c37f128fc2af1'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:33.518125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-81a17523-f56b-4830-ac12-b2ce38b68ec8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14fc12e1046643f1a64c37f128fc2af1'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:33.625503 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-81a17523-f56b-4830-ac12-b2ce38b68ec8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14fc12e1046643f1a64c37f128fc2af1'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:33.633201 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-81a17523-f56b-4830-ac12-b2ce38b68ec8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14fc12e1046643f1a64c37f128fc2af1'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:33.670341 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1062/2103] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:57:33 2022] DELETE /identity/v3/users/14fc12e1046643f1a64c37f128fc2af1 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:57:33.673437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa01945-4023-4a0b-9921-f45a5a2b0e75 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:33.673805 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa01945-4023-4a0b-9921-f45a5a2b0e75 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:33.674149 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa01945-4023-4a0b-9921-f45a5a2b0e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:33.692317 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-efa01945-4023-4a0b-9921-f45a5a2b0e75 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:33.693663 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-efa01945-4023-4a0b-9921-f45a5a2b0e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:33.760187 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1042/2104] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:57:33.769769 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a17523-f56b-4830-ac12-b2ce38b68ec8 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:33.771172 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-81a17523-f56b-4830-ac12-b2ce38b68ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:33.828391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a17523-f56b-4830-ac12-b2ce38b68ec8 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:33.832056 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e740d-8d26-4e63-982c-6e8237225a3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:33.832705 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e740d-8d26-4e63-982c-6e8237225a3e service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:33.832985 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e740d-8d26-4e63-982c-6e8237225a3e service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:33.833258 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e740d-8d26-4e63-982c-6e8237225a3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:33.842324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e740d-8d26-4e63-982c-6e8237225a3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:33.843816 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e740d-8d26-4e63-982c-6e8237225a3e service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:33.853213 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1063/2105] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:57:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:57:33.858153 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa01945-4023-4a0b-9921-f45a5a2b0e75 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:33.862818 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-efa01945-4023-4a0b-9921-f45a5a2b0e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:33.872186 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa01945-4023-4a0b-9921-f45a5a2b0e75 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:33.877826 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5799f9-c09a-4221-8e03-dd98caa1950e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:33.878951 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5799f9-c09a-4221-8e03-dd98caa1950e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:33.879330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5799f9-c09a-4221-8e03-dd98caa1950e admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:33.879755 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5799f9-c09a-4221-8e03-dd98caa1950e admin admin] PATH_INFO: `/v3/projects/b8f89a1223824957adfdc61b53db78a4` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:33.881133 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5799f9-c09a-4221-8e03-dd98caa1950e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8f89a1223824957adfdc61b53db78a4)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:33.883437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5799f9-c09a-4221-8e03-dd98caa1950e admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:33.915171 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:34.036397 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-1a5799f9-c09a-4221-8e03-dd98caa1950e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8f89a1223824957adfdc61b53db78a4', 'request_id': 'req-1a5799f9-c09a-4221-8e03-dd98caa1950e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:34.041674 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-1a5799f9-c09a-4221-8e03-dd98caa1950e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8f89a1223824957adfdc61b53db78a4', 'request_id': 'req-1a5799f9-c09a-4221-8e03-dd98caa1950e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:34.111000 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-1a5799f9-c09a-4221-8e03-dd98caa1950e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8f89a1223824957adfdc61b53db78a4', 'request_id': 'req-1a5799f9-c09a-4221-8e03-dd98caa1950e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:34.122958 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-1a5799f9-c09a-4221-8e03-dd98caa1950e admin admin] The token cache is being invalidate because project b8f89a1223824957adfdc61b53db78a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:57:34.123347 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-1a5799f9-c09a-4221-8e03-dd98caa1950e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:34.124115 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-1a5799f9-c09a-4221-8e03-dd98caa1950e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:34.125759 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1043/2106] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:57:33 2022] DELETE /identity/v3/projects/b8f89a1223824957adfdc61b53db78a4 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:34.130566 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563d4a5-1d2d-4734-97de-6694656e56c4 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:34.130858 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563d4a5-1d2d-4734-97de-6694656e56c4 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:34.131142 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563d4a5-1d2d-4734-97de-6694656e56c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:34.149003 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-6563d4a5-1d2d-4734-97de-6694656e56c4 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:34.150214 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-6563d4a5-1d2d-4734-97de-6694656e56c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:34.220040 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1064/2107] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:57:34.227991 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60454fb1-946a-4ee5-bc13-53db525fb01c None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:34.228282 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60454fb1-946a-4ee5-bc13-53db525fb01c None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:34.235341 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60454fb1-946a-4ee5-bc13-53db525fb01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:34.247423 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-60454fb1-946a-4ee5-bc13-53db525fb01c None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:34.248636 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-60454fb1-946a-4ee5-bc13-53db525fb01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:34.256653 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1044/2108] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:57:34.266952 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563d4a5-1d2d-4734-97de-6694656e56c4 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:34.276808 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563d4a5-1d2d-4734-97de-6694656e56c4 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:34.282270 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6cf56-22e0-467a-9445-0eb706b8b8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:34.286020 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6cf56-22e0-467a-9445-0eb706b8b8ef admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:34.286020 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6cf56-22e0-467a-9445-0eb706b8b8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:34.286020 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6cf56-22e0-467a-9445-0eb706b8b8ef admin admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:34.286020 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6cf56-22e0-467a-9445-0eb706b8b8ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:57:34.286020 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6cf56-22e0-467a-9445-0eb706b8b8ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:34.286451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6cf56-22e0-467a-9445-0eb706b8b8ef admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:34.287757 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:34.299056 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1065/2109] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 15:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:57:34.303278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60454fb1-946a-4ee5-bc13-53db525fb01c None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:34.313018 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6cf56-22e0-467a-9445-0eb706b8b8ef admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:34.314891 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-88b6cf56-22e0-467a-9445-0eb706b8b8ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:34.317523 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60454fb1-946a-4ee5-bc13-53db525fb01c None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:34.322424 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a037d-e13d-47f2-9864-fcc8225005b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:34.323440 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a037d-e13d-47f2-9864-fcc8225005b1 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:34.323841 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a037d-e13d-47f2-9864-fcc8225005b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:34.324695 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a037d-e13d-47f2-9864-fcc8225005b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:34.325482 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a037d-e13d-47f2-9864-fcc8225005b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:34.330319 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a037d-e13d-47f2-9864-fcc8225005b1 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:34.331878 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6cf56-22e0-467a-9445-0eb706b8b8ef admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:34.342703 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b5e33-ccef-4e3e-8829-b7e84db54229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:34.344544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b5e33-ccef-4e3e-8829-b7e84db54229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:34.344544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b5e33-ccef-4e3e-8829-b7e84db54229 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:34.344998 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b5e33-ccef-4e3e-8829-b7e84db54229 admin admin] PATH_INFO: `/v3/projects/07aae44bdae94c58bbf5410f39566dfd` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:34.346511 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b5e33-ccef-4e3e-8829-b7e84db54229 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07aae44bdae94c58bbf5410f39566dfd)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:34.348990 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b5e33-ccef-4e3e-8829-b7e84db54229 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:34.406111 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1045/2110] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:57:34 2022] POST /identity/v3/projects => generated 361 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:57:34.408915 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a037d-e13d-47f2-9864-fcc8225005b1 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:34.483367 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a037d-e13d-47f2-9864-fcc8225005b1 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:34.505206 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-723b5e33-ccef-4e3e-8829-b7e84db54229 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07aae44bdae94c58bbf5410f39566dfd', 'request_id': 'req-723b5e33-ccef-4e3e-8829-b7e84db54229'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:34.519258 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-723b5e33-ccef-4e3e-8829-b7e84db54229 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07aae44bdae94c58bbf5410f39566dfd', 'request_id': 'req-723b5e33-ccef-4e3e-8829-b7e84db54229'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:34.564501 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb1776-1d21-4e5f-8a76-afd4a5e250f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:34.565177 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb1776-1d21-4e5f-8a76-afd4a5e250f8 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:34.565463 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb1776-1d21-4e5f-8a76-afd4a5e250f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:34.565741 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb1776-1d21-4e5f-8a76-afd4a5e250f8 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:34.566455 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb1776-1d21-4e5f-8a76-afd4a5e250f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:34.577079 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb1776-1d21-4e5f-8a76-afd4a5e250f8 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:34.603298 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-723b5e33-ccef-4e3e-8829-b7e84db54229 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07aae44bdae94c58bbf5410f39566dfd', 'request_id': 'req-723b5e33-ccef-4e3e-8829-b7e84db54229'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:34.618281 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-723b5e33-ccef-4e3e-8829-b7e84db54229 admin admin] The token cache is being invalidate because project 07aae44bdae94c58bbf5410f39566dfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:57:34.618570 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-723b5e33-ccef-4e3e-8829-b7e84db54229 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:34.619257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-723b5e33-ccef-4e3e-8829-b7e84db54229 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:34.620874 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1066/2111] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:57:34 2022] DELETE /identity/v3/projects/07aae44bdae94c58bbf5410f39566dfd => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:57:34.625211 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b5e33-ccef-4e3e-8829-b7e84db54229 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:34.626793 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-723b5e33-ccef-4e3e-8829-b7e84db54229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:34.639694 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b5e33-ccef-4e3e-8829-b7e84db54229 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:34.644622 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fdf7fb-a4d4-44b0-9d85-0c178554076d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:34.645491 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdf7fb-a4d4-44b0-9d85-0c178554076d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:34.645778 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdf7fb-a4d4-44b0-9d85-0c178554076d admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:34.646057 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdf7fb-a4d4-44b0-9d85-0c178554076d admin admin] PATH_INFO: `/v3/users/39a60d3107ab48ab82de6036d36e8bdb` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:34.647270 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fdf7fb-a4d4-44b0-9d85-0c178554076d admin admin] RBAC: Authorizing `identity:delete_user(user_id=39a60d3107ab48ab82de6036d36e8bdb)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:34.649241 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fdf7fb-a4d4-44b0-9d85-0c178554076d admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:34.725873 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1046/2112] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:57:34 2022] POST /identity/v3/users => generated 281 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:57:34.730108 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb1776-1d21-4e5f-8a76-afd4a5e250f8 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:34.731959 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-3bcb1776-1d21-4e5f-8a76-afd4a5e250f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:34.744651 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb1776-1d21-4e5f-8a76-afd4a5e250f8 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:34.750074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d096ee0-58e3-44bf-b1b9-88fe9d34315b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:34.750738 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d096ee0-58e3-44bf-b1b9-88fe9d34315b admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:34.751041 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d096ee0-58e3-44bf-b1b9-88fe9d34315b admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:34.751300 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d096ee0-58e3-44bf-b1b9-88fe9d34315b admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:34.752070 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d096ee0-58e3-44bf-b1b9-88fe9d34315b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:34.753674 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d096ee0-58e3-44bf-b1b9-88fe9d34315b admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:34.763787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1047/2113] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:57:34.768011 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d096ee0-58e3-44bf-b1b9-88fe9d34315b admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:34.777689 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d096ee0-58e3-44bf-b1b9-88fe9d34315b admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:34.782768 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fca01-afd8-4236-8bbf-c69f90cbd524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:34.783397 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fca01-afd8-4236-8bbf-c69f90cbd524 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:34.783708 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fca01-afd8-4236-8bbf-c69f90cbd524 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:34.783981 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fca01-afd8-4236-8bbf-c69f90cbd524 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:34.784769 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8fca01-afd8-4236-8bbf-c69f90cbd524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:34.786337 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8fca01-afd8-4236-8bbf-c69f90cbd524 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:34.788474 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:34.798281 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1048/2114] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:57:34.801479 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fca01-afd8-4236-8bbf-c69f90cbd524 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:34.811058 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fca01-afd8-4236-8bbf-c69f90cbd524 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:34.816452 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99212b-c2e5-40dd-a58d-63d91358d488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:34.817291 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99212b-c2e5-40dd-a58d-63d91358d488 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:34.817569 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99212b-c2e5-40dd-a58d-63d91358d488 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:34.817839 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99212b-c2e5-40dd-a58d-63d91358d488 admin admin] PATH_INFO: `/v3/projects/eea1a30d7c48493eabfd9a1e96a72435/users/fdc71c064b6a4c5f91145d8955acee3e/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:34.832442 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99212b-c2e5-40dd-a58d-63d91358d488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eea1a30d7c48493eabfd9a1e96a72435, user_id=fdc71c064b6a4c5f91145d8955acee3e, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:34.838063 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99212b-c2e5-40dd-a58d-63d91358d488 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:34.848558 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-f5fdf7fb-a4d4-44b0-9d85-0c178554076d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39a60d3107ab48ab82de6036d36e8bdb'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:34.849424 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-f5fdf7fb-a4d4-44b0-9d85-0c178554076d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39a60d3107ab48ab82de6036d36e8bdb'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:34.849846 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-f5fdf7fb-a4d4-44b0-9d85-0c178554076d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39a60d3107ab48ab82de6036d36e8bdb'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:34.933117 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1049/2115] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:57:34 2022] PUT /identity/v3/projects/eea1a30d7c48493eabfd9a1e96a72435/users/fdc71c064b6a4c5f91145d8955acee3e/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:57:34.937084 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-f5fdf7fb-a4d4-44b0-9d85-0c178554076d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39a60d3107ab48ab82de6036d36e8bdb'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:34.945007 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221bb71-4a04-4787-91dc-8dda571c73de None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:34.945308 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221bb71-4a04-4787-91dc-8dda571c73de None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:34.945591 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221bb71-4a04-4787-91dc-8dda571c73de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:34.951642 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-f5fdf7fb-a4d4-44b0-9d85-0c178554076d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39a60d3107ab48ab82de6036d36e8bdb'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:34.977227 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1067/2116] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:57:34 2022] DELETE /identity/v3/users/39a60d3107ab48ab82de6036d36e8bdb => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:57:35.003784 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-9221bb71-4a04-4787-91dc-8dda571c73de None None] MFA Rules not processed for user `fdc71c064b6a4c5f91145d8955acee3e`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:35.003784 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-9221bb71-4a04-4787-91dc-8dda571c73de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:35.080178 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1050/2117] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:34 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:57:35.270362 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fdf7fb-a4d4-44b0-9d85-0c178554076d admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:35.274252 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-f5fdf7fb-a4d4-44b0-9d85-0c178554076d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:35.332730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:35.336409 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fdf7fb-a4d4-44b0-9d85-0c178554076d admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:35.340087 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de10b0-d74b-4428-a1e4-b7ce1134b757 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:35.340738 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de10b0-d74b-4428-a1e4-b7ce1134b757 service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:35.341026 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de10b0-d74b-4428-a1e4-b7ce1134b757 service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:35.341307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de10b0-d74b-4428-a1e4-b7ce1134b757 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:35.350314 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de10b0-d74b-4428-a1e4-b7ce1134b757 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:35.351731 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de10b0-d74b-4428-a1e4-b7ce1134b757 service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:35.361797 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1068/2118] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:57:35 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:57:35.376679 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221bb71-4a04-4787-91dc-8dda571c73de None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:35.378094 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-9221bb71-4a04-4787-91dc-8dda571c73de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:35.449283 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221bb71-4a04-4787-91dc-8dda571c73de None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:35.454104 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb01ba2-4f1e-4fb1-bfc5-2722861aa2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:35.454972 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb01ba2-4f1e-4fb1-bfc5-2722861aa2fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:35.459955 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb01ba2-4f1e-4fb1-bfc5-2722861aa2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:35.459955 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb01ba2-4f1e-4fb1-bfc5-2722861aa2fb admin admin] PATH_INFO: `/v3/users/fdc71c064b6a4c5f91145d8955acee3e` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:35.459955 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb01ba2-4f1e-4fb1-bfc5-2722861aa2fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdc71c064b6a4c5f91145d8955acee3e)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:35.459955 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb01ba2-4f1e-4fb1-bfc5-2722861aa2fb admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:35.461775 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de10b0-d74b-4428-a1e4-b7ce1134b757 service cinder] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:35.463938 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-91de10b0-d74b-4428-a1e4-b7ce1134b757 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:35.479713 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de10b0-d74b-4428-a1e4-b7ce1134b757 service cinder] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:35.490447 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59e36e-3b2f-43a1-bddd-fb12b3f5c7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:35.490747 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59e36e-3b2f-43a1-bddd-fb12b3f5c7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:35.491033 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59e36e-3b2f-43a1-bddd-fb12b3f5c7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:35.491463 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59e36e-3b2f-43a1-bddd-fb12b3f5c7d3 admin admin] PATH_INFO: `/v3/projects/0040105485f74e8093ccd9adfdc0a074` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:35.493070 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59e36e-3b2f-43a1-bddd-fb12b3f5c7d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0040105485f74e8093ccd9adfdc0a074)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:35.495478 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59e36e-3b2f-43a1-bddd-fb12b3f5c7d3 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:35.702675 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-7cb01ba2-4f1e-4fb1-bfc5-2722861aa2fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdc71c064b6a4c5f91145d8955acee3e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:35.705595 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-3e59e36e-3b2f-43a1-bddd-fb12b3f5c7d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0040105485f74e8093ccd9adfdc0a074', 'request_id': 'req-3e59e36e-3b2f-43a1-bddd-fb12b3f5c7d3'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:35.711687 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-7cb01ba2-4f1e-4fb1-bfc5-2722861aa2fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdc71c064b6a4c5f91145d8955acee3e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:35.712813 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-7cb01ba2-4f1e-4fb1-bfc5-2722861aa2fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdc71c064b6a4c5f91145d8955acee3e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:35.715306 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-3e59e36e-3b2f-43a1-bddd-fb12b3f5c7d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0040105485f74e8093ccd9adfdc0a074', 'request_id': 'req-3e59e36e-3b2f-43a1-bddd-fb12b3f5c7d3'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:35.722646 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:35.729091 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-7cb01ba2-4f1e-4fb1-bfc5-2722861aa2fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdc71c064b6a4c5f91145d8955acee3e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:35.790383 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-3e59e36e-3b2f-43a1-bddd-fb12b3f5c7d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0040105485f74e8093ccd9adfdc0a074', 'request_id': 'req-3e59e36e-3b2f-43a1-bddd-fb12b3f5c7d3'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:35.802374 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-3e59e36e-3b2f-43a1-bddd-fb12b3f5c7d3 admin admin] The token cache is being invalidate because project 0040105485f74e8093ccd9adfdc0a074 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:57:35.807201 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-3e59e36e-3b2f-43a1-bddd-fb12b3f5c7d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:35.807201 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-3e59e36e-3b2f-43a1-bddd-fb12b3f5c7d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:35.807201 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1069/2119] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:57:35 2022] DELETE /identity/v3/projects/0040105485f74e8093ccd9adfdc0a074 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:57:35.811998 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649a808-04c8-47ef-a0f0-c5bceab2aeb6 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:35.812297 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649a808-04c8-47ef-a0f0-c5bceab2aeb6 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:35.812590 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649a808-04c8-47ef-a0f0-c5bceab2aeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:35.830654 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-f649a808-04c8-47ef-a0f0-c5bceab2aeb6 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:35.831889 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-f649a808-04c8-47ef-a0f0-c5bceab2aeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:35.841554 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-7cb01ba2-4f1e-4fb1-bfc5-2722861aa2fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdc71c064b6a4c5f91145d8955acee3e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:35.848663 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1051/2120] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:57:35 2022] DELETE /identity/v3/users/fdc71c064b6a4c5f91145d8955acee3e => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:35.853090 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0a66f-9b5a-4c87-9904-c4e8191efb3b None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:35.853411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0a66f-9b5a-4c87-9904-c4e8191efb3b None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:35.853691 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0a66f-9b5a-4c87-9904-c4e8191efb3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:35.872896 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-cff0a66f-9b5a-4c87-9904-c4e8191efb3b None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:35.874026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-cff0a66f-9b5a-4c87-9904-c4e8191efb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:35.895229 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1070/2121] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:57:35.903315 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058b719-df16-4de7-9022-51cdb81754fe None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:35.903641 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058b719-df16-4de7-9022-51cdb81754fe None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:35.903923 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058b719-df16-4de7-9022-51cdb81754fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:35.924424 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-f058b719-df16-4de7-9022-51cdb81754fe None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:35.925625 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-f058b719-df16-4de7-9022-51cdb81754fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:35.940612 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1052/2122] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:57:35.948393 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0a66f-9b5a-4c87-9904-c4e8191efb3b None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:35.949811 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-cff0a66f-9b5a-4c87-9904-c4e8191efb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:35.989194 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1071/2123] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:57:35.994055 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058b719-df16-4de7-9022-51cdb81754fe None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:36.004585 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058b719-df16-4de7-9022-51cdb81754fe None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:36.011738 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125ca15-2cc9-4daa-97da-84f78d630dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:36.012332 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0a66f-9b5a-4c87-9904-c4e8191efb3b None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:36.012503 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125ca15-2cc9-4daa-97da-84f78d630dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:36.012838 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125ca15-2cc9-4daa-97da-84f78d630dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:36.013179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125ca15-2cc9-4daa-97da-84f78d630dd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:36.013856 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125ca15-2cc9-4daa-97da-84f78d630dd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:57:36.014163 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125ca15-2cc9-4daa-97da-84f78d630dd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:36.016332 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125ca15-2cc9-4daa-97da-84f78d630dd9 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:36.036026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bb5d3-3b5f-4129-a446-8366414c996a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:36.036026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bb5d3-3b5f-4129-a446-8366414c996a service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:36.036026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bb5d3-3b5f-4129-a446-8366414c996a service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:36.036026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bb5d3-3b5f-4129-a446-8366414c996a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:36.036436 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0bb5d3-3b5f-4129-a446-8366414c996a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:36.036436 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0bb5d3-3b5f-4129-a446-8366414c996a service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:36.036579 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1072/2124] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 15:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:57:36.040554 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125ca15-2cc9-4daa-97da-84f78d630dd9 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:36.047262 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1053/2125] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:57:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:57:36.053420 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125ca15-2cc9-4daa-97da-84f78d630dd9 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:36.054592 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:36.060046 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413fb734-0f12-4535-9a9e-f1d2261cdf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:36.060856 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fb734-0f12-4535-9a9e-f1d2261cdf20 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:36.061265 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fb734-0f12-4535-9a9e-f1d2261cdf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:36.061664 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fb734-0f12-4535-9a9e-f1d2261cdf20 admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:36.062791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413fb734-0f12-4535-9a9e-f1d2261cdf20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:36.064834 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413fb734-0f12-4535-9a9e-f1d2261cdf20 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:37.163682 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1073/2126] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:57:36 2022] POST /identity/v3/projects => generated 385 bytes in 1124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:57:37.168053 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bb5d3-3b5f-4129-a446-8366414c996a service neutron] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:37.178332 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bb5d3-3b5f-4129-a446-8366414c996a service neutron] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:37.244557 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f718674-9c5d-4a3e-8695-7194b7a07151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:37.245233 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f718674-9c5d-4a3e-8695-7194b7a07151 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:37.245518 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f718674-9c5d-4a3e-8695-7194b7a07151 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:37.245789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f718674-9c5d-4a3e-8695-7194b7a07151 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:37.246479 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f718674-9c5d-4a3e-8695-7194b7a07151 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:37.248553 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f718674-9c5d-4a3e-8695-7194b7a07151 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:37.522562 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413fb734-0f12-4535-9a9e-f1d2261cdf20 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:37.527548 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-413fb734-0f12-4535-9a9e-f1d2261cdf20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:37.527954 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1054/2127] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:57:37 2022] POST /identity/v3/users => generated 293 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:57:37.530829 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f718674-9c5d-4a3e-8695-7194b7a07151 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:37.542531 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413fb734-0f12-4535-9a9e-f1d2261cdf20 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:37.558169 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024d5b3-5611-4e4e-b5ae-d7540daa684d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:37.558661 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024d5b3-5611-4e4e-b5ae-d7540daa684d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:37.558933 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f718674-9c5d-4a3e-8695-7194b7a07151 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:37.559064 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024d5b3-5611-4e4e-b5ae-d7540daa684d admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:37.559209 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024d5b3-5611-4e4e-b5ae-d7540daa684d admin admin] PATH_INFO: `/v3/projects/eea1a30d7c48493eabfd9a1e96a72435` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:37.560767 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7024d5b3-5611-4e4e-b5ae-d7540daa684d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eea1a30d7c48493eabfd9a1e96a72435)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:37.563326 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7024d5b3-5611-4e4e-b5ae-d7540daa684d admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:37.564956 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07762c5b-b28d-430a-ac3d-5875f9003eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:37.565597 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07762c5b-b28d-430a-ac3d-5875f9003eac admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:37.565865 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07762c5b-b28d-430a-ac3d-5875f9003eac admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:37.566145 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07762c5b-b28d-430a-ac3d-5875f9003eac admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:37.566880 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07762c5b-b28d-430a-ac3d-5875f9003eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:37.568520 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07762c5b-b28d-430a-ac3d-5875f9003eac admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:37.578927 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1055/2128] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:57:37.582856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07762c5b-b28d-430a-ac3d-5875f9003eac admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:37.592637 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07762c5b-b28d-430a-ac3d-5875f9003eac admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:37.597465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b482a-db15-4e94-b428-24921e1e085d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:37.602138 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b482a-db15-4e94-b428-24921e1e085d admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:37.602138 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b482a-db15-4e94-b428-24921e1e085d admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:37.602138 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b482a-db15-4e94-b428-24921e1e085d admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:37.602138 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b482a-db15-4e94-b428-24921e1e085d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:37.602138 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b482a-db15-4e94-b428-24921e1e085d admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:37.614289 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1056/2129] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:57:37.618612 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b482a-db15-4e94-b428-24921e1e085d admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:37.629185 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b482a-db15-4e94-b428-24921e1e085d admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:37.634205 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af27f9-000b-4a2e-8fe6-87f34ed97072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:37.635303 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af27f9-000b-4a2e-8fe6-87f34ed97072 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:37.635582 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af27f9-000b-4a2e-8fe6-87f34ed97072 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:37.635964 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af27f9-000b-4a2e-8fe6-87f34ed97072 admin admin] PATH_INFO: `/v3/projects/8915a40e8bf04a879027b82b9d1f91f6/users/0ff40010b9a9406aad70a30090b7762f/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:37.651673 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af27f9-000b-4a2e-8fe6-87f34ed97072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8915a40e8bf04a879027b82b9d1f91f6, user_id=0ff40010b9a9406aad70a30090b7762f, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:37.654527 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af27f9-000b-4a2e-8fe6-87f34ed97072 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:37.680147 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:37.762399 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1057/2130] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:57:37 2022] PUT /identity/v3/projects/8915a40e8bf04a879027b82b9d1f91f6/users/0ff40010b9a9406aad70a30090b7762f/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:57:37.771540 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7024d5b3-5611-4e4e-b5ae-d7540daa684d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eea1a30d7c48493eabfd9a1e96a72435', 'request_id': 'req-7024d5b3-5611-4e4e-b5ae-d7540daa684d'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:37.773364 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819b6bc-ef82-4aa4-9aaf-2dd451a65bc4 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:37.773656 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819b6bc-ef82-4aa4-9aaf-2dd451a65bc4 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:37.773973 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819b6bc-ef82-4aa4-9aaf-2dd451a65bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:37.778266 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7024d5b3-5611-4e4e-b5ae-d7540daa684d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eea1a30d7c48493eabfd9a1e96a72435', 'request_id': 'req-7024d5b3-5611-4e4e-b5ae-d7540daa684d'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:37.800640 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-4819b6bc-ef82-4aa4-9aaf-2dd451a65bc4 None None] MFA Rules not processed for user `0ff40010b9a9406aad70a30090b7762f`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:37.801828 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-4819b6bc-ef82-4aa4-9aaf-2dd451a65bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:37.848037 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7024d5b3-5611-4e4e-b5ae-d7540daa684d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eea1a30d7c48493eabfd9a1e96a72435', 'request_id': 'req-7024d5b3-5611-4e4e-b5ae-d7540daa684d'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:37.865858 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7024d5b3-5611-4e4e-b5ae-d7540daa684d admin admin] The token cache is being invalidate because project eea1a30d7c48493eabfd9a1e96a72435 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:57:37.866301 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7024d5b3-5611-4e4e-b5ae-d7540daa684d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:37.867116 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7024d5b3-5611-4e4e-b5ae-d7540daa684d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:37.873664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1058/2132] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:57:37.873664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda0b04-fbb0-40ea-b1f6-e2518d875cf6 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:37.873664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda0b04-fbb0-40ea-b1f6-e2518d875cf6 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:37.873664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda0b04-fbb0-40ea-b1f6-e2518d875cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:37.884101 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1074/2132] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:57:37 2022] DELETE /identity/v3/projects/eea1a30d7c48493eabfd9a1e96a72435 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:37.887504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024d5b3-5611-4e4e-b5ae-d7540daa684d admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:37.888992 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-7024d5b3-5611-4e4e-b5ae-d7540daa684d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:37.897008 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-3dda0b04-fbb0-40ea-b1f6-e2518d875cf6 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:37.898182 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-3dda0b04-fbb0-40ea-b1f6-e2518d875cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:37.948076 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024d5b3-5611-4e4e-b5ae-d7540daa684d admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:37.951740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c50828-911a-4005-9d63-1f249ae4eac8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:37.952517 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c50828-911a-4005-9d63-1f249ae4eac8 service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:37.952895 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c50828-911a-4005-9d63-1f249ae4eac8 service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:37.953266 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c50828-911a-4005-9d63-1f249ae4eac8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:37.955323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-40c50828-911a-4005-9d63-1f249ae4eac8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:37.962299 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1059/2133] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:57:37.970225 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c50828-911a-4005-9d63-1f249ae4eac8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:37.970709 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ce66f-eb49-45ee-976d-fd51205421dd None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:37.971003 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ce66f-eb49-45ee-976d-fd51205421dd None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:37.971287 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ce66f-eb49-45ee-976d-fd51205421dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:37.971704 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c50828-911a-4005-9d63-1f249ae4eac8 service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:37.982906 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1075/2134] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:57:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:57:37.993555 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-ce5ce66f-eb49-45ee-976d-fd51205421dd None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:37.994865 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-ce5ce66f-eb49-45ee-976d-fd51205421dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:38.009786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1060/2135] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:57:38.014757 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c50828-911a-4005-9d63-1f249ae4eac8 service cinder] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:38.021305 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ce66f-eb49-45ee-976d-fd51205421dd None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:38.023496 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-ce5ce66f-eb49-45ee-976d-fd51205421dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:38.027081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c50828-911a-4005-9d63-1f249ae4eac8 service cinder] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:38.034603 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e7bc4-949e-4fbc-b042-41850972c87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:38.034603 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e7bc4-949e-4fbc-b042-41850972c87f admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:38.034603 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e7bc4-949e-4fbc-b042-41850972c87f admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:38.034959 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e7bc4-949e-4fbc-b042-41850972c87f admin admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:38.035616 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e7bc4-949e-4fbc-b042-41850972c87f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:57:38.035939 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e7bc4-949e-4fbc-b042-41850972c87f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:38.037555 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e7bc4-949e-4fbc-b042-41850972c87f admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:38.039035 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ce66f-eb49-45ee-976d-fd51205421dd None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:38.043772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb025651-01ce-4ceb-b968-380990def7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:38.045607 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb025651-01ce-4ceb-b968-380990def7a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:38.045607 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb025651-01ce-4ceb-b968-380990def7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:38.045607 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb025651-01ce-4ceb-b968-380990def7a7 admin admin] PATH_INFO: `/v3/users/0ff40010b9a9406aad70a30090b7762f` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:38.047344 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb025651-01ce-4ceb-b968-380990def7a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ff40010b9a9406aad70a30090b7762f)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:38.049514 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb025651-01ce-4ceb-b968-380990def7a7 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:38.051153 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1076/2136] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 15:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:57:38.055583 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e7bc4-949e-4fbc-b042-41850972c87f admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:38.069346 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e7bc4-949e-4fbc-b042-41850972c87f admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:38.074656 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185dd9e8-2d21-4a43-845e-bff33be20f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:38.075327 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dd9e8-2d21-4a43-845e-bff33be20f49 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:38.075647 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dd9e8-2d21-4a43-845e-bff33be20f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:38.075923 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dd9e8-2d21-4a43-845e-bff33be20f49 admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:38.076962 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185dd9e8-2d21-4a43-845e-bff33be20f49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:38.078720 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185dd9e8-2d21-4a43-845e-bff33be20f49 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:38.230718 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1077/2137] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:57:38 2022] POST /identity/v3/projects => generated 383 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:57:38.231773 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185dd9e8-2d21-4a43-845e-bff33be20f49 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:38.265687 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:38.294414 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185dd9e8-2d21-4a43-845e-bff33be20f49 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:38.299213 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b710f-08d4-4345-84c2-a6719b90a590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:38.299917 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b710f-08d4-4345-84c2-a6719b90a590 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:38.300202 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b710f-08d4-4345-84c2-a6719b90a590 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:38.300480 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b710f-08d4-4345-84c2-a6719b90a590 admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:38.301162 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b710f-08d4-4345-84c2-a6719b90a590 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:38.303105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b710f-08d4-4345-84c2-a6719b90a590 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:38.341205 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-fb025651-01ce-4ceb-b968-380990def7a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ff40010b9a9406aad70a30090b7762f'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:38.348516 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-fb025651-01ce-4ceb-b968-380990def7a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ff40010b9a9406aad70a30090b7762f'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:38.349276 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-fb025651-01ce-4ceb-b968-380990def7a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ff40010b9a9406aad70a30090b7762f'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:38.361130 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-fb025651-01ce-4ceb-b968-380990def7a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ff40010b9a9406aad70a30090b7762f'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:38.412458 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1078/2138] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:57:38 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:57:38.416456 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b710f-08d4-4345-84c2-a6719b90a590 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:38.426294 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b710f-08d4-4345-84c2-a6719b90a590 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:38.430868 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c3692-f4a6-46a4-9b7f-82b293af9d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:38.431520 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c3692-f4a6-46a4-9b7f-82b293af9d6b admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:38.431834 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c3692-f4a6-46a4-9b7f-82b293af9d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:38.432110 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c3692-f4a6-46a4-9b7f-82b293af9d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:38.432829 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c3692-f4a6-46a4-9b7f-82b293af9d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:38.434438 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c3692-f4a6-46a4-9b7f-82b293af9d6b admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:38.437662 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:38.441463 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-fb025651-01ce-4ceb-b968-380990def7a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ff40010b9a9406aad70a30090b7762f'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:38.447825 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1079/2139] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:57:38.448810 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1061/2140] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:57:38 2022] DELETE /identity/v3/users/0ff40010b9a9406aad70a30090b7762f => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:38.453264 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb025651-01ce-4ceb-b968-380990def7a7 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:38.454738 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-fb025651-01ce-4ceb-b968-380990def7a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:38.455033 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9651b1-f7d9-4c26-b2eb-e33d01c40b15 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:38.455333 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9651b1-f7d9-4c26-b2eb-e33d01c40b15 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:38.455677 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9651b1-f7d9-4c26-b2eb-e33d01c40b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:38.474012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-ee9651b1-f7d9-4c26-b2eb-e33d01c40b15 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:38.475230 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-ee9651b1-f7d9-4c26-b2eb-e33d01c40b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:38.522821 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb025651-01ce-4ceb-b968-380990def7a7 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:38.527384 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1039a2d-2e11-45b2-afcb-f92f535711e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:38.528159 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1039a2d-2e11-45b2-afcb-f92f535711e1 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:38.528441 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1039a2d-2e11-45b2-afcb-f92f535711e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:38.528720 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1039a2d-2e11-45b2-afcb-f92f535711e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:38.529459 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1039a2d-2e11-45b2-afcb-f92f535711e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:38.532452 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1039a2d-2e11-45b2-afcb-f92f535711e1 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:38.536911 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1080/2141] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:57:38.545708 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1062/2142] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:57:38.546548 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9651b1-f7d9-4c26-b2eb-e33d01c40b15 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:38.546676 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1039a2d-2e11-45b2-afcb-f92f535711e1 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:38.548015 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-ee9651b1-f7d9-4c26-b2eb-e33d01c40b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:38.557481 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1039a2d-2e11-45b2-afcb-f92f535711e1 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:38.567292 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7a040-4c58-402d-981c-8d2fc7dfc647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:38.567815 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7a040-4c58-402d-981c-8d2fc7dfc647 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:38.568103 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7a040-4c58-402d-981c-8d2fc7dfc647 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:38.568462 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7a040-4c58-402d-981c-8d2fc7dfc647 admin admin] PATH_INFO: `/v3/projects/dd0b90acd942410288c43857a789c2c5/users/d0db6bbbeb7c498598a284b8965dd962/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:38.586934 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7a040-4c58-402d-981c-8d2fc7dfc647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd0b90acd942410288c43857a789c2c5, user_id=d0db6bbbeb7c498598a284b8965dd962, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:38.590284 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7a040-4c58-402d-981c-8d2fc7dfc647 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:38.616870 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9651b1-f7d9-4c26-b2eb-e33d01c40b15 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:38.620585 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185e2d8-2d00-4876-9f87-6b1ae1c82a65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:38.621224 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185e2d8-2d00-4876-9f87-6b1ae1c82a65 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:38.621507 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185e2d8-2d00-4876-9f87-6b1ae1c82a65 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:38.621788 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185e2d8-2d00-4876-9f87-6b1ae1c82a65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:38.632462 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185e2d8-2d00-4876-9f87-6b1ae1c82a65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:38.633962 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185e2d8-2d00-4876-9f87-6b1ae1c82a65 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:38.645915 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1081/2143] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:57:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:57:38.680529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bd257-d3b8-4c0d-9368-74f95dc26c5e None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:38.680529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bd257-d3b8-4c0d-9368-74f95dc26c5e None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:38.680529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bd257-d3b8-4c0d-9368-74f95dc26c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:38.680776 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1063/2144] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:57:38 2022] PUT /identity/v3/projects/dd0b90acd942410288c43857a789c2c5/users/d0db6bbbeb7c498598a284b8965dd962/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:57:38.699295 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-2b4bd257-d3b8-4c0d-9368-74f95dc26c5e None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:38.703103 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-2b4bd257-d3b8-4c0d-9368-74f95dc26c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:38.779784 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1082/2145] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:57:38.782108 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:38.789951 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7a040-4c58-402d-981c-8d2fc7dfc647 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:38.853642 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7a040-4c58-402d-981c-8d2fc7dfc647 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:38.857516 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006638e-676c-4ec4-b494-d9f82dedaa55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:38.858172 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006638e-676c-4ec4-b494-d9f82dedaa55 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:38.858459 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006638e-676c-4ec4-b494-d9f82dedaa55 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:38.858774 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006638e-676c-4ec4-b494-d9f82dedaa55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:38.869268 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8006638e-676c-4ec4-b494-d9f82dedaa55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:38.871903 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8006638e-676c-4ec4-b494-d9f82dedaa55 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:38.885525 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1064/2146] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:57:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:57:39.092692 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bd257-d3b8-4c0d-9368-74f95dc26c5e None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:39.095855 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-2b4bd257-d3b8-4c0d-9368-74f95dc26c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:39.106506 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bd257-d3b8-4c0d-9368-74f95dc26c5e None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:39.113285 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42820f3d-e528-4829-af9f-c185054df822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:39.114155 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42820f3d-e528-4829-af9f-c185054df822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:39.114439 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42820f3d-e528-4829-af9f-c185054df822 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:39.114719 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42820f3d-e528-4829-af9f-c185054df822 admin admin] PATH_INFO: `/v3/projects/8915a40e8bf04a879027b82b9d1f91f6` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:39.115967 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42820f3d-e528-4829-af9f-c185054df822 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8915a40e8bf04a879027b82b9d1f91f6)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:39.117908 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42820f3d-e528-4829-af9f-c185054df822 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:39.278934 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-42820f3d-e528-4829-af9f-c185054df822 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8915a40e8bf04a879027b82b9d1f91f6', 'request_id': 'req-42820f3d-e528-4829-af9f-c185054df822'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:39.287025 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-42820f3d-e528-4829-af9f-c185054df822 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8915a40e8bf04a879027b82b9d1f91f6', 'request_id': 'req-42820f3d-e528-4829-af9f-c185054df822'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:39.475907 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-42820f3d-e528-4829-af9f-c185054df822 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8915a40e8bf04a879027b82b9d1f91f6', 'request_id': 'req-42820f3d-e528-4829-af9f-c185054df822'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:39.488404 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-42820f3d-e528-4829-af9f-c185054df822 admin admin] The token cache is being invalidate because project 8915a40e8bf04a879027b82b9d1f91f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:57:39.488697 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-42820f3d-e528-4829-af9f-c185054df822 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:39.489323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-42820f3d-e528-4829-af9f-c185054df822 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:39.490868 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1083/2147] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:57:39 2022] DELETE /identity/v3/projects/8915a40e8bf04a879027b82b9d1f91f6 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:39.496087 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d0adc-b276-470c-8c7a-f22b118254fe None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:39.496784 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d0adc-b276-470c-8c7a-f22b118254fe None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:39.496784 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d0adc-b276-470c-8c7a-f22b118254fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:39.520045 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-d95d0adc-b276-470c-8c7a-f22b118254fe None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:39.521411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-d95d0adc-b276-470c-8c7a-f22b118254fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:39.563456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:39.590189 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1065/2148] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:57:39.598175 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac422289-497c-481b-a08c-0da67d8b9fea None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:39.598466 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac422289-497c-481b-a08c-0da67d8b9fea None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:39.598795 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac422289-497c-481b-a08c-0da67d8b9fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:39.618366 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-ac422289-497c-481b-a08c-0da67d8b9fea None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:39.619580 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-ac422289-497c-481b-a08c-0da67d8b9fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:39.627549 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1084/2149] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:57:39.631986 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d0adc-b276-470c-8c7a-f22b118254fe None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:39.641812 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d0adc-b276-470c-8c7a-f22b118254fe None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:39.646664 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61589a95-aadd-4da2-af26-199132b0fb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:39.647328 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61589a95-aadd-4da2-af26-199132b0fb80 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:39.647623 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61589a95-aadd-4da2-af26-199132b0fb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:39.647923 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61589a95-aadd-4da2-af26-199132b0fb80 admin admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:39.648683 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61589a95-aadd-4da2-af26-199132b0fb80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:57:39.649006 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61589a95-aadd-4da2-af26-199132b0fb80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:39.650602 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61589a95-aadd-4da2-af26-199132b0fb80 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:39.663254 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1066/2150] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 15:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:57:39.673401 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac422289-497c-481b-a08c-0da67d8b9fea None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:39.682927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac422289-497c-481b-a08c-0da67d8b9fea None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:39.688369 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee9e16-efe7-4596-aa06-d938392d7cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:39.689079 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee9e16-efe7-4596-aa06-d938392d7cd7 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:39.689368 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee9e16-efe7-4596-aa06-d938392d7cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:39.689645 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee9e16-efe7-4596-aa06-d938392d7cd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:39.690348 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee9e16-efe7-4596-aa06-d938392d7cd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:39.692689 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee9e16-efe7-4596-aa06-d938392d7cd7 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:39.822126 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1085/2151] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:57:39 2022] POST /identity/v3/projects => generated 363 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:57:39.826469 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61589a95-aadd-4da2-af26-199132b0fb80 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:39.839155 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61589a95-aadd-4da2-af26-199132b0fb80 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:39.904804 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd5321-0606-49b0-baab-f29c8a69cc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:39.910520 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd5321-0606-49b0-baab-f29c8a69cc53 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:39.910520 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd5321-0606-49b0-baab-f29c8a69cc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:39.910520 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd5321-0606-49b0-baab-f29c8a69cc53 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:39.910520 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd5321-0606-49b0-baab-f29c8a69cc53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:39.911442 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd5321-0606-49b0-baab-f29c8a69cc53 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:40.016784 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1067/2152] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:57:39 2022] POST /identity/v3/users => generated 282 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:57:40.021370 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee9e16-efe7-4596-aa06-d938392d7cd7 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:40.034887 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee9e16-efe7-4596-aa06-d938392d7cd7 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:40.045513 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e2e96-1a41-49b8-9253-40257a175961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:40.046757 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e2e96-1a41-49b8-9253-40257a175961 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:40.048193 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e2e96-1a41-49b8-9253-40257a175961 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:40.048717 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e2e96-1a41-49b8-9253-40257a175961 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:40.049765 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e2e96-1a41-49b8-9253-40257a175961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:40.051763 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e2e96-1a41-49b8-9253-40257a175961 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:40.067928 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1086/2153] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:57:40.071849 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd5321-0606-49b0-baab-f29c8a69cc53 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:40.083838 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd5321-0606-49b0-baab-f29c8a69cc53 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:40.089793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523497a-01f0-471e-990e-7a1e999f28ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:40.090501 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523497a-01f0-471e-990e-7a1e999f28ed admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:40.090734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523497a-01f0-471e-990e-7a1e999f28ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:40.091008 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523497a-01f0-471e-990e-7a1e999f28ed admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:40.091949 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523497a-01f0-471e-990e-7a1e999f28ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:40.094378 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523497a-01f0-471e-990e-7a1e999f28ed admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:40.107041 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1068/2154] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:57:40.111927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e2e96-1a41-49b8-9253-40257a175961 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:40.122502 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e2e96-1a41-49b8-9253-40257a175961 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:40.132433 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0ed92-3569-4b05-bcab-e022326a9a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:40.132433 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0ed92-3569-4b05-bcab-e022326a9a8a admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:40.132433 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0ed92-3569-4b05-bcab-e022326a9a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:40.132433 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0ed92-3569-4b05-bcab-e022326a9a8a admin admin] PATH_INFO: `/v3/projects/a9fb2c6de8e24750aef4ec79582ebb69/users/867edfb4fd09453db9cb8773fe1cf747/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:40.149978 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0ed92-3569-4b05-bcab-e022326a9a8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9fb2c6de8e24750aef4ec79582ebb69, user_id=867edfb4fd09453db9cb8773fe1cf747, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:40.153165 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0ed92-3569-4b05-bcab-e022326a9a8a admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:40.159223 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523497a-01f0-471e-990e-7a1e999f28ed admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:40.161618 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-4523497a-01f0-471e-990e-7a1e999f28ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:40.180052 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523497a-01f0-471e-990e-7a1e999f28ed admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:40.190442 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7348e-c57f-4ee9-9843-a65643288fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:40.191341 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7348e-c57f-4ee9-9843-a65643288fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:40.191658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7348e-c57f-4ee9-9843-a65643288fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:40.191934 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7348e-c57f-4ee9-9843-a65643288fcb admin admin] PATH_INFO: `/v3/users/7c175b7fe73d43e48ecb7be4242d9bf1` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:40.193208 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac7348e-c57f-4ee9-9843-a65643288fcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c175b7fe73d43e48ecb7be4242d9bf1)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:40.195221 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac7348e-c57f-4ee9-9843-a65643288fcb admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:40.224107 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1087/2155] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:57:40 2022] PUT /identity/v3/projects/a9fb2c6de8e24750aef4ec79582ebb69/users/867edfb4fd09453db9cb8773fe1cf747/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:40.224935 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0ed92-3569-4b05-bcab-e022326a9a8a admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:40.226484 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-45f0ed92-3569-4b05-bcab-e022326a9a8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:40.286739 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0ed92-3569-4b05-bcab-e022326a9a8a admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:40.290538 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1c95b-a75b-41ee-8813-0f30781b531c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:40.291185 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1c95b-a75b-41ee-8813-0f30781b531c service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:40.291586 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1c95b-a75b-41ee-8813-0f30781b531c service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:40.291904 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1c95b-a75b-41ee-8813-0f30781b531c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:40.293689 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-f0f1c95b-a75b-41ee-8813-0f30781b531c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:40.322499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:40.358537 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f1c95b-a75b-41ee-8813-0f30781b531c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:40.359967 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f1c95b-a75b-41ee-8813-0f30781b531c service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:40.369937 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1088/2156] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:57:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:57:40.371211 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceefa19-5617-476e-8856-45e769b82b8e None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:40.371501 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceefa19-5617-476e-8856-45e769b82b8e None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:40.371879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceefa19-5617-476e-8856-45e769b82b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:40.417770 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-1ceefa19-5617-476e-8856-45e769b82b8e None None] MFA Rules not processed for user `867edfb4fd09453db9cb8773fe1cf747`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:40.419083 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-1ceefa19-5617-476e-8856-45e769b82b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:40.461784 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-0ac7348e-c57f-4ee9-9843-a65643288fcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c175b7fe73d43e48ecb7be4242d9bf1'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:40.472968 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-0ac7348e-c57f-4ee9-9843-a65643288fcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c175b7fe73d43e48ecb7be4242d9bf1'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:40.474000 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-0ac7348e-c57f-4ee9-9843-a65643288fcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c175b7fe73d43e48ecb7be4242d9bf1'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:40.493136 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-0ac7348e-c57f-4ee9-9843-a65643288fcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c175b7fe73d43e48ecb7be4242d9bf1'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:40.522392 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1089/2157] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:40 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:57:40.534351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceefa19-5617-476e-8856-45e769b82b8e None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:40.535944 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-1ceefa19-5617-476e-8856-45e769b82b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:40.591576 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-0ac7348e-c57f-4ee9-9843-a65643288fcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c175b7fe73d43e48ecb7be4242d9bf1'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:40.601350 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1069/2158] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:57:40 2022] DELETE /identity/v3/users/7c175b7fe73d43e48ecb7be4242d9bf1 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:40.604382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceefa19-5617-476e-8856-45e769b82b8e None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:40.610182 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613156c8-2ce7-4293-bad1-dcd313132878 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:40.610473 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613156c8-2ce7-4293-bad1-dcd313132878 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:40.610758 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613156c8-2ce7-4293-bad1-dcd313132878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:40.629752 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-613156c8-2ce7-4293-bad1-dcd313132878 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:40.631020 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-613156c8-2ce7-4293-bad1-dcd313132878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:40.645387 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:40.667375 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc53e86-60c6-4f5d-a238-854c04ac8929 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:40.668301 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc53e86-60c6-4f5d-a238-854c04ac8929 service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:40.668586 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc53e86-60c6-4f5d-a238-854c04ac8929 service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:40.668913 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc53e86-60c6-4f5d-a238-854c04ac8929 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:40.670906 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-1cc53e86-60c6-4f5d-a238-854c04ac8929 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:40.694241 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1070/2159] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:57:40.695353 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db2cf6-66a9-42e4-95fb-b11a829fa852 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:40.695666 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db2cf6-66a9-42e4-95fb-b11a829fa852 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:40.695944 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db2cf6-66a9-42e4-95fb-b11a829fa852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:40.731230 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-76db2cf6-66a9-42e4-95fb-b11a829fa852 None None] MFA Rules not processed for user `d0db6bbbeb7c498598a284b8965dd962`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:40.732490 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-76db2cf6-66a9-42e4-95fb-b11a829fa852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:40.741029 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc53e86-60c6-4f5d-a238-854c04ac8929 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:40.742562 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc53e86-60c6-4f5d-a238-854c04ac8929 service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:40.753260 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1090/2160] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:57:40 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:57:40.753931 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc53e86-60c6-4f5d-a238-854c04ac8929 service cinder] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:40.755249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-1cc53e86-60c6-4f5d-a238-854c04ac8929 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:40.800224 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:40.805829 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1071/2161] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:57:40.817540 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db2cf6-66a9-42e4-95fb-b11a829fa852 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:40.819212 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-76db2cf6-66a9-42e4-95fb-b11a829fa852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:40.829569 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc53e86-60c6-4f5d-a238-854c04ac8929 service cinder] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:40.834080 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db2cf6-66a9-42e4-95fb-b11a829fa852 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:40.837852 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849347f-7e6b-44f4-bb4b-7516568801f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:40.837852 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849347f-7e6b-44f4-bb4b-7516568801f0 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:40.837852 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849347f-7e6b-44f4-bb4b-7516568801f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:40.837852 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849347f-7e6b-44f4-bb4b-7516568801f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:40.838559 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e3615-c118-4fc1-b1ab-b53275c9e89a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:40.839288 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e3615-c118-4fc1-b1ab-b53275c9e89a service cinder] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:40.839288 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e3615-c118-4fc1-b1ab-b53275c9e89a service cinder] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:40.842672 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e3615-c118-4fc1-b1ab-b53275c9e89a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:40.854213 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849347f-7e6b-44f4-bb4b-7516568801f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:40.854373 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e3615-c118-4fc1-b1ab-b53275c9e89a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:40.855864 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e3615-c118-4fc1-b1ab-b53275c9e89a service cinder] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:40.857009 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849347f-7e6b-44f4-bb4b-7516568801f0 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:40.868570 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1072/2162] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:57:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:57:40.884450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1091/2163] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:57:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:57:41.357976 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e3615-c118-4fc1-b1ab-b53275c9e89a service cinder] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:41.360517 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-0b2e3615-c118-4fc1-b1ab-b53275c9e89a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:41.375740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e3615-c118-4fc1-b1ab-b53275c9e89a service cinder] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:41.380772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05afd3f-68a0-4264-9282-7b8ba99c274f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:41.389465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05afd3f-68a0-4264-9282-7b8ba99c274f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:41.389465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05afd3f-68a0-4264-9282-7b8ba99c274f admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:41.389465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05afd3f-68a0-4264-9282-7b8ba99c274f admin admin] PATH_INFO: `/v3/projects/f8845c827f5d44a7bed46884aa34a921` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:41.389465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05afd3f-68a0-4264-9282-7b8ba99c274f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8845c827f5d44a7bed46884aa34a921)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:41.389465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05afd3f-68a0-4264-9282-7b8ba99c274f admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:41.540244 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-a05afd3f-68a0-4264-9282-7b8ba99c274f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8845c827f5d44a7bed46884aa34a921', 'request_id': 'req-a05afd3f-68a0-4264-9282-7b8ba99c274f'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:41.546543 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-a05afd3f-68a0-4264-9282-7b8ba99c274f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8845c827f5d44a7bed46884aa34a921', 'request_id': 'req-a05afd3f-68a0-4264-9282-7b8ba99c274f'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:41.698197 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-a05afd3f-68a0-4264-9282-7b8ba99c274f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8845c827f5d44a7bed46884aa34a921', 'request_id': 'req-a05afd3f-68a0-4264-9282-7b8ba99c274f'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:41.710686 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-a05afd3f-68a0-4264-9282-7b8ba99c274f admin admin] The token cache is being invalidate because project f8845c827f5d44a7bed46884aa34a921 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:57:41.711414 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-a05afd3f-68a0-4264-9282-7b8ba99c274f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:41.711633 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-a05afd3f-68a0-4264-9282-7b8ba99c274f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:57:41.713281 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1073/2164] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:57:41 2022] DELETE /identity/v3/projects/f8845c827f5d44a7bed46884aa34a921 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:41.721205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255ea1c-6974-46a0-83ef-5c3b3a8a9dad None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:41.721681 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255ea1c-6974-46a0-83ef-5c3b3a8a9dad None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:41.721791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255ea1c-6974-46a0-83ef-5c3b3a8a9dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:41.745309 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-2255ea1c-6974-46a0-83ef-5c3b3a8a9dad None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:41.746534 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-2255ea1c-6974-46a0-83ef-5c3b3a8a9dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:41.831435 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1092/2165] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:57:41.839271 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ffa55-7996-495f-a97d-a95b04258576 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:41.839799 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ffa55-7996-495f-a97d-a95b04258576 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:41.840111 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ffa55-7996-495f-a97d-a95b04258576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:41.860882 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-e93ffa55-7996-495f-a97d-a95b04258576 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:41.861947 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-e93ffa55-7996-495f-a97d-a95b04258576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:41.871757 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1074/2166] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:57:41.876110 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255ea1c-6974-46a0-83ef-5c3b3a8a9dad None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:41.886395 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255ea1c-6974-46a0-83ef-5c3b3a8a9dad None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:41.892341 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953122e6-f3b1-49d0-a2e4-6f8da1d2d0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:41.893055 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953122e6-f3b1-49d0-a2e4-6f8da1d2d0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:41.893345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953122e6-f3b1-49d0-a2e4-6f8da1d2d0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:41.893624 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953122e6-f3b1-49d0-a2e4-6f8da1d2d0f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:41.894376 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953122e6-f3b1-49d0-a2e4-6f8da1d2d0f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:57:41.894688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953122e6-f3b1-49d0-a2e4-6f8da1d2d0f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:41.896443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953122e6-f3b1-49d0-a2e4-6f8da1d2d0f6 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:41.913432 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1093/2167] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 15:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:57:41.918482 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ffa55-7996-495f-a97d-a95b04258576 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:41.930090 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ffa55-7996-495f-a97d-a95b04258576 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:41.936256 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1166382-b85f-4e39-8881-d4cff49b9d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:41.938121 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1166382-b85f-4e39-8881-d4cff49b9d4b admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:41.938742 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1166382-b85f-4e39-8881-d4cff49b9d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:41.939362 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1166382-b85f-4e39-8881-d4cff49b9d4b admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:41.941431 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1166382-b85f-4e39-8881-d4cff49b9d4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:41.943527 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1166382-b85f-4e39-8881-d4cff49b9d4b admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:41.954133 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:42.043945 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1075/2168] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:57:41 2022] POST /identity/v3/projects => generated 367 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:57:42.048285 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953122e6-f3b1-49d0-a2e4-6f8da1d2d0f6 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:42.058799 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953122e6-f3b1-49d0-a2e4-6f8da1d2d0f6 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:42.113276 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:42.123493 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c9115-feff-4a8d-b683-543e96c140d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:42.124234 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c9115-feff-4a8d-b683-543e96c140d1 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:42.124516 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c9115-feff-4a8d-b683-543e96c140d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:42.125392 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c9115-feff-4a8d-b683-543e96c140d1 admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:42.125519 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c9115-feff-4a8d-b683-543e96c140d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:42.127459 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c9115-feff-4a8d-b683-543e96c140d1 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:42.213546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1094/2169] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:57:42 2022] POST /identity/v3/users => generated 284 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:57:42.214337 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1166382-b85f-4e39-8881-d4cff49b9d4b admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:42.226709 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1166382-b85f-4e39-8881-d4cff49b9d4b admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:42.231841 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918daae-d98d-421d-b247-8f709ec2e355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:42.232581 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918daae-d98d-421d-b247-8f709ec2e355 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:42.232870 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918daae-d98d-421d-b247-8f709ec2e355 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:42.233177 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918daae-d98d-421d-b247-8f709ec2e355 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:42.234206 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918daae-d98d-421d-b247-8f709ec2e355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:42.235953 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918daae-d98d-421d-b247-8f709ec2e355 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:42.249811 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1076/2170] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:57:42.251183 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c9115-feff-4a8d-b683-543e96c140d1 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:42.261875 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c9115-feff-4a8d-b683-543e96c140d1 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:42.267543 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b372091-67db-471d-a8e3-83fe475f074a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:42.268282 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b372091-67db-471d-a8e3-83fe475f074a admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:42.268568 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b372091-67db-471d-a8e3-83fe475f074a admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:42.268901 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b372091-67db-471d-a8e3-83fe475f074a admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:42.269676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b372091-67db-471d-a8e3-83fe475f074a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:42.271324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b372091-67db-471d-a8e3-83fe475f074a admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:42.286932 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1095/2171] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:57:42.288220 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918daae-d98d-421d-b247-8f709ec2e355 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:42.298537 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918daae-d98d-421d-b247-8f709ec2e355 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:42.303247 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c970d-94d5-49a3-8de1-719b704f6d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:42.304150 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c970d-94d5-49a3-8de1-719b704f6d3f admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:42.304434 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c970d-94d5-49a3-8de1-719b704f6d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:42.304705 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c970d-94d5-49a3-8de1-719b704f6d3f admin admin] PATH_INFO: `/v3/projects/5019ea4f128e4e8ebe80e882e6587d01/users/6532ea194211415ea0949b201a1c801b/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:42.320908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c970d-94d5-49a3-8de1-719b704f6d3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5019ea4f128e4e8ebe80e882e6587d01, user_id=6532ea194211415ea0949b201a1c801b, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:42.323639 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c970d-94d5-49a3-8de1-719b704f6d3f admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:42.419279 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1077/2172] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:57:42 2022] PUT /identity/v3/projects/5019ea4f128e4e8ebe80e882e6587d01/users/6532ea194211415ea0949b201a1c801b/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:57:42.430403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7abadb-cde1-4740-ba31-dfea4f789562 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:42.430691 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7abadb-cde1-4740-ba31-dfea4f789562 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:42.431029 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7abadb-cde1-4740-ba31-dfea4f789562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:42.463408 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-6f7abadb-cde1-4740-ba31-dfea4f789562 None None] MFA Rules not processed for user `6532ea194211415ea0949b201a1c801b`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:42.464673 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-6f7abadb-cde1-4740-ba31-dfea4f789562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:42.537184 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1096/2173] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:57:42.550347 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c970d-94d5-49a3-8de1-719b704f6d3f admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:57:42.552519 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-ad8c970d-94d5-49a3-8de1-719b704f6d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:42.641158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c970d-94d5-49a3-8de1-719b704f6d3f admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:57:42.645469 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6abd0e-3d50-4bbf-aaf3-8c43412bdc34 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd003ff6cc73946da9203c69a167bbfff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:57:42.646121 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6abd0e-3d50-4bbf-aaf3-8c43412bdc34 service glance] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:42.646416 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6abd0e-3d50-4bbf-aaf3-8c43412bdc34 service glance] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:42.646684 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6abd0e-3d50-4bbf-aaf3-8c43412bdc34 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:42.658385 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6abd0e-3d50-4bbf-aaf3-8c43412bdc34 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:57:42.659962 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6abd0e-3d50-4bbf-aaf3-8c43412bdc34 service glance] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:57:42.670539 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1078/2174] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:57:42 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:57:43.985588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d351e-78ce-4516-832d-362a2011a901 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:43.986565 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d351e-78ce-4516-832d-362a2011a901 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:43.986853 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d351e-78ce-4516-832d-362a2011a901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:44.007262 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-243d351e-78ce-4516-832d-362a2011a901 None None] MFA Rules not processed for user `d0db6bbbeb7c498598a284b8965dd962`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:44.009189 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-243d351e-78ce-4516-832d-362a2011a901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:44.071782 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1097/2175] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:57:53.145786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=54,keystone:INSERT=2 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:54.064755 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=67,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:57:57.871911 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d3da2-8733-45da-a847-77cff0247aa9 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:57:57.872412 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d3da2-8733-45da-a847-77cff0247aa9 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:57:57.872540 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d3da2-8733-45da-a847-77cff0247aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:57:57.891277 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-bf3d3da2-8733-45da-a847-77cff0247aa9 None None] MFA Rules not processed for user `5c6b6d56a8b94fcb9eecc4d3167cd8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:57:57.892607 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-bf3d3da2-8733-45da-a847-77cff0247aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:57:57.953729 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1079/2176] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:57:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:58:07.946293 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=25 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:58:19.797053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d351e-78ce-4516-832d-362a2011a901 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:58:19.865411 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d351e-78ce-4516-832d-362a2011a901 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:58:19.870063 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898c6dc-f57a-4ac4-a0eb-de9976fee67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:58:19.871615 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898c6dc-f57a-4ac4-a0eb-de9976fee67b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:58:19.871964 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898c6dc-f57a-4ac4-a0eb-de9976fee67b admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:58:19.872250 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898c6dc-f57a-4ac4-a0eb-de9976fee67b admin admin] PATH_INFO: `/v3/users/6532ea194211415ea0949b201a1c801b` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:58:19.873778 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898c6dc-f57a-4ac4-a0eb-de9976fee67b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6532ea194211415ea0949b201a1c801b)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:58:19.875764 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898c6dc-f57a-4ac4-a0eb-de9976fee67b admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:58:20.060775 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-8898c6dc-f57a-4ac4-a0eb-de9976fee67b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6532ea194211415ea0949b201a1c801b'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:58:20.061446 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-8898c6dc-f57a-4ac4-a0eb-de9976fee67b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6532ea194211415ea0949b201a1c801b'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:58:20.062061 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-8898c6dc-f57a-4ac4-a0eb-de9976fee67b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6532ea194211415ea0949b201a1c801b'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:58:20.126679 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-8898c6dc-f57a-4ac4-a0eb-de9976fee67b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6532ea194211415ea0949b201a1c801b'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:58:20.134568 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-8898c6dc-f57a-4ac4-a0eb-de9976fee67b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6532ea194211415ea0949b201a1c801b'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:58:20.156248 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1098/2177] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:58:19 2022] DELETE /identity/v3/users/6532ea194211415ea0949b201a1c801b => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:58:20.160984 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e5592-fca7-4cbb-84cd-5da3faa6c723 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:58:20.161504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e5592-fca7-4cbb-84cd-5da3faa6c723 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:58:20.161504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e5592-fca7-4cbb-84cd-5da3faa6c723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:58:20.181332 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-b35e5592-fca7-4cbb-84cd-5da3faa6c723 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:58:20.182550 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-b35e5592-fca7-4cbb-84cd-5da3faa6c723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:58:20.249442 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1080/2178] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:58:20.259091 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898c6dc-f57a-4ac4-a0eb-de9976fee67b admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:58:20.260509 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-8898c6dc-f57a-4ac4-a0eb-de9976fee67b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:58:20.332946 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898c6dc-f57a-4ac4-a0eb-de9976fee67b admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:58:20.341341 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02e3cf-0961-4b60-ad76-64362f549be9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:58:20.342007 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02e3cf-0961-4b60-ad76-64362f549be9 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:58:20.342292 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02e3cf-0961-4b60-ad76-64362f549be9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:58:20.342568 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02e3cf-0961-4b60-ad76-64362f549be9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:58:20.355175 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02e3cf-0961-4b60-ad76-64362f549be9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:58:20.356664 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02e3cf-0961-4b60-ad76-64362f549be9 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:58:20.368141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1099/2179] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:58:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:58:20.775348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e5592-fca7-4cbb-84cd-5da3faa6c723 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:58:20.777662 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-b35e5592-fca7-4cbb-84cd-5da3faa6c723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:58:20.790160 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e5592-fca7-4cbb-84cd-5da3faa6c723 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:58:20.796349 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12935b9c-ab4e-4716-9d09-64b4c886cafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:58:20.797260 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12935b9c-ab4e-4716-9d09-64b4c886cafc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:58:20.797563 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12935b9c-ab4e-4716-9d09-64b4c886cafc admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:58:20.797844 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12935b9c-ab4e-4716-9d09-64b4c886cafc admin admin] PATH_INFO: `/v3/projects/5019ea4f128e4e8ebe80e882e6587d01` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:58:20.799032 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12935b9c-ab4e-4716-9d09-64b4c886cafc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5019ea4f128e4e8ebe80e882e6587d01)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:58:20.801128 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12935b9c-ab4e-4716-9d09-64b4c886cafc admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:58:20.891775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-12935b9c-ab4e-4716-9d09-64b4c886cafc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5019ea4f128e4e8ebe80e882e6587d01', 'request_id': 'req-12935b9c-ab4e-4716-9d09-64b4c886cafc'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:58:20.897988 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-12935b9c-ab4e-4716-9d09-64b4c886cafc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5019ea4f128e4e8ebe80e882e6587d01', 'request_id': 'req-12935b9c-ab4e-4716-9d09-64b4c886cafc'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:58:20.938378 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-12935b9c-ab4e-4716-9d09-64b4c886cafc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5019ea4f128e4e8ebe80e882e6587d01', 'request_id': 'req-12935b9c-ab4e-4716-9d09-64b4c886cafc'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:58:20.953114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-12935b9c-ab4e-4716-9d09-64b4c886cafc admin admin] The token cache is being invalidate because project 5019ea4f128e4e8ebe80e882e6587d01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:58:20.953463 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-12935b9c-ab4e-4716-9d09-64b4c886cafc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:58:20.954218 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-12935b9c-ab4e-4716-9d09-64b4c886cafc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:58:20.956106 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1081/2180] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:58:20 2022] DELETE /identity/v3/projects/5019ea4f128e4e8ebe80e882e6587d01 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:58:20.962122 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cd443-58c6-4a54-9ede-602a50f27a81 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:58:20.962675 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cd443-58c6-4a54-9ede-602a50f27a81 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:58:20.967823 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cd443-58c6-4a54-9ede-602a50f27a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:58:20.982182 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-334cd443-58c6-4a54-9ede-602a50f27a81 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:58:20.983388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-334cd443-58c6-4a54-9ede-602a50f27a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:58:21.006005 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:58:21.049567 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1100/2181] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:58:21.057280 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fcda2-0528-4c0a-ab8d-3d53676c237e None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:58:21.057568 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fcda2-0528-4c0a-ab8d-3d53676c237e None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:58:21.057846 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fcda2-0528-4c0a-ab8d-3d53676c237e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:58:21.079195 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-f29fcda2-0528-4c0a-ab8d-3d53676c237e None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:58:21.080414 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-f29fcda2-0528-4c0a-ab8d-3d53676c237e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:58:21.088617 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1082/2182] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:58:21.093627 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cd443-58c6-4a54-9ede-602a50f27a81 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:58:21.103279 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cd443-58c6-4a54-9ede-602a50f27a81 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:58:21.107876 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d53754-4308-43d9-a8d7-01c991e79528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:58:21.108527 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d53754-4308-43d9-a8d7-01c991e79528 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:58:21.108814 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d53754-4308-43d9-a8d7-01c991e79528 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:58:21.109092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d53754-4308-43d9-a8d7-01c991e79528 admin admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:58:21.109816 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d53754-4308-43d9-a8d7-01c991e79528 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:58:21.110126 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d53754-4308-43d9-a8d7-01c991e79528 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:58:21.111778 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d53754-4308-43d9-a8d7-01c991e79528 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:58:21.123553 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1101/2183] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 15:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:58:21.127864 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29fcda2-0528-4c0a-ab8d-3d53676c237e None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:58:21.138467 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29fcda2-0528-4c0a-ab8d-3d53676c237e None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:58:21.143399 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db395cff-58b3-41ce-9ea9-23f94386130b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:58:21.144097 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db395cff-58b3-41ce-9ea9-23f94386130b admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:58:21.144384 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db395cff-58b3-41ce-9ea9-23f94386130b admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:58:21.144661 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db395cff-58b3-41ce-9ea9-23f94386130b admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:58:21.145415 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db395cff-58b3-41ce-9ea9-23f94386130b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:58:21.147337 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db395cff-58b3-41ce-9ea9-23f94386130b admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:58:21.259875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1083/2184] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 15:58:21 2022] POST /identity/v3/projects => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:58:21.264791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d53754-4308-43d9-a8d7-01c991e79528 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:58:21.274742 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d53754-4308-43d9-a8d7-01c991e79528 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:58:21.331864 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3c924-c75e-417c-a4aa-dbbc7c7e692d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:58:21.332532 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3c924-c75e-417c-a4aa-dbbc7c7e692d admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:58:21.332817 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3c924-c75e-417c-a4aa-dbbc7c7e692d admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:58:21.333099 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3c924-c75e-417c-a4aa-dbbc7c7e692d admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:58:21.333787 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3c924-c75e-417c-a4aa-dbbc7c7e692d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:58:21.335772 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3c924-c75e-417c-a4aa-dbbc7c7e692d admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:58:21.418172 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1102/2185] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 15:58:21 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:58:21.422186 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db395cff-58b3-41ce-9ea9-23f94386130b admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:58:21.432634 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db395cff-58b3-41ce-9ea9-23f94386130b admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:58:21.438250 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75393ef9-2f67-4847-b4de-a741d5528b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:58:21.438904 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75393ef9-2f67-4847-b4de-a741d5528b0d admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:58:21.439188 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75393ef9-2f67-4847-b4de-a741d5528b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:58:21.439465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75393ef9-2f67-4847-b4de-a741d5528b0d admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:58:21.440221 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75393ef9-2f67-4847-b4de-a741d5528b0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:58:21.442456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75393ef9-2f67-4847-b4de-a741d5528b0d admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:58:21.453151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1084/2186] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:58:21.457100 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3c924-c75e-417c-a4aa-dbbc7c7e692d admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:58:21.467290 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3c924-c75e-417c-a4aa-dbbc7c7e692d admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:58:21.471922 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b8611-935f-4c6d-b6d7-7c409a630b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:58:21.472575 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b8611-935f-4c6d-b6d7-7c409a630b7b admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:58:21.472860 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b8611-935f-4c6d-b6d7-7c409a630b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:58:21.473137 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b8611-935f-4c6d-b6d7-7c409a630b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:58:21.473863 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b8611-935f-4c6d-b6d7-7c409a630b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:58:21.475482 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b8611-935f-4c6d-b6d7-7c409a630b7b admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:58:21.485719 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1103/2187] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 15:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:58:21.489804 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75393ef9-2f67-4847-b4de-a741d5528b0d admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:58:21.500336 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75393ef9-2f67-4847-b4de-a741d5528b0d admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:58:21.504889 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1269a6e-ae8f-492e-8b68-39bbddb91296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:58:21.505751 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1269a6e-ae8f-492e-8b68-39bbddb91296 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:58:21.506034 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1269a6e-ae8f-492e-8b68-39bbddb91296 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:58:21.506310 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1269a6e-ae8f-492e-8b68-39bbddb91296 admin admin] PATH_INFO: `/v3/projects/00d2d8c6acd8408295650fbb3e0fffec/users/a10b927fb5044a4480b218a13215a2d5/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:58:21.521683 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1269a6e-ae8f-492e-8b68-39bbddb91296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00d2d8c6acd8408295650fbb3e0fffec, user_id=a10b927fb5044a4480b218a13215a2d5, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:58:21.524404 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1269a6e-ae8f-492e-8b68-39bbddb91296 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:58:21.591453 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1085/2188] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 15:58:21 2022] PUT /identity/v3/projects/00d2d8c6acd8408295650fbb3e0fffec/users/a10b927fb5044a4480b218a13215a2d5/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:58:21.602475 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ad7ea-5922-49fd-bdfe-efe715815037 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:58:21.602772 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ad7ea-5922-49fd-bdfe-efe715815037 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:58:21.603055 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ad7ea-5922-49fd-bdfe-efe715815037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:58:21.632054 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-107ad7ea-5922-49fd-bdfe-efe715815037 None None] MFA Rules not processed for user `a10b927fb5044a4480b218a13215a2d5`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:58:21.633252 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-107ad7ea-5922-49fd-bdfe-efe715815037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:58:21.699857 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1104/2189] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:58:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:58:21.711779 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1269a6e-ae8f-492e-8b68-39bbddb91296 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:58:21.713531 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-a1269a6e-ae8f-492e-8b68-39bbddb91296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:58:21.738420 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:58:21.773529 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1269a6e-ae8f-492e-8b68-39bbddb91296 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:58:21.777692 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abff634-80d2-4d39-8140-051b4b73bb57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:58:21.778328 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abff634-80d2-4d39-8140-051b4b73bb57 service cinder] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:58:21.778611 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abff634-80d2-4d39-8140-051b4b73bb57 service cinder] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:58:21.778884 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abff634-80d2-4d39-8140-051b4b73bb57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:58:21.787138 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abff634-80d2-4d39-8140-051b4b73bb57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:58:21.788608 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abff634-80d2-4d39-8140-051b4b73bb57 service cinder] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:58:21.798017 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1086/2190] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:58:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:58:21.823356 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ad7ea-5922-49fd-bdfe-efe715815037 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:58:21.843408 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:58:21.889730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ad7ea-5922-49fd-bdfe-efe715815037 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:58:21.894380 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80a6da-b7a4-45e9-9d92-620fdcc5eab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:58:21.895265 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80a6da-b7a4-45e9-9d92-620fdcc5eab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:58:21.895566 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80a6da-b7a4-45e9-9d92-620fdcc5eab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:58:21.895874 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80a6da-b7a4-45e9-9d92-620fdcc5eab1 admin admin] PATH_INFO: `/v3/users/a10b927fb5044a4480b218a13215a2d5` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:58:21.897110 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c80a6da-b7a4-45e9-9d92-620fdcc5eab1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a10b927fb5044a4480b218a13215a2d5)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:58:21.899073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c80a6da-b7a4-45e9-9d92-620fdcc5eab1 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:58:22.095125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-6c80a6da-b7a4-45e9-9d92-620fdcc5eab1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a10b927fb5044a4480b218a13215a2d5'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:58:22.095853 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-6c80a6da-b7a4-45e9-9d92-620fdcc5eab1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a10b927fb5044a4480b218a13215a2d5'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:58:22.096444 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-6c80a6da-b7a4-45e9-9d92-620fdcc5eab1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a10b927fb5044a4480b218a13215a2d5'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:58:22.195235 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-6c80a6da-b7a4-45e9-9d92-620fdcc5eab1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a10b927fb5044a4480b218a13215a2d5'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:58:22.204233 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-6c80a6da-b7a4-45e9-9d92-620fdcc5eab1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a10b927fb5044a4480b218a13215a2d5'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:58:22.226491 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1105/2191] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:58:21 2022] DELETE /identity/v3/users/a10b927fb5044a4480b218a13215a2d5 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:58:22.231280 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cc9d5-302a-48fa-a1ae-f9a16e223fb0 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:58:22.231781 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cc9d5-302a-48fa-a1ae-f9a16e223fb0 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:58:22.232125 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cc9d5-302a-48fa-a1ae-f9a16e223fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:58:22.251816 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-7b4cc9d5-302a-48fa-a1ae-f9a16e223fb0 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:58:22.253044 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-7b4cc9d5-302a-48fa-a1ae-f9a16e223fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:58:22.316377 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1087/2192] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:58:22.327770 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80a6da-b7a4-45e9-9d92-620fdcc5eab1 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:58:22.329332 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-6c80a6da-b7a4-45e9-9d92-620fdcc5eab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:58:22.393123 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80a6da-b7a4-45e9-9d92-620fdcc5eab1 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:58:22.397067 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fcb3e-01a4-4b4d-ac6a-48277de7cb71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:58:22.397724 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fcb3e-01a4-4b4d-ac6a-48277de7cb71 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:58:22.398007 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fcb3e-01a4-4b4d-ac6a-48277de7cb71 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:58:22.398284 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fcb3e-01a4-4b4d-ac6a-48277de7cb71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:58:22.408805 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7fcb3e-01a4-4b4d-ac6a-48277de7cb71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:58:22.410302 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7fcb3e-01a4-4b4d-ac6a-48277de7cb71 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:58:22.420758 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1106/2193] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:58:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:58:22.852690 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4cc9d5-302a-48fa-a1ae-f9a16e223fb0 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:58:22.854120 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-7b4cc9d5-302a-48fa-a1ae-f9a16e223fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:58:22.874205 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4cc9d5-302a-48fa-a1ae-f9a16e223fb0 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:58:22.879030 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a437bbe-7725-4576-bf3d-b278123359e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:58:22.879954 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a437bbe-7725-4576-bf3d-b278123359e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:58:22.880231 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a437bbe-7725-4576-bf3d-b278123359e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:58:22.880508 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a437bbe-7725-4576-bf3d-b278123359e5 admin admin] PATH_INFO: `/v3/projects/00d2d8c6acd8408295650fbb3e0fffec` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:58:22.881873 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a437bbe-7725-4576-bf3d-b278123359e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00d2d8c6acd8408295650fbb3e0fffec)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:58:22.883801 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a437bbe-7725-4576-bf3d-b278123359e5 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:58:22.992463 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-1a437bbe-7725-4576-bf3d-b278123359e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00d2d8c6acd8408295650fbb3e0fffec', 'request_id': 'req-1a437bbe-7725-4576-bf3d-b278123359e5'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:58:22.999414 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-1a437bbe-7725-4576-bf3d-b278123359e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00d2d8c6acd8408295650fbb3e0fffec', 'request_id': 'req-1a437bbe-7725-4576-bf3d-b278123359e5'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:58:23.069408 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-1a437bbe-7725-4576-bf3d-b278123359e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00d2d8c6acd8408295650fbb3e0fffec', 'request_id': 'req-1a437bbe-7725-4576-bf3d-b278123359e5'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:58:23.083158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-1a437bbe-7725-4576-bf3d-b278123359e5 admin admin] The token cache is being invalidate because project 00d2d8c6acd8408295650fbb3e0fffec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:58:23.083453 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-1a437bbe-7725-4576-bf3d-b278123359e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:58:23.084159 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-1a437bbe-7725-4576-bf3d-b278123359e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:58:23.085785 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1088/2194] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:58:22 2022] DELETE /identity/v3/projects/00d2d8c6acd8408295650fbb3e0fffec => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:58:32.415665 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:58:33.079858 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:58:41.124051 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fcb3e-01a4-4b4d-ac6a-48277de7cb71 service neutron] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:58:41.126090 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-df7fcb3e-01a4-4b4d-ac6a-48277de7cb71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:58:41.138723 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fcb3e-01a4-4b4d-ac6a-48277de7cb71 service neutron] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:58:41.195454 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760553b-7070-4d56-8630-4e4042cf66a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:58:41.196354 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760553b-7070-4d56-8630-4e4042cf66a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:58:41.196636 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760553b-7070-4d56-8630-4e4042cf66a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:58:41.196912 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760553b-7070-4d56-8630-4e4042cf66a9 admin admin] PATH_INFO: `/v3/users/867edfb4fd09453db9cb8773fe1cf747` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:58:41.198115 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760553b-7070-4d56-8630-4e4042cf66a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=867edfb4fd09453db9cb8773fe1cf747)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:58:41.200085 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760553b-7070-4d56-8630-4e4042cf66a9 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:58:41.420582 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-5760553b-7070-4d56-8630-4e4042cf66a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '867edfb4fd09453db9cb8773fe1cf747'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:58:41.421238 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-5760553b-7070-4d56-8630-4e4042cf66a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '867edfb4fd09453db9cb8773fe1cf747'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:58:41.421916 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-5760553b-7070-4d56-8630-4e4042cf66a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '867edfb4fd09453db9cb8773fe1cf747'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:58:41.491757 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-5760553b-7070-4d56-8630-4e4042cf66a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '867edfb4fd09453db9cb8773fe1cf747'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:58:41.499193 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-5760553b-7070-4d56-8630-4e4042cf66a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '867edfb4fd09453db9cb8773fe1cf747'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:58:41.517878 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1107/2195] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 15:58:41 2022] DELETE /identity/v3/users/867edfb4fd09453db9cb8773fe1cf747 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:58:41.522677 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15427066-fc33-478a-a294-e2e8157dc7d3 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:58:41.523182 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15427066-fc33-478a-a294-e2e8157dc7d3 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:58:41.523514 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15427066-fc33-478a-a294-e2e8157dc7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:58:41.544140 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-15427066-fc33-478a-a294-e2e8157dc7d3 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:58:41.545325 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-15427066-fc33-478a-a294-e2e8157dc7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:58:41.605081 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1089/2196] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:58:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:58:41.614741 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760553b-7070-4d56-8630-4e4042cf66a9 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:58:41.616189 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-5760553b-7070-4d56-8630-4e4042cf66a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:58:41.673140 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760553b-7070-4d56-8630-4e4042cf66a9 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:58:41.676746 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5f34a-e55d-4d8c-9657-51a30d9102a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:58:41.677391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5f34a-e55d-4d8c-9657-51a30d9102a6 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:58:41.677676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5f34a-e55d-4d8c-9657-51a30d9102a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:58:41.677955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5f34a-e55d-4d8c-9657-51a30d9102a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:58:41.687109 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5f34a-e55d-4d8c-9657-51a30d9102a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:58:41.688769 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5f34a-e55d-4d8c-9657-51a30d9102a6 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:58:41.698146 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1108/2197] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:58:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:58:42.342998 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15427066-fc33-478a-a294-e2e8157dc7d3 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:58:42.344669 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-15427066-fc33-478a-a294-e2e8157dc7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:58:42.357240 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15427066-fc33-478a-a294-e2e8157dc7d3 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:58:42.363551 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee406a-599c-49ea-a3b1-22d3d6cbdef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:58:42.368830 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee406a-599c-49ea-a3b1-22d3d6cbdef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:58:42.368830 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee406a-599c-49ea-a3b1-22d3d6cbdef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:58:42.368830 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee406a-599c-49ea-a3b1-22d3d6cbdef2 admin admin] PATH_INFO: `/v3/projects/a9fb2c6de8e24750aef4ec79582ebb69` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:58:42.368830 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee406a-599c-49ea-a3b1-22d3d6cbdef2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9fb2c6de8e24750aef4ec79582ebb69)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:58:42.368830 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee406a-599c-49ea-a3b1-22d3d6cbdef2 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:58:42.543881 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-faee406a-599c-49ea-a3b1-22d3d6cbdef2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9fb2c6de8e24750aef4ec79582ebb69', 'request_id': 'req-faee406a-599c-49ea-a3b1-22d3d6cbdef2'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:58:42.550189 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-faee406a-599c-49ea-a3b1-22d3d6cbdef2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9fb2c6de8e24750aef4ec79582ebb69', 'request_id': 'req-faee406a-599c-49ea-a3b1-22d3d6cbdef2'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:58:42.622964 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-faee406a-599c-49ea-a3b1-22d3d6cbdef2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9fb2c6de8e24750aef4ec79582ebb69', 'request_id': 'req-faee406a-599c-49ea-a3b1-22d3d6cbdef2'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:58:42.635978 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-faee406a-599c-49ea-a3b1-22d3d6cbdef2 admin admin] The token cache is being invalidate because project a9fb2c6de8e24750aef4ec79582ebb69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:58:42.636270 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-faee406a-599c-49ea-a3b1-22d3d6cbdef2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:58:42.636903 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-faee406a-599c-49ea-a3b1-22d3d6cbdef2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:58:42.638606 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1090/2198] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 15:58:42 2022] DELETE /identity/v3/projects/a9fb2c6de8e24750aef4ec79582ebb69 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:58:44.086919 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08089a-bb67-42b5-8c3f-cb01311765d4 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:58:44.087483 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08089a-bb67-42b5-8c3f-cb01311765d4 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:58:44.087483 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08089a-bb67-42b5-8c3f-cb01311765d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:58:44.105298 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-da08089a-bb67-42b5-8c3f-cb01311765d4 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:58:44.106624 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-da08089a-bb67-42b5-8c3f-cb01311765d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:58:44.123951 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:58:44.171732 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1109/2199] 10.222.0.15 () {58 vars in 1016 bytes} [Mon May 23 15:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:58:44.203092 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee406a-599c-49ea-a3b1-22d3d6cbdef2 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:58:44.204654 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-faee406a-599c-49ea-a3b1-22d3d6cbdef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:58:44.292845 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:58:44.307456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee406a-599c-49ea-a3b1-22d3d6cbdef2 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:58:44.313314 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f73643-a33a-48b2-86cd-5e432074aec3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:58:44.313953 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f73643-a33a-48b2-86cd-5e432074aec3 service nova] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:58:44.314236 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f73643-a33a-48b2-86cd-5e432074aec3 service nova] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:58:44.314513 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f73643-a33a-48b2-86cd-5e432074aec3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:58:44.323982 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f73643-a33a-48b2-86cd-5e432074aec3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:58:44.325563 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f73643-a33a-48b2-86cd-5e432074aec3 service nova] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:58:44.335194 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1091/2200] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:58:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:58:50.610385 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10108bdd-b12b-40a6-89a2-f673f5b2a4ae None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:58:50.610919 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10108bdd-b12b-40a6-89a2-f673f5b2a4ae None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:58:50.611022 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10108bdd-b12b-40a6-89a2-f673f5b2a4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:58:50.631803 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-10108bdd-b12b-40a6-89a2-f673f5b2a4ae None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:58:50.633133 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-10108bdd-b12b-40a6-89a2-f673f5b2a4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:58:50.641492 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1110/2201] 10.222.0.15 () {58 vars in 1016 bytes} [Mon May 23 15:58:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:58:50.663902 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f73643-a33a-48b2-86cd-5e432074aec3 service nova] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:58:50.675560 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f73643-a33a-48b2-86cd-5e432074aec3 service nova] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:58:50.681796 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3b31c-c1f8-40a9-ba3f-889ec8e96534 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:58:50.682429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3b31c-c1f8-40a9-ba3f-889ec8e96534 service nova] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:58:50.682713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3b31c-c1f8-40a9-ba3f-889ec8e96534 service nova] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:58:50.682987 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3b31c-c1f8-40a9-ba3f-889ec8e96534 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:58:50.691817 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3b31c-c1f8-40a9-ba3f-889ec8e96534 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:58:50.693409 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3b31c-c1f8-40a9-ba3f-889ec8e96534 service nova] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:58:50.703020 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1092/2202] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:58:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:58:56.125669 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f71d2a-fe8a-4e2f-afc1-acb94717213c None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:58:56.126240 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f71d2a-fe8a-4e2f-afc1-acb94717213c None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:58:56.126359 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f71d2a-fe8a-4e2f-afc1-acb94717213c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:58:56.145446 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-78f71d2a-fe8a-4e2f-afc1-acb94717213c None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:58:56.146786 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-78f71d2a-fe8a-4e2f-afc1-acb94717213c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:58:56.155924 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1111/2203] 10.222.0.15 () {58 vars in 1016 bytes} [Mon May 23 15:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:58:56.198094 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3b31c-c1f8-40a9-ba3f-889ec8e96534 service nova] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:58:56.211774 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3b31c-c1f8-40a9-ba3f-889ec8e96534 service nova] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:58:56.219375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7d95a-d9f5-4261-8ec5-2ea4764d41b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:58:56.220071 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7d95a-d9f5-4261-8ec5-2ea4764d41b8 service nova] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:58:56.220357 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7d95a-d9f5-4261-8ec5-2ea4764d41b8 service nova] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:58:56.220638 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7d95a-d9f5-4261-8ec5-2ea4764d41b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:58:56.233011 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7d95a-d9f5-4261-8ec5-2ea4764d41b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:58:56.236007 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7d95a-d9f5-4261-8ec5-2ea4764d41b8 service nova] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:58:56.245472 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1093/2204] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:58:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:58:58.625208 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fa9f6-099f-4c3d-979d-910fc1aa1172 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:58:58.625695 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fa9f6-099f-4c3d-979d-910fc1aa1172 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:58:58.625792 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fa9f6-099f-4c3d-979d-910fc1aa1172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:58:58.644066 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-305fa9f6-099f-4c3d-979d-910fc1aa1172 None None] MFA Rules not processed for user `ce2a9dc6fbae42dfbfa4cb8b326c3de5`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:58:58.645279 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-305fa9f6-099f-4c3d-979d-910fc1aa1172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:58:58.701782 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1112/2205] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:58:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:59:00.002504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684eb8c5-9318-46c3-bd82-4a46110087de None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:59:00.002990 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684eb8c5-9318-46c3-bd82-4a46110087de None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:59:00.003083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684eb8c5-9318-46c3-bd82-4a46110087de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:59:00.021822 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-684eb8c5-9318-46c3-bd82-4a46110087de None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:59:00.023042 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-684eb8c5-9318-46c3-bd82-4a46110087de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:59:00.031246 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1094/2206] 10.222.0.15 () {58 vars in 1016 bytes} [Mon May 23 15:59:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:59:00.053636 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fa9f6-099f-4c3d-979d-910fc1aa1172 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:59:00.055001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-305fa9f6-099f-4c3d-979d-910fc1aa1172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:59:00.071768 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fa9f6-099f-4c3d-979d-910fc1aa1172 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:59:00.078210 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f69e7d-e35e-40b5-860d-ae45af219507 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:59:00.078823 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f69e7d-e35e-40b5-860d-ae45af219507 service nova] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:59:00.079106 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f69e7d-e35e-40b5-860d-ae45af219507 service nova] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:59:00.079382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f69e7d-e35e-40b5-860d-ae45af219507 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:59:00.087976 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f69e7d-e35e-40b5-860d-ae45af219507 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:59:00.089592 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f69e7d-e35e-40b5-860d-ae45af219507 service nova] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:59:00.099706 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1113/2207] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:59:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:59:01.446970 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684eb8c5-9318-46c3-bd82-4a46110087de None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:59:01.448635 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-684eb8c5-9318-46c3-bd82-4a46110087de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:59:01.541801 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684eb8c5-9318-46c3-bd82-4a46110087de None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:59:01.547472 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e66e8a-64dc-4737-ab83-a94b16195cb1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f06d35d7cc48658262bf79d9c72280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:59:01.548171 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e66e8a-64dc-4737-ab83-a94b16195cb1 service placement] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:59:01.548470 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e66e8a-64dc-4737-ab83-a94b16195cb1 service placement] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:59:01.548742 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e66e8a-64dc-4737-ab83-a94b16195cb1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:59:01.550520 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-50e66e8a-64dc-4737-ab83-a94b16195cb1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:59:01.563820 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e66e8a-64dc-4737-ab83-a94b16195cb1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:59:01.565422 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e66e8a-64dc-4737-ab83-a94b16195cb1 service placement] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:59:01.575552 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1095/2208] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:59:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:59:05.245933 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838e3e7-b2c2-42ff-b2d5-dd15fd64eb0b None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:59:05.246425 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838e3e7-b2c2-42ff-b2d5-dd15fd64eb0b None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:59:05.246504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838e3e7-b2c2-42ff-b2d5-dd15fd64eb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:59:05.272471 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-c838e3e7-b2c2-42ff-b2d5-dd15fd64eb0b None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:59:05.273827 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-c838e3e7-b2c2-42ff-b2d5-dd15fd64eb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:59:05.283305 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1114/2209] 10.222.0.15 () {58 vars in 1016 bytes} [Mon May 23 15:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:59:05.306240 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e66e8a-64dc-4737-ab83-a94b16195cb1 service placement] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:59:05.320400 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e66e8a-64dc-4737-ab83-a94b16195cb1 service placement] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:59:05.327832 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69fb97-ea62-48a1-a490-eb584022d331 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:59:05.328504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69fb97-ea62-48a1-a490-eb584022d331 service nova] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:59:05.328787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69fb97-ea62-48a1-a490-eb584022d331 service nova] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:59:05.329064 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69fb97-ea62-48a1-a490-eb584022d331 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:59:05.340036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca69fb97-ea62-48a1-a490-eb584022d331 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:59:05.342463 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca69fb97-ea62-48a1-a490-eb584022d331 service nova] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:59:05.354669 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1096/2210] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:59:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:59:11.581885 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92027ce-82b9-480f-a047-88c607905c1f None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:59:11.582463 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92027ce-82b9-480f-a047-88c607905c1f None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:59:11.582463 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92027ce-82b9-480f-a047-88c607905c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:59:11.600922 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-e92027ce-82b9-480f-a047-88c607905c1f None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:59:11.602117 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-e92027ce-82b9-480f-a047-88c607905c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:59:11.611202 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1115/2211] 10.222.0.15 () {58 vars in 1016 bytes} [Mon May 23 15:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:59:11.633816 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69fb97-ea62-48a1-a490-eb584022d331 service nova] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:59:11.646007 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69fb97-ea62-48a1-a490-eb584022d331 service nova] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:59:11.652018 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef37ef-a332-4a13-92ac-4be0a6f36b71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:59:11.652652 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef37ef-a332-4a13-92ac-4be0a6f36b71 service nova] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:59:11.652937 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef37ef-a332-4a13-92ac-4be0a6f36b71 service nova] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:59:11.653213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef37ef-a332-4a13-92ac-4be0a6f36b71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:59:11.662505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef37ef-a332-4a13-92ac-4be0a6f36b71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:59:11.664140 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef37ef-a332-4a13-92ac-4be0a6f36b71 service nova] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:59:11.674318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1097/2212] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:59:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:59:19.456123 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941b2a0-0187-4754-b459-55879a69b606 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:59:19.462756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941b2a0-0187-4754-b459-55879a69b606 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:59:19.462756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941b2a0-0187-4754-b459-55879a69b606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:59:19.462756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=61 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:59:19.507441 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-d941b2a0-0187-4754-b459-55879a69b606 None None] MFA Rules not processed for user `048fc48dd55a43f7b342533a9484c3ad`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:59:19.508680 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-d941b2a0-0187-4754-b459-55879a69b606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:59:19.585321 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1116/2213] 10.222.0.39 () {58 vars in 1009 bytes} [Mon May 23 15:59:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:59:19.638845 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef37ef-a332-4a13-92ac-4be0a6f36b71 service nova] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:59:19.640405 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-4eef37ef-a332-4a13-92ac-4be0a6f36b71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:59:19.644802 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=77 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:59:19.742146 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef37ef-a332-4a13-92ac-4be0a6f36b71 service nova] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:59:19.747357 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5729f-fd25-4673-a779-9f151c1b235c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b275a110936a44ce8d54793af1a34808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:59:19.748032 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5729f-fd25-4673-a779-9f151c1b235c service swift] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:59:19.748315 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5729f-fd25-4673-a779-9f151c1b235c service swift] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:59:19.748588 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5729f-fd25-4673-a779-9f151c1b235c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:59:19.757643 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5729f-fd25-4673-a779-9f151c1b235c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:59:19.759236 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5729f-fd25-4673-a779-9f151c1b235c service swift] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:59:19.768224 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1098/2214] 10.222.0.39 () {60 vars in 1384 bytes} [Mon May 23 15:59:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 23 15:59:29.582297 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=39 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:59:29.764289 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=40 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:59:38.207241 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499e747-d83a-41ce-98a1-b95da301c86c None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:59:38.207884 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499e747-d83a-41ce-98a1-b95da301c86c None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:59:38.207884 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499e747-d83a-41ce-98a1-b95da301c86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:59:38.225978 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-a499e747-d83a-41ce-98a1-b95da301c86c None None] MFA Rules not processed for user `d0db6bbbeb7c498598a284b8965dd962`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:59:38.227176 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-a499e747-d83a-41ce-98a1-b95da301c86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:59:38.285574 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1117/2215] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 15:59:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:59:41.808410 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9de5fc-5eaf-4061-99ef-b0751ee768ef None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:59:41.809549 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9de5fc-5eaf-4061-99ef-b0751ee768ef None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:59:41.809977 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9de5fc-5eaf-4061-99ef-b0751ee768ef None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:59:41.812742 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1099/2216] 10.222.0.39 () {54 vars in 921 bytes} [Mon May 23 15:59:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:59:41.819622 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a51f7-8edf-4ea9-8d2a-82175f7e1940 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:59:41.820195 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a51f7-8edf-4ea9-8d2a-82175f7e1940 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:59:41.820195 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a51f7-8edf-4ea9-8d2a-82175f7e1940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:59:41.859744 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-167a51f7-8edf-4ea9-8d2a-82175f7e1940 None None] MFA Rules not processed for user `76f7895b7b5748e7b4461f7fde1d558a`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:59:41.860818 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-167a51f7-8edf-4ea9-8d2a-82175f7e1940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:59:41.870745 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1118/2217] 10.222.0.39 () {58 vars in 1018 bytes} [Mon May 23 15:59:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:59:41.885552 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9de5fc-5eaf-4061-99ef-b0751ee768ef None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:59:41.887969 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-9d9de5fc-5eaf-4061-99ef-b0751ee768ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:59:41.970176 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9de5fc-5eaf-4061-99ef-b0751ee768ef None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:59:41.974637 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb27469-3454-4d6b-9a2c-0241588b6ad6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd003ff6cc73946da9203c69a167bbfff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:59:41.975518 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb27469-3454-4d6b-9a2c-0241588b6ad6 service glance] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:59:41.975888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb27469-3454-4d6b-9a2c-0241588b6ad6 service glance] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:59:41.976336 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb27469-3454-4d6b-9a2c-0241588b6ad6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:59:41.991582 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb27469-3454-4d6b-9a2c-0241588b6ad6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:59:41.993089 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb27469-3454-4d6b-9a2c-0241588b6ad6 service glance] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:59:42.005969 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1100/2218] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:59:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:59:42.207086 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d257f9-71cc-4565-b605-f158ed8e92a3 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:59:42.207376 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d257f9-71cc-4565-b605-f158ed8e92a3 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:59:42.207717 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d257f9-71cc-4565-b605-f158ed8e92a3 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:59:42.209216 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1119/2219] 10.222.0.39 () {54 vars in 921 bytes} [Mon May 23 15:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:59:42.215437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4990a-baef-48ab-9bca-80fa2f152391 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:59:42.215979 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4990a-baef-48ab-9bca-80fa2f152391 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:59:42.216465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4990a-baef-48ab-9bca-80fa2f152391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:59:42.237353 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-26b4990a-baef-48ab-9bca-80fa2f152391 None None] MFA Rules not processed for user `f831a06a9cf344a2aa068c20a987b6da`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:59:42.238608 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-26b4990a-baef-48ab-9bca-80fa2f152391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:59:42.295254 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1101/2220] 10.222.0.39 () {58 vars in 1018 bytes} [Mon May 23 15:59:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:59:42.313005 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d257f9-71cc-4565-b605-f158ed8e92a3 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:59:42.315232 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-36d257f9-71cc-4565-b605-f158ed8e92a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:59:42.334583 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d257f9-71cc-4565-b605-f158ed8e92a3 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:59:42.334583 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3869dc-00b1-47d4-94c7-a827444b0c05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:59:42.335066 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3869dc-00b1-47d4-94c7-a827444b0c05 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:59:42.335521 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3869dc-00b1-47d4-94c7-a827444b0c05 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:59:42.335992 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3869dc-00b1-47d4-94c7-a827444b0c05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:59:42.345608 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3869dc-00b1-47d4-94c7-a827444b0c05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:59:42.347062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3869dc-00b1-47d4-94c7-a827444b0c05 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:59:42.357306 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1120/2221] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:59:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:59:42.489250 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecfa9c-78d0-47f6-85e3-467e645ffede None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:59:42.489786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecfa9c-78d0-47f6-85e3-467e645ffede None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:59:42.490326 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecfa9c-78d0-47f6-85e3-467e645ffede None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:59:42.492113 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1102/2222] 10.222.0.39 () {54 vars in 921 bytes} [Mon May 23 15:59:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:59:42.500049 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e5aae-7670-4bf7-aa17-062074176045 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:59:42.502403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e5aae-7670-4bf7-aa17-062074176045 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:59:42.503309 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e5aae-7670-4bf7-aa17-062074176045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:59:42.527994 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-450e5aae-7670-4bf7-aa17-062074176045 None None] MFA Rules not processed for user `76f7895b7b5748e7b4461f7fde1d558a`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:59:42.529965 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-450e5aae-7670-4bf7-aa17-062074176045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:59:42.551846 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1121/2223] 10.222.0.39 () {58 vars in 1018 bytes} [Mon May 23 15:59:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:59:42.561533 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecfa9c-78d0-47f6-85e3-467e645ffede None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:59:42.578901 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecfa9c-78d0-47f6-85e3-467e645ffede None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:59:42.585572 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467cce80-62d2-4e12-9c32-cb45cdf9cc82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:59:42.586578 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cce80-62d2-4e12-9c32-cb45cdf9cc82 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:59:42.587006 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cce80-62d2-4e12-9c32-cb45cdf9cc82 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:59:42.587451 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cce80-62d2-4e12-9c32-cb45cdf9cc82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:59:42.602850 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467cce80-62d2-4e12-9c32-cb45cdf9cc82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:59:42.604472 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467cce80-62d2-4e12-9c32-cb45cdf9cc82 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:59:42.618928 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1103/2224] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 15:59:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:59:49.559026 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c05ca7-303d-4e93-86c8-d8e9d2a4e950 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:59:49.559466 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c05ca7-303d-4e93-86c8-d8e9d2a4e950 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:59:49.559654 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c05ca7-303d-4e93-86c8-d8e9d2a4e950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:59:49.577933 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-d3c05ca7-303d-4e93-86c8-d8e9d2a4e950 None None] MFA Rules not processed for user `048fc48dd55a43f7b342533a9484c3ad`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:59:49.579314 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-d3c05ca7-303d-4e93-86c8-d8e9d2a4e950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:59:49.586973 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1122/2225] 10.222.0.39 () {58 vars in 1009 bytes} [Mon May 23 15:59:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:59:49.599492 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467cce80-62d2-4e12-9c32-cb45cdf9cc82 service neutron] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:59:49.611619 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467cce80-62d2-4e12-9c32-cb45cdf9cc82 service neutron] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:59:49.616963 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1393cde-3be4-4615-a97e-18e07bf52d08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b275a110936a44ce8d54793af1a34808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:59:49.617693 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1393cde-3be4-4615-a97e-18e07bf52d08 service swift] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:59:49.618043 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1393cde-3be4-4615-a97e-18e07bf52d08 service swift] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:59:49.618389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1393cde-3be4-4615-a97e-18e07bf52d08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:59:49.627729 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1393cde-3be4-4615-a97e-18e07bf52d08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:59:49.629417 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1393cde-3be4-4615-a97e-18e07bf52d08 service swift] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:59:49.638145 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1104/2226] 10.222.0.39 () {60 vars in 1384 bytes} [Mon May 23 15:59:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 23 15:59:59.572428 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=46 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:59:59.634597 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=61 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:00:17.988052 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b25e9-7752-4ae8-b244-8ef09e16514b None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:00:17.988507 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b25e9-7752-4ae8-b244-8ef09e16514b None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:00:17.988607 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b25e9-7752-4ae8-b244-8ef09e16514b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:00:18.007203 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-5f2b25e9-7752-4ae8-b244-8ef09e16514b None None] MFA Rules not processed for user `048fc48dd55a43f7b342533a9484c3ad`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:00:18.008451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-5f2b25e9-7752-4ae8-b244-8ef09e16514b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:00:18.016003 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1123/2227] 10.222.0.39 () {58 vars in 967 bytes} [Mon May 23 16:00:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:00:18.029039 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1393cde-3be4-4615-a97e-18e07bf52d08 service swift] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:00:18.040003 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1393cde-3be4-4615-a97e-18e07bf52d08 service swift] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:00:18.044974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd877ec-5b3d-4211-bfa3-2cc1fa4db42e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b275a110936a44ce8d54793af1a34808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:00:18.045608 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd877ec-5b3d-4211-bfa3-2cc1fa4db42e service swift] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:00:18.045887 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd877ec-5b3d-4211-bfa3-2cc1fa4db42e service swift] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:00:18.046161 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd877ec-5b3d-4211-bfa3-2cc1fa4db42e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:00:18.054114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd877ec-5b3d-4211-bfa3-2cc1fa4db42e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:00:18.055710 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd877ec-5b3d-4211-bfa3-2cc1fa4db42e service swift] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:00:18.063865 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1105/2228] 10.222.0.39 () {60 vars in 1384 bytes} [Mon May 23 16:00:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 16:00:20.556939 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c25196-f681-44b0-8a5f-54d9deb5800f None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:00:20.557811 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c25196-f681-44b0-8a5f-54d9deb5800f None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:00:20.557920 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c25196-f681-44b0-8a5f-54d9deb5800f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:00:20.577009 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-38c25196-f681-44b0-8a5f-54d9deb5800f None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:00:20.578216 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-38c25196-f681-44b0-8a5f-54d9deb5800f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:00:20.586322 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1124/2229] 10.222.0.15 () {58 vars in 1016 bytes} [Mon May 23 16:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:00:20.613495 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd877ec-5b3d-4211-bfa3-2cc1fa4db42e service swift] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:00:20.626320 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd877ec-5b3d-4211-bfa3-2cc1fa4db42e service swift] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:00:20.633958 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f7c64-b840-48b2-966c-939a67081a89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:00:20.634668 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f7c64-b840-48b2-966c-939a67081a89 service nova] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:00:20.634955 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f7c64-b840-48b2-966c-939a67081a89 service nova] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:00:20.639220 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f7c64-b840-48b2-966c-939a67081a89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:00:20.643849 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f7c64-b840-48b2-966c-939a67081a89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:00:20.645602 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f7c64-b840-48b2-966c-939a67081a89 service nova] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:00:20.655236 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1106/2230] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:00:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:00:26.246835 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2067d1-bf02-44db-adee-c4bc1255133b None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:00:26.247377 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2067d1-bf02-44db-adee-c4bc1255133b None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:00:26.247377 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2067d1-bf02-44db-adee-c4bc1255133b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:00:26.269078 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-ba2067d1-bf02-44db-adee-c4bc1255133b None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:00:26.270344 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-ba2067d1-bf02-44db-adee-c4bc1255133b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:00:26.279339 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1125/2231] 10.222.0.15 () {58 vars in 1016 bytes} [Mon May 23 16:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:00:26.315445 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f7c64-b840-48b2-966c-939a67081a89 service nova] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:00:26.327353 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f7c64-b840-48b2-966c-939a67081a89 service nova] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:00:26.332891 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf0ab5-dd3a-4009-877c-c86890dc17a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:00:26.335550 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf0ab5-dd3a-4009-877c-c86890dc17a4 service nova] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:00:26.335550 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf0ab5-dd3a-4009-877c-c86890dc17a4 service nova] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:00:26.335550 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf0ab5-dd3a-4009-877c-c86890dc17a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:00:26.343725 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf0ab5-dd3a-4009-877c-c86890dc17a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:00:26.345314 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf0ab5-dd3a-4009-877c-c86890dc17a4 service nova] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:00:26.355351 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1107/2232] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:00:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:00:29.904462 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fab4f-ca46-4c40-83aa-9049bb19fed6 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:00:29.904944 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fab4f-ca46-4c40-83aa-9049bb19fed6 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:00:29.905045 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fab4f-ca46-4c40-83aa-9049bb19fed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:00:29.923437 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-3c8fab4f-ca46-4c40-83aa-9049bb19fed6 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:00:29.924651 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-3c8fab4f-ca46-4c40-83aa-9049bb19fed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:00:29.933361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1126/2233] 10.222.0.15 () {58 vars in 1016 bytes} [Mon May 23 16:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:00:29.957961 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf0ab5-dd3a-4009-877c-c86890dc17a4 service nova] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:00:29.970044 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf0ab5-dd3a-4009-877c-c86890dc17a4 service nova] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:00:29.976365 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1726f-bc1d-4bd9-9b90-ba480bd08407 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:00:29.977005 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1726f-bc1d-4bd9-9b90-ba480bd08407 service nova] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:00:29.977294 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1726f-bc1d-4bd9-9b90-ba480bd08407 service nova] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:00:29.977576 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1726f-bc1d-4bd9-9b90-ba480bd08407 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:00:29.985918 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1726f-bc1d-4bd9-9b90-ba480bd08407 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:00:29.987531 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1726f-bc1d-4bd9-9b90-ba480bd08407 service nova] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:00:29.997781 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1108/2234] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:00:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:00:33.042389 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fab4f-ca46-4c40-83aa-9049bb19fed6 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:00:33.044105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-3c8fab4f-ca46-4c40-83aa-9049bb19fed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:00:33.057602 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fab4f-ca46-4c40-83aa-9049bb19fed6 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:00:33.061459 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57924c0-6288-45a1-88f5-9041890769fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:00:33.062135 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57924c0-6288-45a1-88f5-9041890769fd service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:00:33.062419 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57924c0-6288-45a1-88f5-9041890769fd service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:00:33.062689 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57924c0-6288-45a1-88f5-9041890769fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:00:33.064460 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-d57924c0-6288-45a1-88f5-9041890769fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:00:33.078072 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57924c0-6288-45a1-88f5-9041890769fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:00:33.079618 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57924c0-6288-45a1-88f5-9041890769fd service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:00:33.092151 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1127/2235] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:00:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:00:34.268993 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1726f-bc1d-4bd9-9b90-ba480bd08407 service nova] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:00:34.278343 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1726f-bc1d-4bd9-9b90-ba480bd08407 service nova] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:00:34.281886 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18124082-db73-475e-a65a-b855cf6c793f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:00:34.282516 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18124082-db73-475e-a65a-b855cf6c793f service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:00:34.282797 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18124082-db73-475e-a65a-b855cf6c793f service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:00:34.283172 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18124082-db73-475e-a65a-b855cf6c793f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:00:34.284877 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-18124082-db73-475e-a65a-b855cf6c793f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:00:34.298532 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18124082-db73-475e-a65a-b855cf6c793f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:00:34.300015 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18124082-db73-475e-a65a-b855cf6c793f service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:00:34.312343 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1109/2236] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:00:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:00:35.216144 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412b1dc-2a57-4e2b-be88-5c6cad25445a None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:00:35.216144 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412b1dc-2a57-4e2b-be88-5c6cad25445a None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:00:35.216144 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412b1dc-2a57-4e2b-be88-5c6cad25445a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:00:35.234575 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-7412b1dc-2a57-4e2b-be88-5c6cad25445a None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:00:35.235825 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-7412b1dc-2a57-4e2b-be88-5c6cad25445a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:00:35.248952 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1128/2237] 10.222.0.15 () {58 vars in 1016 bytes} [Mon May 23 16:00:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:00:35.276896 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18124082-db73-475e-a65a-b855cf6c793f service neutron] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:00:35.287957 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18124082-db73-475e-a65a-b855cf6c793f service neutron] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:00:35.293503 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e6e2b-22ca-4487-a0d9-0f1893776845 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:00:35.294155 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e6e2b-22ca-4487-a0d9-0f1893776845 service nova] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:00:35.294432 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e6e2b-22ca-4487-a0d9-0f1893776845 service nova] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:00:35.294703 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e6e2b-22ca-4487-a0d9-0f1893776845 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:00:35.302988 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e6e2b-22ca-4487-a0d9-0f1893776845 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:00:35.304645 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e6e2b-22ca-4487-a0d9-0f1893776845 service nova] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:00:35.314583 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1110/2238] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:00:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:00:40.273948 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767efb7-49d7-4452-81ab-b4ae512522b3 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:00:40.279407 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767efb7-49d7-4452-81ab-b4ae512522b3 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:00:40.279407 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767efb7-49d7-4452-81ab-b4ae512522b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:00:40.280451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=22 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:00:40.293425 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-4767efb7-49d7-4452-81ab-b4ae512522b3 None None] MFA Rules not processed for user `5c6b6d56a8b94fcb9eecc4d3167cd8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:00:40.294648 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-4767efb7-49d7-4452-81ab-b4ae512522b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:00:40.349925 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1129/2239] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:00:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:00:41.498919 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc3f38-a478-4ef9-a14f-bd0ff062dc38 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:00:41.499457 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc3f38-a478-4ef9-a14f-bd0ff062dc38 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:00:41.499457 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc3f38-a478-4ef9-a14f-bd0ff062dc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:00:41.505789 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=37 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:00:41.518303 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-64cc3f38-a478-4ef9-a14f-bd0ff062dc38 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:00:41.521958 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-64cc3f38-a478-4ef9-a14f-bd0ff062dc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:00:41.527351 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1111/2240] 10.222.0.15 () {58 vars in 1016 bytes} [Mon May 23 16:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:00:41.551657 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767efb7-49d7-4452-81ab-b4ae512522b3 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:00:41.565603 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767efb7-49d7-4452-81ab-b4ae512522b3 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:00:41.571086 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda84cd3-cf15-4d71-9c99-1a6271e7daaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:00:41.571761 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda84cd3-cf15-4d71-9c99-1a6271e7daaf service nova] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:00:41.572056 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda84cd3-cf15-4d71-9c99-1a6271e7daaf service nova] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:00:41.572335 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda84cd3-cf15-4d71-9c99-1a6271e7daaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:00:41.581963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda84cd3-cf15-4d71-9c99-1a6271e7daaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:00:41.583686 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda84cd3-cf15-4d71-9c99-1a6271e7daaf service nova] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:00:41.593779 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1130/2241] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:00:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:00:50.990603 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc3f38-a478-4ef9-a14f-bd0ff062dc38 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:00:51.000582 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc3f38-a478-4ef9-a14f-bd0ff062dc38 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:00:51.008910 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ed8fd-83ea-4046-80b4-e58235e439ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:00:51.008910 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ed8fd-83ea-4046-80b4-e58235e439ae service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:00:51.008910 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ed8fd-83ea-4046-80b4-e58235e439ae service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:00:51.008910 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ed8fd-83ea-4046-80b4-e58235e439ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:00:51.009386 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-b75ed8fd-83ea-4046-80b4-e58235e439ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:00:51.018269 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ed8fd-83ea-4046-80b4-e58235e439ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:00:51.019924 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ed8fd-83ea-4046-80b4-e58235e439ae service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:00:51.028590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1112/2242] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:00:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:00:51.588960 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=30 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:00:59.899547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda84cd3-cf15-4d71-9c99-1a6271e7daaf service nova] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:00:59.911516 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda84cd3-cf15-4d71-9c99-1a6271e7daaf service nova] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:00:59.916992 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a135c40-36c1-4db5-8f27-e77a5a45fa1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:00:59.917632 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a135c40-36c1-4db5-8f27-e77a5a45fa1f service nova] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:00:59.917920 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a135c40-36c1-4db5-8f27-e77a5a45fa1f service nova] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:00:59.918201 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a135c40-36c1-4db5-8f27-e77a5a45fa1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:00:59.920002 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-7a135c40-36c1-4db5-8f27-e77a5a45fa1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:00:59.979417 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a135c40-36c1-4db5-8f27-e77a5a45fa1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:00:59.981049 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a135c40-36c1-4db5-8f27-e77a5a45fa1f service nova] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:00:59.990963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1131/2243] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:00:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:01:01.025052 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=8 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:01:09.985833 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=28 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:01:13.363058 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ed8fd-83ea-4046-80b4-e58235e439ae service neutron] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:01:13.377238 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ed8fd-83ea-4046-80b4-e58235e439ae service neutron] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:01:13.397759 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e7e1e-58a4-4648-aaee-c749374ec5b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:01:13.398477 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e7e1e-58a4-4648-aaee-c749374ec5b8 service nova] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:13.398816 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e7e1e-58a4-4648-aaee-c749374ec5b8 service nova] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:13.399094 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e7e1e-58a4-4648-aaee-c749374ec5b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:13.400921 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-a52e7e1e-58a4-4648-aaee-c749374ec5b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:01:13.412968 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e7e1e-58a4-4648-aaee-c749374ec5b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:01:13.414553 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e7e1e-58a4-4648-aaee-c749374ec5b8 service nova] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:01:13.423735 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1113/2244] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:01:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:01:17.076461 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a135c40-36c1-4db5-8f27-e77a5a45fa1f service nova] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:01:17.090590 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a135c40-36c1-4db5-8f27-e77a5a45fa1f service nova] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:01:17.097060 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664b2f0-b4ff-4c34-9035-ea78a913d793 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:01:17.098114 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664b2f0-b4ff-4c34-9035-ea78a913d793 service nova] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:17.098545 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664b2f0-b4ff-4c34-9035-ea78a913d793 service nova] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:17.098913 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664b2f0-b4ff-4c34-9035-ea78a913d793 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:17.100842 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-f664b2f0-b4ff-4c34-9035-ea78a913d793 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:01:17.115419 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664b2f0-b4ff-4c34-9035-ea78a913d793 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:01:17.117180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664b2f0-b4ff-4c34-9035-ea78a913d793 service nova] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:01:17.130123 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1132/2245] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:01:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:01:22.873611 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e7e1e-58a4-4648-aaee-c749374ec5b8 service nova] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:01:22.875044 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-a52e7e1e-58a4-4648-aaee-c749374ec5b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:01:22.895125 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e7e1e-58a4-4648-aaee-c749374ec5b8 service nova] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:01:22.902028 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484a008-117e-4da8-998d-ce996f54e3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:01:22.902767 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484a008-117e-4da8-998d-ce996f54e3d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:22.903190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484a008-117e-4da8-998d-ce996f54e3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:22.903479 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484a008-117e-4da8-998d-ce996f54e3d3 admin admin] PATH_INFO: `/v3/users/d0db6bbbeb7c498598a284b8965dd962` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:22.904758 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c484a008-117e-4da8-998d-ce996f54e3d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0db6bbbeb7c498598a284b8965dd962)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:01:22.906784 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c484a008-117e-4da8-998d-ce996f54e3d3 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:01:23.109371 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-c484a008-117e-4da8-998d-ce996f54e3d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0db6bbbeb7c498598a284b8965dd962'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:01:23.116279 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-c484a008-117e-4da8-998d-ce996f54e3d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0db6bbbeb7c498598a284b8965dd962'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:01:23.116954 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-c484a008-117e-4da8-998d-ce996f54e3d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0db6bbbeb7c498598a284b8965dd962'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:01:23.128805 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-c484a008-117e-4da8-998d-ce996f54e3d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0db6bbbeb7c498598a284b8965dd962'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:01:23.216645 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-c484a008-117e-4da8-998d-ce996f54e3d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0db6bbbeb7c498598a284b8965dd962'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:01:23.223438 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1114/2246] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:01:22 2022] DELETE /identity/v3/users/d0db6bbbeb7c498598a284b8965dd962 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:01:23.473959 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664b2f0-b4ff-4c34-9035-ea78a913d793 service nova] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:01:23.485266 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664b2f0-b4ff-4c34-9035-ea78a913d793 service nova] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:01:23.543338 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae95f1-f28e-405f-866c-ffd5a00313b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:01:23.544218 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae95f1-f28e-405f-866c-ffd5a00313b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:23.544500 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae95f1-f28e-405f-866c-ffd5a00313b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:23.544784 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae95f1-f28e-405f-866c-ffd5a00313b4 admin admin] PATH_INFO: `/v3/projects/dd0b90acd942410288c43857a789c2c5` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:23.546001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae95f1-f28e-405f-866c-ffd5a00313b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd0b90acd942410288c43857a789c2c5)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:01:23.547932 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae95f1-f28e-405f-866c-ffd5a00313b4 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:01:23.665444 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-39ae95f1-f28e-405f-866c-ffd5a00313b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd0b90acd942410288c43857a789c2c5', 'request_id': 'req-39ae95f1-f28e-405f-866c-ffd5a00313b4'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:01:23.672439 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-39ae95f1-f28e-405f-866c-ffd5a00313b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd0b90acd942410288c43857a789c2c5', 'request_id': 'req-39ae95f1-f28e-405f-866c-ffd5a00313b4'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:01:23.727126 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-39ae95f1-f28e-405f-866c-ffd5a00313b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd0b90acd942410288c43857a789c2c5', 'request_id': 'req-39ae95f1-f28e-405f-866c-ffd5a00313b4'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:01:23.738386 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-39ae95f1-f28e-405f-866c-ffd5a00313b4 admin admin] The token cache is being invalidate because project dd0b90acd942410288c43857a789c2c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:01:23.738670 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-39ae95f1-f28e-405f-866c-ffd5a00313b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:01:23.739289 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-39ae95f1-f28e-405f-866c-ffd5a00313b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:01:23.740844 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1133/2247] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:01:23 2022] DELETE /identity/v3/projects/dd0b90acd942410288c43857a789c2c5 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:01:30.157951 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484a008-117e-4da8-998d-ce996f54e3d3 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:01:30.161272 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-c484a008-117e-4da8-998d-ce996f54e3d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:01:30.291241 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484a008-117e-4da8-998d-ce996f54e3d3 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:01:30.367783 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:01:30.382960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4566855-feb3-42ff-bfe0-51c4263f9a22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:01:30.383914 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4566855-feb3-42ff-bfe0-51c4263f9a22 service nova] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:30.384258 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4566855-feb3-42ff-bfe0-51c4263f9a22 service nova] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:30.384504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4566855-feb3-42ff-bfe0-51c4263f9a22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:30.386669 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-a4566855-feb3-42ff-bfe0-51c4263f9a22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:01:30.407220 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4566855-feb3-42ff-bfe0-51c4263f9a22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:01:30.407220 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4566855-feb3-42ff-bfe0-51c4263f9a22 service nova] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:01:30.418807 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1115/2248] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:01:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:01:31.457668 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e8ee5-4063-42a0-96bb-e575b5ab1790 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:31.458255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e8ee5-4063-42a0-96bb-e575b5ab1790 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:31.458453 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e8ee5-4063-42a0-96bb-e575b5ab1790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:31.476885 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-5b2e8ee5-4063-42a0-96bb-e575b5ab1790 None None] MFA Rules not processed for user `ce2a9dc6fbae42dfbfa4cb8b326c3de5`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:01:31.480244 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-5b2e8ee5-4063-42a0-96bb-e575b5ab1790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:01:31.547741 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1134/2249] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:01:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:01:31.880243 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4566855-feb3-42ff-bfe0-51c4263f9a22 service nova] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:01:31.881668 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-a4566855-feb3-42ff-bfe0-51c4263f9a22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:01:31.940196 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4566855-feb3-42ff-bfe0-51c4263f9a22 service nova] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:01:31.943978 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df4ce9-9ee7-425f-bec8-5cd99ae7be98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:01:31.944616 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df4ce9-9ee7-425f-bec8-5cd99ae7be98 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:31.944898 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df4ce9-9ee7-425f-bec8-5cd99ae7be98 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:31.945197 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df4ce9-9ee7-425f-bec8-5cd99ae7be98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:31.946955 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-48df4ce9-9ee7-425f-bec8-5cd99ae7be98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:01:31.957711 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df4ce9-9ee7-425f-bec8-5cd99ae7be98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:01:31.959143 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df4ce9-9ee7-425f-bec8-5cd99ae7be98 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:01:31.967437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1116/2250] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:01:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:01:32.355774 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e8ee5-4063-42a0-96bb-e575b5ab1790 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:01:32.357281 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-5b2e8ee5-4063-42a0-96bb-e575b5ab1790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:01:32.383752 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:01:32.429814 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e8ee5-4063-42a0-96bb-e575b5ab1790 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:01:32.435142 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d99ea15-5e6e-4d6f-80b0-01f9ff4ddd03 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f06d35d7cc48658262bf79d9c72280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:01:32.442222 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99ea15-5e6e-4d6f-80b0-01f9ff4ddd03 service placement] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:32.442222 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99ea15-5e6e-4d6f-80b0-01f9ff4ddd03 service placement] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:32.442222 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99ea15-5e6e-4d6f-80b0-01f9ff4ddd03 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:32.442222 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-0d99ea15-5e6e-4d6f-80b0-01f9ff4ddd03 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:01:32.449567 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d99ea15-5e6e-4d6f-80b0-01f9ff4ddd03 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:01:32.451153 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d99ea15-5e6e-4d6f-80b0-01f9ff4ddd03 service placement] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:01:32.461490 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1135/2251] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:01:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:01:37.158298 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df4ce9-9ee7-425f-bec8-5cd99ae7be98 service neutron] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:01:37.161206 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d99ea15-5e6e-4d6f-80b0-01f9ff4ddd03 service placement] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:01:37.168021 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df4ce9-9ee7-425f-bec8-5cd99ae7be98 service neutron] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:01:37.171840 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d99ea15-5e6e-4d6f-80b0-01f9ff4ddd03 service placement] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:01:37.173460 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797644a-e1cc-4bd3-9ece-cdb11bdb8538 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:01:37.174136 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797644a-e1cc-4bd3-9ece-cdb11bdb8538 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:37.174379 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797644a-e1cc-4bd3-9ece-cdb11bdb8538 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:37.175061 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797644a-e1cc-4bd3-9ece-cdb11bdb8538 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:37.176043 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d3c9c-67da-474e-a16f-582c19b79163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:01:37.176732 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-a797644a-e1cc-4bd3-9ece-cdb11bdb8538 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:01:37.177192 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d3c9c-67da-474e-a16f-582c19b79163 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:37.177677 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d3c9c-67da-474e-a16f-582c19b79163 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:37.178176 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d3c9c-67da-474e-a16f-582c19b79163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:37.180167 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-3a2d3c9c-67da-474e-a16f-582c19b79163 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:01:37.255238 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797644a-e1cc-4bd3-9ece-cdb11bdb8538 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:01:37.256764 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797644a-e1cc-4bd3-9ece-cdb11bdb8538 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:01:37.258456 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d3c9c-67da-474e-a16f-582c19b79163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:01:37.259955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d3c9c-67da-474e-a16f-582c19b79163 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:01:37.268169 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1117/2252] 10.222.0.39 () {60 vars in 1396 bytes} [Mon May 23 16:01:37 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:01:37.270394 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1136/2253] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:01:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:01:39.662226 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cf8b4-a439-484a-a710-a95198933d96 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:39.662687 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cf8b4-a439-484a-a710-a95198933d96 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:39.662800 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cf8b4-a439-484a-a710-a95198933d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:39.680413 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-d22cf8b4-a439-484a-a710-a95198933d96 None None] MFA Rules not processed for user `048fc48dd55a43f7b342533a9484c3ad`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:01:39.681894 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-d22cf8b4-a439-484a-a710-a95198933d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:01:39.741848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1118/2254] 10.222.0.39 () {58 vars in 967 bytes} [Mon May 23 16:01:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:01:39.836876 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d3c9c-67da-474e-a16f-582c19b79163 service neutron] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:01:39.838745 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-3a2d3c9c-67da-474e-a16f-582c19b79163 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:01:39.854853 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d3c9c-67da-474e-a16f-582c19b79163 service neutron] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:01:39.860440 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2703a6c-977e-4b94-b55a-eecc7fff01dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:01:39.861081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2703a6c-977e-4b94-b55a-eecc7fff01dd service nova] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:39.861364 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2703a6c-977e-4b94-b55a-eecc7fff01dd service nova] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:39.861650 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2703a6c-977e-4b94-b55a-eecc7fff01dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:39.863349 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-f2703a6c-977e-4b94-b55a-eecc7fff01dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:01:39.880594 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22cf8b4-a439-484a-a710-a95198933d96 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:01:39.881964 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-d22cf8b4-a439-484a-a710-a95198933d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:01:39.914478 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:01:39.923561 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2703a6c-977e-4b94-b55a-eecc7fff01dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:01:39.925224 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2703a6c-977e-4b94-b55a-eecc7fff01dd service nova] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:01:39.936996 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1137/2255] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:01:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:01:39.959169 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22cf8b4-a439-484a-a710-a95198933d96 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:01:39.964296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe180914-6905-458a-a854-b6c03cb88d01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b275a110936a44ce8d54793af1a34808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:01:39.965010 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe180914-6905-458a-a854-b6c03cb88d01 service swift] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:39.965293 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe180914-6905-458a-a854-b6c03cb88d01 service swift] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:39.965570 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe180914-6905-458a-a854-b6c03cb88d01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:39.974374 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe180914-6905-458a-a854-b6c03cb88d01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:01:39.975989 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe180914-6905-458a-a854-b6c03cb88d01 service swift] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:01:39.984496 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1119/2256] 10.222.0.39 () {60 vars in 1384 bytes} [Mon May 23 16:01:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 23 16:01:40.975068 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2703a6c-977e-4b94-b55a-eecc7fff01dd service nova] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:01:40.976581 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-f2703a6c-977e-4b94-b55a-eecc7fff01dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:01:40.988062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2703a6c-977e-4b94-b55a-eecc7fff01dd service nova] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:01:40.991527 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5687b-c6f1-4fd2-80ac-5df28e3f0521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:01:40.992196 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5687b-c6f1-4fd2-80ac-5df28e3f0521 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:40.992480 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5687b-c6f1-4fd2-80ac-5df28e3f0521 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:40.992756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5687b-c6f1-4fd2-80ac-5df28e3f0521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:40.994650 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-dbc5687b-c6f1-4fd2-80ac-5df28e3f0521 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:01:41.040555 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:01:41.058242 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5687b-c6f1-4fd2-80ac-5df28e3f0521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:01:41.059726 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5687b-c6f1-4fd2-80ac-5df28e3f0521 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:01:41.069551 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1138/2257] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:01:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:01:45.710826 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe180914-6905-458a-a854-b6c03cb88d01 service swift] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:01:45.712838 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-fe180914-6905-458a-a854-b6c03cb88d01 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:01:45.729340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe180914-6905-458a-a854-b6c03cb88d01 service swift] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:01:45.734985 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb04c41-2648-49fe-8635-a4adc21fe359 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:01:45.735686 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb04c41-2648-49fe-8635-a4adc21fe359 service nova] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:45.735973 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb04c41-2648-49fe-8635-a4adc21fe359 service nova] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:45.736247 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb04c41-2648-49fe-8635-a4adc21fe359 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:45.738047 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-bcb04c41-2648-49fe-8635-a4adc21fe359 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:01:45.751101 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb04c41-2648-49fe-8635-a4adc21fe359 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:01:45.752731 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb04c41-2648-49fe-8635-a4adc21fe359 service nova] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:01:45.768110 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1120/2258] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:01:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:01:49.782272 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5687b-c6f1-4fd2-80ac-5df28e3f0521 service neutron] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:01:49.801702 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5687b-c6f1-4fd2-80ac-5df28e3f0521 service neutron] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:01:49.818698 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518fc62-83d9-446d-83ea-a5df34fd4c5f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f06d35d7cc48658262bf79d9c72280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:01:49.819495 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518fc62-83d9-446d-83ea-a5df34fd4c5f service placement] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:49.820536 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518fc62-83d9-446d-83ea-a5df34fd4c5f service placement] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:49.824021 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518fc62-83d9-446d-83ea-a5df34fd4c5f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:49.824769 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-a518fc62-83d9-446d-83ea-a5df34fd4c5f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:01:49.839398 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518fc62-83d9-446d-83ea-a5df34fd4c5f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:01:49.841144 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518fc62-83d9-446d-83ea-a5df34fd4c5f service placement] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:01:49.856237 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1139/2259] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:01:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:01:49.924222 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb04c41-2648-49fe-8635-a4adc21fe359 service nova] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:01:49.930881 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-bcb04c41-2648-49fe-8635-a4adc21fe359 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:01:49.964582 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb04c41-2648-49fe-8635-a4adc21fe359 service nova] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:01:49.971116 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa011de-9c86-4e3d-a79f-49f06ac9f979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:01:49.972044 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa011de-9c86-4e3d-a79f-49f06ac9f979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:49.972348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa011de-9c86-4e3d-a79f-49f06ac9f979 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:49.972631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa011de-9c86-4e3d-a79f-49f06ac9f979 admin admin] PATH_INFO: `/v3/users/c951fd797a694516ac54a92d26421389` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:49.973972 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa011de-9c86-4e3d-a79f-49f06ac9f979 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c951fd797a694516ac54a92d26421389)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:01:49.976680 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa011de-9c86-4e3d-a79f-49f06ac9f979 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:01:50.221530 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-0aa011de-9c86-4e3d-a79f-49f06ac9f979 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c951fd797a694516ac54a92d26421389'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:01:50.231164 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-0aa011de-9c86-4e3d-a79f-49f06ac9f979 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c951fd797a694516ac54a92d26421389'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:01:50.232335 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-0aa011de-9c86-4e3d-a79f-49f06ac9f979 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c951fd797a694516ac54a92d26421389'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:01:50.248110 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-0aa011de-9c86-4e3d-a79f-49f06ac9f979 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c951fd797a694516ac54a92d26421389'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:01:50.327256 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-0aa011de-9c86-4e3d-a79f-49f06ac9f979 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c951fd797a694516ac54a92d26421389'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:01:50.337934 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1121/2260] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:01:49 2022] DELETE /identity/v3/users/c951fd797a694516ac54a92d26421389 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:01:50.600485 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518fc62-83d9-446d-83ea-a5df34fd4c5f service placement] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:01:50.613461 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518fc62-83d9-446d-83ea-a5df34fd4c5f service placement] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:01:50.707022 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b31b40e-3065-4fa3-b422-fed78841c951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:01:50.708051 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31b40e-3065-4fa3-b422-fed78841c951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:50.709716 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31b40e-3065-4fa3-b422-fed78841c951 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:50.709716 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31b40e-3065-4fa3-b422-fed78841c951 admin admin] PATH_INFO: `/v3/projects/a96b5fba4c3844da9389e23f016c1479` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:50.711847 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b31b40e-3065-4fa3-b422-fed78841c951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a96b5fba4c3844da9389e23f016c1479)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:01:50.714231 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b31b40e-3065-4fa3-b422-fed78841c951 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:01:50.892324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-4b31b40e-3065-4fa3-b422-fed78841c951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a96b5fba4c3844da9389e23f016c1479', 'request_id': 'req-4b31b40e-3065-4fa3-b422-fed78841c951'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:01:50.901416 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-4b31b40e-3065-4fa3-b422-fed78841c951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a96b5fba4c3844da9389e23f016c1479', 'request_id': 'req-4b31b40e-3065-4fa3-b422-fed78841c951'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:01:50.998413 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-4b31b40e-3065-4fa3-b422-fed78841c951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a96b5fba4c3844da9389e23f016c1479', 'request_id': 'req-4b31b40e-3065-4fa3-b422-fed78841c951'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:01:51.011761 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-4b31b40e-3065-4fa3-b422-fed78841c951 admin admin] The token cache is being invalidate because project a96b5fba4c3844da9389e23f016c1479 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:01:51.012357 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-4b31b40e-3065-4fa3-b422-fed78841c951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:01:51.013079 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-4b31b40e-3065-4fa3-b422-fed78841c951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:01:51.015350 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1140/2261] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:01:50 2022] DELETE /identity/v3/projects/a96b5fba4c3844da9389e23f016c1479 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:01:51.019581 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa011de-9c86-4e3d-a79f-49f06ac9f979 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:01:51.021194 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-0aa011de-9c86-4e3d-a79f-49f06ac9f979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:01:51.038228 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa011de-9c86-4e3d-a79f-49f06ac9f979 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:01:51.106909 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091b5f0-8526-42c5-b050-af2e0b68750a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:01:51.108065 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091b5f0-8526-42c5-b050-af2e0b68750a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:51.108351 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091b5f0-8526-42c5-b050-af2e0b68750a admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:51.108621 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091b5f0-8526-42c5-b050-af2e0b68750a admin admin] PATH_INFO: `/v3/users/343e1424c43543218f790516acc3976a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:51.109854 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5091b5f0-8526-42c5-b050-af2e0b68750a admin admin] RBAC: Authorizing `identity:delete_user(user_id=343e1424c43543218f790516acc3976a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:01:51.111825 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5091b5f0-8526-42c5-b050-af2e0b68750a admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:01:51.139190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:01:51.379207 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-5091b5f0-8526-42c5-b050-af2e0b68750a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '343e1424c43543218f790516acc3976a'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:01:51.387262 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-5091b5f0-8526-42c5-b050-af2e0b68750a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '343e1424c43543218f790516acc3976a'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:01:51.387995 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-5091b5f0-8526-42c5-b050-af2e0b68750a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '343e1424c43543218f790516acc3976a'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:01:51.400598 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-5091b5f0-8526-42c5-b050-af2e0b68750a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '343e1424c43543218f790516acc3976a'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:01:51.479523 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-5091b5f0-8526-42c5-b050-af2e0b68750a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '343e1424c43543218f790516acc3976a'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:01:51.486493 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1122/2262] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:01:51 2022] DELETE /identity/v3/users/343e1424c43543218f790516acc3976a => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:01:51.767907 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b31b40e-3065-4fa3-b422-fed78841c951 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:01:51.770144 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-4b31b40e-3065-4fa3-b422-fed78841c951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:01:51.784359 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b31b40e-3065-4fa3-b422-fed78841c951 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:01:51.846663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eab5ad-b41f-407b-8ed6-f984dfbf3459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:01:51.847452 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eab5ad-b41f-407b-8ed6-f984dfbf3459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:51.847797 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eab5ad-b41f-407b-8ed6-f984dfbf3459 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:51.848071 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eab5ad-b41f-407b-8ed6-f984dfbf3459 admin admin] PATH_INFO: `/v3/projects/55a7c00510cc4ef680e6e9fa775cc10e` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:51.849275 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eab5ad-b41f-407b-8ed6-f984dfbf3459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55a7c00510cc4ef680e6e9fa775cc10e)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:01:51.851236 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eab5ad-b41f-407b-8ed6-f984dfbf3459 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:01:51.852803 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:01:51.961808 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-70eab5ad-b41f-407b-8ed6-f984dfbf3459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55a7c00510cc4ef680e6e9fa775cc10e', 'request_id': 'req-70eab5ad-b41f-407b-8ed6-f984dfbf3459'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:01:51.968013 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-70eab5ad-b41f-407b-8ed6-f984dfbf3459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55a7c00510cc4ef680e6e9fa775cc10e', 'request_id': 'req-70eab5ad-b41f-407b-8ed6-f984dfbf3459'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:01:52.059570 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-70eab5ad-b41f-407b-8ed6-f984dfbf3459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55a7c00510cc4ef680e6e9fa775cc10e', 'request_id': 'req-70eab5ad-b41f-407b-8ed6-f984dfbf3459'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:01:52.071494 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-70eab5ad-b41f-407b-8ed6-f984dfbf3459 admin admin] The token cache is being invalidate because project 55a7c00510cc4ef680e6e9fa775cc10e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:01:52.071842 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-70eab5ad-b41f-407b-8ed6-f984dfbf3459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:01:52.073163 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-70eab5ad-b41f-407b-8ed6-f984dfbf3459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:01:52.074935 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1141/2263] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:01:51 2022] DELETE /identity/v3/projects/55a7c00510cc4ef680e6e9fa775cc10e => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:01:52.079909 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380ed4f-03b6-49e7-9b01-65a14a3edeee None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:52.080388 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380ed4f-03b6-49e7-9b01-65a14a3edeee None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:52.080586 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380ed4f-03b6-49e7-9b01-65a14a3edeee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:52.101375 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-2380ed4f-03b6-49e7-9b01-65a14a3edeee None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:01:52.102523 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-2380ed4f-03b6-49e7-9b01-65a14a3edeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:01:52.163475 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1123/2264] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:01:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:01:52.172409 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa737245-7353-4302-9d2f-c3039324886b None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:52.172987 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa737245-7353-4302-9d2f-c3039324886b None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:52.173479 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa737245-7353-4302-9d2f-c3039324886b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:52.193342 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-fa737245-7353-4302-9d2f-c3039324886b None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:01:52.194553 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-fa737245-7353-4302-9d2f-c3039324886b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:01:52.203536 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1142/2265] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:01:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:01:52.208019 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380ed4f-03b6-49e7-9b01-65a14a3edeee None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:01:52.217881 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380ed4f-03b6-49e7-9b01-65a14a3edeee None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:01:52.222423 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cec2ff-aea1-4332-b2a5-523c0e947150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:01:52.223076 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cec2ff-aea1-4332-b2a5-523c0e947150 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:52.223355 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cec2ff-aea1-4332-b2a5-523c0e947150 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:52.223663 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cec2ff-aea1-4332-b2a5-523c0e947150 admin admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:52.224412 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cec2ff-aea1-4332-b2a5-523c0e947150 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:01:52.224721 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cec2ff-aea1-4332-b2a5-523c0e947150 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:01:52.226351 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cec2ff-aea1-4332-b2a5-523c0e947150 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:01:52.240346 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1124/2266] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 16:01:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:01:52.245671 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa737245-7353-4302-9d2f-c3039324886b None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:01:52.257095 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa737245-7353-4302-9d2f-c3039324886b None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:01:52.262734 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9162b8-fcf0-4951-8315-b66a89676324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:01:52.263407 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9162b8-fcf0-4951-8315-b66a89676324 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:52.263738 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9162b8-fcf0-4951-8315-b66a89676324 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:52.264024 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9162b8-fcf0-4951-8315-b66a89676324 admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:52.264743 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9162b8-fcf0-4951-8315-b66a89676324 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:01:52.266721 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9162b8-fcf0-4951-8315-b66a89676324 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:01:52.355400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1143/2267] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:01:52 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:01:52.359540 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cec2ff-aea1-4332-b2a5-523c0e947150 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:01:52.370228 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cec2ff-aea1-4332-b2a5-523c0e947150 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:01:52.428892 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4820f-6782-4195-a0fb-867fed4334f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:01:52.429735 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4820f-6782-4195-a0fb-867fed4334f6 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:52.429896 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4820f-6782-4195-a0fb-867fed4334f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:52.430425 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4820f-6782-4195-a0fb-867fed4334f6 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:52.431206 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f4820f-6782-4195-a0fb-867fed4334f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:01:52.433922 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f4820f-6782-4195-a0fb-867fed4334f6 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:01:52.578929 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1125/2268] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:01:52 2022] POST /identity/v3/users => generated 286 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:01:52.581046 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9162b8-fcf0-4951-8315-b66a89676324 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:01:52.592125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9162b8-fcf0-4951-8315-b66a89676324 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:01:52.596943 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7271c-08c1-4b02-b8ba-3043535f620c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:01:52.597651 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7271c-08c1-4b02-b8ba-3043535f620c admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:52.597935 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7271c-08c1-4b02-b8ba-3043535f620c admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:52.598213 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7271c-08c1-4b02-b8ba-3043535f620c admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:52.598945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7271c-08c1-4b02-b8ba-3043535f620c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:01:52.600614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7271c-08c1-4b02-b8ba-3043535f620c admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:01:52.611583 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1144/2269] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:01:52.615738 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4820f-6782-4195-a0fb-867fed4334f6 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:01:52.626124 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4820f-6782-4195-a0fb-867fed4334f6 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:01:52.630799 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af671d6d-9563-41fd-a4f4-eba7be9d0fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:01:52.631451 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af671d6d-9563-41fd-a4f4-eba7be9d0fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:52.631776 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af671d6d-9563-41fd-a4f4-eba7be9d0fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:52.632056 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af671d6d-9563-41fd-a4f4-eba7be9d0fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:52.632802 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af671d6d-9563-41fd-a4f4-eba7be9d0fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:01:52.634484 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af671d6d-9563-41fd-a4f4-eba7be9d0fd7 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:01:52.644845 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1126/2270] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:01:52.648987 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7271c-08c1-4b02-b8ba-3043535f620c admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:01:52.659920 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7271c-08c1-4b02-b8ba-3043535f620c admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:01:52.664633 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d81bf-6cbf-497f-a533-9b65a848b50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:01:52.665522 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d81bf-6cbf-497f-a533-9b65a848b50b admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:52.666431 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d81bf-6cbf-497f-a533-9b65a848b50b admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:52.666707 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d81bf-6cbf-497f-a533-9b65a848b50b admin admin] PATH_INFO: `/v3/projects/c5b06f17eb584370bb4771cb7c7b69d5/users/1d4c1a9323564133817374393d52fba4/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:52.682143 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d81bf-6cbf-497f-a533-9b65a848b50b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5b06f17eb584370bb4771cb7c7b69d5, user_id=1d4c1a9323564133817374393d52fba4, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:01:52.684932 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d81bf-6cbf-497f-a533-9b65a848b50b admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:01:52.761912 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1145/2271] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:01:52 2022] PUT /identity/v3/projects/c5b06f17eb584370bb4771cb7c7b69d5/users/1d4c1a9323564133817374393d52fba4/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:01:52.767471 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9b49f-8238-4413-97af-4e7fdb823e2e None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:52.767793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9b49f-8238-4413-97af-4e7fdb823e2e None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:52.768076 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9b49f-8238-4413-97af-4e7fdb823e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:52.774620 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:01:52.788643 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-3ab9b49f-8238-4413-97af-4e7fdb823e2e None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:01:52.789821 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-3ab9b49f-8238-4413-97af-4e7fdb823e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:01:52.853249 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1127/2272] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:01:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:01:52.867364 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d81bf-6cbf-497f-a533-9b65a848b50b admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:01:52.867364 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-ef3d81bf-6cbf-497f-a533-9b65a848b50b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:01:52.924773 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d81bf-6cbf-497f-a533-9b65a848b50b admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:01:52.928646 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6303b9-a7ce-4ca1-8840-d082475d150e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:01:52.929299 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6303b9-a7ce-4ca1-8840-d082475d150e service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:52.929587 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6303b9-a7ce-4ca1-8840-d082475d150e service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:52.929880 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6303b9-a7ce-4ca1-8840-d082475d150e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:52.939648 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6303b9-a7ce-4ca1-8840-d082475d150e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:01:52.941125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6303b9-a7ce-4ca1-8840-d082475d150e service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:01:52.951251 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1146/2273] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:01:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:01:54.111788 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d08703-afa5-443c-893e-37dae9f873c7 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:54.112310 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d08703-afa5-443c-893e-37dae9f873c7 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:54.112426 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d08703-afa5-443c-893e-37dae9f873c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:54.131284 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-c8d08703-afa5-443c-893e-37dae9f873c7 None None] MFA Rules not processed for user `261e4ebfb0504a21b6c54e05c0b8378f`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:01:54.132666 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-c8d08703-afa5-443c-893e-37dae9f873c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:01:54.190785 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1128/2274] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:01:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:01:58.986411 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d955cd-ab0a-4d26-8b6d-505882668d1d None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:58.986970 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d955cd-ab0a-4d26-8b6d-505882668d1d None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:58.986970 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d955cd-ab0a-4d26-8b6d-505882668d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:59.025211 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-52d955cd-ab0a-4d26-8b6d-505882668d1d None None] MFA Rules not processed for user `1d4c1a9323564133817374393d52fba4`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:01:59.027106 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-52d955cd-ab0a-4d26-8b6d-505882668d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:01:59.037192 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:01:59.113333 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1147/2275] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:01:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:01:59.117524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d08703-afa5-443c-893e-37dae9f873c7 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:01:59.131076 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d08703-afa5-443c-893e-37dae9f873c7 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:01:59.138320 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71177cbe-8d63-41b2-be9f-961360117926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:01:59.139357 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71177cbe-8d63-41b2-be9f-961360117926 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:59.139996 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71177cbe-8d63-41b2-be9f-961360117926 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:59.140445 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71177cbe-8d63-41b2-be9f-961360117926 admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:59.141310 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71177cbe-8d63-41b2-be9f-961360117926 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:01:59.143448 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71177cbe-8d63-41b2-be9f-961360117926 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:01:59.248863 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1129/2276] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:01:59 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:01:59.252851 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d955cd-ab0a-4d26-8b6d-505882668d1d None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:01:59.266249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d955cd-ab0a-4d26-8b6d-505882668d1d None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:01:59.330902 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80da811-2434-44c1-8a0e-a7cb393b67c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:01:59.331990 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80da811-2434-44c1-8a0e-a7cb393b67c5 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:59.332322 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80da811-2434-44c1-8a0e-a7cb393b67c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:59.332650 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80da811-2434-44c1-8a0e-a7cb393b67c5 admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:59.333559 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80da811-2434-44c1-8a0e-a7cb393b67c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:01:59.335905 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80da811-2434-44c1-8a0e-a7cb393b67c5 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:01:59.414132 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1148/2277] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:01:59 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:01:59.415485 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71177cbe-8d63-41b2-be9f-961360117926 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:01:59.431140 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71177cbe-8d63-41b2-be9f-961360117926 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:01:59.438270 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7466f04-e337-40ad-b878-636570c91c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:01:59.438270 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7466f04-e337-40ad-b878-636570c91c6c admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:59.438270 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7466f04-e337-40ad-b878-636570c91c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:59.438270 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7466f04-e337-40ad-b878-636570c91c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:59.439432 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7466f04-e337-40ad-b878-636570c91c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:01:59.441122 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7466f04-e337-40ad-b878-636570c91c6c admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:01:59.458212 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1130/2278] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:01:59.462253 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80da811-2434-44c1-8a0e-a7cb393b67c5 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:01:59.476406 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80da811-2434-44c1-8a0e-a7cb393b67c5 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:01:59.483932 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f4324-0203-4e10-8d3b-872fad6fe6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:01:59.485920 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f4324-0203-4e10-8d3b-872fad6fe6bd admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:59.486428 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f4324-0203-4e10-8d3b-872fad6fe6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:59.486713 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f4324-0203-4e10-8d3b-872fad6fe6bd admin admin] PATH_INFO: `/v3/projects/753d0c95a4744e02bba7baef4febb578/users/011c5b11d11e4ef2bd3bdaa3b28a3b6a/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:59.507947 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f4324-0203-4e10-8d3b-872fad6fe6bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=753d0c95a4744e02bba7baef4febb578, user_id=011c5b11d11e4ef2bd3bdaa3b28a3b6a, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:01:59.511549 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f4324-0203-4e10-8d3b-872fad6fe6bd admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:01:59.588957 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1149/2279] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:01:59 2022] PUT /identity/v3/projects/753d0c95a4744e02bba7baef4febb578/users/011c5b11d11e4ef2bd3bdaa3b28a3b6a/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:01:59.589707 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7466f04-e337-40ad-b878-636570c91c6c admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:01:59.601016 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7466f04-e337-40ad-b878-636570c91c6c admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:01:59.666512 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef360a0-4fe0-438c-ac88-63ee1f0952ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:01:59.671007 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef360a0-4fe0-438c-ac88-63ee1f0952ee admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:59.671007 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef360a0-4fe0-438c-ac88-63ee1f0952ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:59.671007 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef360a0-4fe0-438c-ac88-63ee1f0952ee admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:59.671007 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef360a0-4fe0-438c-ac88-63ee1f0952ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:01:59.671007 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef360a0-4fe0-438c-ac88-63ee1f0952ee admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:01:59.683096 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1131/2280] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:01:59.687207 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f4324-0203-4e10-8d3b-872fad6fe6bd admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:01:59.701376 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f4324-0203-4e10-8d3b-872fad6fe6bd admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:01:59.707426 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e09e9-de1a-4112-ba6e-c8943e7273ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:01:59.709044 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e09e9-de1a-4112-ba6e-c8943e7273ac admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:01:59.709455 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e09e9-de1a-4112-ba6e-c8943e7273ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:01:59.709635 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e09e9-de1a-4112-ba6e-c8943e7273ac admin admin] PATH_INFO: `/v3/projects/753d0c95a4744e02bba7baef4febb578/users/011c5b11d11e4ef2bd3bdaa3b28a3b6a/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:01:59.711862 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e09e9-de1a-4112-ba6e-c8943e7273ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=753d0c95a4744e02bba7baef4febb578, user_id=011c5b11d11e4ef2bd3bdaa3b28a3b6a, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:01:59.715070 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e09e9-de1a-4112-ba6e-c8943e7273ac admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:01:59.728324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1150/2281] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:01:59 2022] PUT /identity/v3/projects/753d0c95a4744e02bba7baef4febb578/users/011c5b11d11e4ef2bd3bdaa3b28a3b6a/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:02:03.629620 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef360a0-4fe0-438c-ac88-63ee1f0952ee admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:03.633373 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-9ef360a0-4fe0-438c-ac88-63ee1f0952ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:03.658183 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:02:03.715040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef360a0-4fe0-438c-ac88-63ee1f0952ee admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:03.773990 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a5602-11f3-49d2-b33e-d623c90da89d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:03.774767 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a5602-11f3-49d2-b33e-d623c90da89d service cinder] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:03.775122 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a5602-11f3-49d2-b33e-d623c90da89d service cinder] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:03.776703 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a5602-11f3-49d2-b33e-d623c90da89d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:03.779054 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-262a5602-11f3-49d2-b33e-d623c90da89d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:03.876774 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a5602-11f3-49d2-b33e-d623c90da89d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:03.878549 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a5602-11f3-49d2-b33e-d623c90da89d service cinder] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:03.892316 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1132/2282] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:02:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:02:05.739687 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67965592-c623-449f-9854-ab093f7bcb99 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:05.740160 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67965592-c623-449f-9854-ab093f7bcb99 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:05.740262 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67965592-c623-449f-9854-ab093f7bcb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:05.771715 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-67965592-c623-449f-9854-ab093f7bcb99 None None] MFA Rules not processed for user `011c5b11d11e4ef2bd3bdaa3b28a3b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:02:05.773384 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-67965592-c623-449f-9854-ab093f7bcb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:05.857090 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:02:05.881408 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1151/2283] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:02:05 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:02:05.896150 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a5602-11f3-49d2-b33e-d623c90da89d service cinder] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:05.897684 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-262a5602-11f3-49d2-b33e-d623c90da89d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:06.001141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a5602-11f3-49d2-b33e-d623c90da89d service cinder] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:06.007028 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc1f6d-3b8c-4cf3-9e12-a1e8f333fa3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:06.007725 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc1f6d-3b8c-4cf3-9e12-a1e8f333fa3b service nova] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:06.008011 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc1f6d-3b8c-4cf3-9e12-a1e8f333fa3b service nova] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:06.008288 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc1f6d-3b8c-4cf3-9e12-a1e8f333fa3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:06.027635 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:02:06.080617 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc1f6d-3b8c-4cf3-9e12-a1e8f333fa3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:06.082316 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc1f6d-3b8c-4cf3-9e12-a1e8f333fa3b service nova] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:06.095224 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1133/2284] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:02:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:02:08.657429 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94389232-6adf-45d3-8946-71292be837cf None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:08.657915 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94389232-6adf-45d3-8946-71292be837cf None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:08.658012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94389232-6adf-45d3-8946-71292be837cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:08.676342 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-94389232-6adf-45d3-8946-71292be837cf None None] MFA Rules not processed for user `1d4c1a9323564133817374393d52fba4`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:02:08.677507 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-94389232-6adf-45d3-8946-71292be837cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:08.684977 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1152/2285] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:02:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:02:16.382035 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=19 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:02:18.670783 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=9 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:02:29.944101 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc1f6d-3b8c-4cf3-9e12-a1e8f333fa3b service nova] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:30.011963 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc1f6d-3b8c-4cf3-9e12-a1e8f333fa3b service nova] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:30.016349 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4c72c-56d3-4d76-998e-a02245cd0fc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:30.017005 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4c72c-56d3-4d76-998e-a02245cd0fc2 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:30.017303 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4c72c-56d3-4d76-998e-a02245cd0fc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:30.017579 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4c72c-56d3-4d76-998e-a02245cd0fc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:30.022926 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-e4b4c72c-56d3-4d76-998e-a02245cd0fc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:30.109597 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b4c72c-56d3-4d76-998e-a02245cd0fc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:30.111278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b4c72c-56d3-4d76-998e-a02245cd0fc2 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:30.124186 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1134/2286] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:02:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:02:32.141178 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea11622-d89e-4cfc-9481-3570434da390 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:32.141766 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea11622-d89e-4cfc-9481-3570434da390 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:32.141766 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea11622-d89e-4cfc-9481-3570434da390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:32.160277 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-aea11622-d89e-4cfc-9481-3570434da390 None None] MFA Rules not processed for user `5a57fd95e0714be6b124d5abc2422dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:02:32.161482 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-aea11622-d89e-4cfc-9481-3570434da390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:32.239721 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1153/2287] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:02:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:02:32.734725 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4c72c-56d3-4d76-998e-a02245cd0fc2 service neutron] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:32.736837 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-e4b4c72c-56d3-4d76-998e-a02245cd0fc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:32.748564 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4c72c-56d3-4d76-998e-a02245cd0fc2 service neutron] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:32.752406 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb39e12-9bcf-477e-b8d4-70f72bafe705 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:32.753048 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb39e12-9bcf-477e-b8d4-70f72bafe705 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:32.753328 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb39e12-9bcf-477e-b8d4-70f72bafe705 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:32.753595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb39e12-9bcf-477e-b8d4-70f72bafe705 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:32.755391 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-8bb39e12-9bcf-477e-b8d4-70f72bafe705 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:32.765869 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb39e12-9bcf-477e-b8d4-70f72bafe705 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:32.768001 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb39e12-9bcf-477e-b8d4-70f72bafe705 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:32.777296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1135/2288] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:02:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:02:34.747496 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea11622-d89e-4cfc-9481-3570434da390 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:34.749243 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-aea11622-d89e-4cfc-9481-3570434da390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:34.764881 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea11622-d89e-4cfc-9481-3570434da390 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:34.769751 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca00d4d-a36d-4def-a739-d2cc0162b852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:34.770757 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca00d4d-a36d-4def-a739-d2cc0162b852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:34.771111 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca00d4d-a36d-4def-a739-d2cc0162b852 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:34.771462 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca00d4d-a36d-4def-a739-d2cc0162b852 admin admin] PATH_INFO: `/v3/users/5c6b6d56a8b94fcb9eecc4d3167cd8a1` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:34.772960 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca00d4d-a36d-4def-a739-d2cc0162b852 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c6b6d56a8b94fcb9eecc4d3167cd8a1)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:34.774895 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca00d4d-a36d-4def-a739-d2cc0162b852 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:34.986978 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-4ca00d4d-a36d-4def-a739-d2cc0162b852 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c6b6d56a8b94fcb9eecc4d3167cd8a1'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:34.988118 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-4ca00d4d-a36d-4def-a739-d2cc0162b852 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c6b6d56a8b94fcb9eecc4d3167cd8a1'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:34.988989 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-4ca00d4d-a36d-4def-a739-d2cc0162b852 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c6b6d56a8b94fcb9eecc4d3167cd8a1'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:35.089515 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-4ca00d4d-a36d-4def-a739-d2cc0162b852 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c6b6d56a8b94fcb9eecc4d3167cd8a1'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:35.100707 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-4ca00d4d-a36d-4def-a739-d2cc0162b852 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c6b6d56a8b94fcb9eecc4d3167cd8a1'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:35.124966 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1154/2289] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:02:34 2022] DELETE /identity/v3/users/5c6b6d56a8b94fcb9eecc4d3167cd8a1 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:02:35.407266 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb39e12-9bcf-477e-b8d4-70f72bafe705 service neutron] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:35.419233 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb39e12-9bcf-477e-b8d4-70f72bafe705 service neutron] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:35.485527 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5df847-0f53-4274-9499-eee70fa925c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:35.486546 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5df847-0f53-4274-9499-eee70fa925c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:35.487255 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5df847-0f53-4274-9499-eee70fa925c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:35.487255 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5df847-0f53-4274-9499-eee70fa925c5 admin admin] PATH_INFO: `/v3/projects/dc8e8edebd8a4ad78ef3e03407758db1` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:35.488676 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5df847-0f53-4274-9499-eee70fa925c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc8e8edebd8a4ad78ef3e03407758db1)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:35.491038 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5df847-0f53-4274-9499-eee70fa925c5 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:35.708557 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:02:35.717551 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-9a5df847-0f53-4274-9499-eee70fa925c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc8e8edebd8a4ad78ef3e03407758db1', 'request_id': 'req-9a5df847-0f53-4274-9499-eee70fa925c5'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:35.725027 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-9a5df847-0f53-4274-9499-eee70fa925c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc8e8edebd8a4ad78ef3e03407758db1', 'request_id': 'req-9a5df847-0f53-4274-9499-eee70fa925c5'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:35.812297 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-9a5df847-0f53-4274-9499-eee70fa925c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc8e8edebd8a4ad78ef3e03407758db1', 'request_id': 'req-9a5df847-0f53-4274-9499-eee70fa925c5'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:35.827931 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-9a5df847-0f53-4274-9499-eee70fa925c5 admin admin] The token cache is being invalidate because project dc8e8edebd8a4ad78ef3e03407758db1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:02:35.828154 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-9a5df847-0f53-4274-9499-eee70fa925c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:35.828804 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-9a5df847-0f53-4274-9499-eee70fa925c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:35.830435 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1136/2290] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:02:35 2022] DELETE /identity/v3/projects/dc8e8edebd8a4ad78ef3e03407758db1 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:02:35.835521 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de58f9-8b79-41a5-b85a-512cba289a30 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:35.837678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de58f9-8b79-41a5-b85a-512cba289a30 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:35.837678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de58f9-8b79-41a5-b85a-512cba289a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:35.860133 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-75de58f9-8b79-41a5-b85a-512cba289a30 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:02:35.861997 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-75de58f9-8b79-41a5-b85a-512cba289a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:35.992836 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1155/2291] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:02:35.994273 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9016e4e-873f-4150-b385-350b31f39de8 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:35.994569 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9016e4e-873f-4150-b385-350b31f39de8 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:35.994850 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9016e4e-873f-4150-b385-350b31f39de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:36.018861 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-e9016e4e-873f-4150-b385-350b31f39de8 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:02:36.021673 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-e9016e4e-873f-4150-b385-350b31f39de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:36.048151 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de58f9-8b79-41a5-b85a-512cba289a30 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:36.055677 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1137/2292] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:02:36.061059 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de58f9-8b79-41a5-b85a-512cba289a30 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:36.080212 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d88d65-22b4-4183-a8a0-0472dba4a50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:36.096099 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d88d65-22b4-4183-a8a0-0472dba4a50a admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:36.096099 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d88d65-22b4-4183-a8a0-0472dba4a50a admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:36.096099 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d88d65-22b4-4183-a8a0-0472dba4a50a admin admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:36.096099 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d88d65-22b4-4183-a8a0-0472dba4a50a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:02:36.096099 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d88d65-22b4-4183-a8a0-0472dba4a50a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:36.096099 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d88d65-22b4-4183-a8a0-0472dba4a50a admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:36.103807 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1156/2293] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 16:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:02:36.108818 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9016e4e-873f-4150-b385-350b31f39de8 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:36.132141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9016e4e-873f-4150-b385-350b31f39de8 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:36.140003 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40f1e9-99a1-4a47-be9e-3d9045f1aa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:36.140787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40f1e9-99a1-4a47-be9e-3d9045f1aa73 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:36.141123 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40f1e9-99a1-4a47-be9e-3d9045f1aa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:36.142140 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40f1e9-99a1-4a47-be9e-3d9045f1aa73 admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:36.142975 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40f1e9-99a1-4a47-be9e-3d9045f1aa73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:36.145104 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40f1e9-99a1-4a47-be9e-3d9045f1aa73 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:36.234678 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1138/2294] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:02:36 2022] POST /identity/v3/projects => generated 365 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:02:36.239286 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d88d65-22b4-4183-a8a0-0472dba4a50a admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:36.246386 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:02:36.250989 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d88d65-22b4-4183-a8a0-0472dba4a50a admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:36.316348 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3635f99-fd50-4cf8-9b52-b8f2a82588b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:36.317033 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3635f99-fd50-4cf8-9b52-b8f2a82588b7 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:36.317359 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3635f99-fd50-4cf8-9b52-b8f2a82588b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:36.317661 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3635f99-fd50-4cf8-9b52-b8f2a82588b7 admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:36.318353 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3635f99-fd50-4cf8-9b52-b8f2a82588b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:36.320495 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3635f99-fd50-4cf8-9b52-b8f2a82588b7 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:36.389295 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1157/2295] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:02:36 2022] POST /identity/v3/users => generated 283 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:02:36.393686 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40f1e9-99a1-4a47-be9e-3d9045f1aa73 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:36.413365 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40f1e9-99a1-4a47-be9e-3d9045f1aa73 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:36.418129 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b3627-962f-4765-be24-006495a28b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:36.420502 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b3627-962f-4765-be24-006495a28b9f admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:36.420894 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b3627-962f-4765-be24-006495a28b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:36.421306 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b3627-962f-4765-be24-006495a28b9f admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:36.422139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b3627-962f-4765-be24-006495a28b9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:36.423905 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b3627-962f-4765-be24-006495a28b9f admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:36.437187 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1139/2296] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:02:36.441440 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3635f99-fd50-4cf8-9b52-b8f2a82588b7 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:36.453618 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3635f99-fd50-4cf8-9b52-b8f2a82588b7 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:36.458991 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d8cd8-b9e1-49c5-aabd-edf283c77475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:36.459784 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d8cd8-b9e1-49c5-aabd-edf283c77475 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:36.460164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d8cd8-b9e1-49c5-aabd-edf283c77475 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:36.460509 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d8cd8-b9e1-49c5-aabd-edf283c77475 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:36.462382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d8cd8-b9e1-49c5-aabd-edf283c77475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:36.464035 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d8cd8-b9e1-49c5-aabd-edf283c77475 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:36.479865 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1158/2297] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:02:36.481069 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b3627-962f-4765-be24-006495a28b9f admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:36.492667 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b3627-962f-4765-be24-006495a28b9f admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:36.499534 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfebc591-1583-49df-83f2-72ae27f473db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:36.500161 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfebc591-1583-49df-83f2-72ae27f473db admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:36.500506 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfebc591-1583-49df-83f2-72ae27f473db admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:36.500856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfebc591-1583-49df-83f2-72ae27f473db admin admin] PATH_INFO: `/v3/projects/41ee324368ba49cf9c01d5c442dbc1ad/users/89996d893a2c424cb930967834bb4e7e/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:36.520710 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfebc591-1583-49df-83f2-72ae27f473db admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ee324368ba49cf9c01d5c442dbc1ad, user_id=89996d893a2c424cb930967834bb4e7e, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:36.523230 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfebc591-1583-49df-83f2-72ae27f473db admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:36.674249 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1140/2298] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:02:36 2022] PUT /identity/v3/projects/41ee324368ba49cf9c01d5c442dbc1ad/users/89996d893a2c424cb930967834bb4e7e/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:02:36.685350 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df03e2a-ca6b-4aaf-a2ee-e070d1545de7 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:36.686237 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df03e2a-ca6b-4aaf-a2ee-e070d1545de7 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:36.686237 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df03e2a-ca6b-4aaf-a2ee-e070d1545de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:36.715113 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-8df03e2a-ca6b-4aaf-a2ee-e070d1545de7 None None] MFA Rules not processed for user `89996d893a2c424cb930967834bb4e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:02:36.716511 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-8df03e2a-ca6b-4aaf-a2ee-e070d1545de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:36.791957 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1159/2299] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:02:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:02:36.796985 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfebc591-1583-49df-83f2-72ae27f473db admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:36.862829 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfebc591-1583-49df-83f2-72ae27f473db admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:36.867770 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab9eb7-6e09-4d61-9ba8-92e222523750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:36.868437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab9eb7-6e09-4d61-9ba8-92e222523750 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:36.868718 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab9eb7-6e09-4d61-9ba8-92e222523750 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:36.868996 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab9eb7-6e09-4d61-9ba8-92e222523750 admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:36.869839 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab9eb7-6e09-4d61-9ba8-92e222523750 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:36.871825 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab9eb7-6e09-4d61-9ba8-92e222523750 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:37.008122 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1141/2300] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:02:36 2022] POST /identity/v3/projects => generated 363 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:02:37.011957 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df03e2a-ca6b-4aaf-a2ee-e070d1545de7 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:37.023239 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df03e2a-ca6b-4aaf-a2ee-e070d1545de7 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:37.090099 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065987cc-dd00-49bb-a6d8-7911a77074d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:37.091626 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065987cc-dd00-49bb-a6d8-7911a77074d2 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:37.091995 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065987cc-dd00-49bb-a6d8-7911a77074d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:37.096027 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065987cc-dd00-49bb-a6d8-7911a77074d2 admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:37.096027 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065987cc-dd00-49bb-a6d8-7911a77074d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:37.096027 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065987cc-dd00-49bb-a6d8-7911a77074d2 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:37.235223 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1160/2301] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:02:37 2022] POST /identity/v3/users => generated 288 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:02:37.239041 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab9eb7-6e09-4d61-9ba8-92e222523750 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:37.250489 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab9eb7-6e09-4d61-9ba8-92e222523750 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:37.255090 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfe942-06fe-46c2-818f-c7a67dffaeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:37.255790 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfe942-06fe-46c2-818f-c7a67dffaeb6 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:37.256077 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfe942-06fe-46c2-818f-c7a67dffaeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:37.256456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfe942-06fe-46c2-818f-c7a67dffaeb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:37.257158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bfe942-06fe-46c2-818f-c7a67dffaeb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:37.258758 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bfe942-06fe-46c2-818f-c7a67dffaeb6 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:37.270293 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1142/2302] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:02:37.274366 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065987cc-dd00-49bb-a6d8-7911a77074d2 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:37.280921 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:02:37.286446 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065987cc-dd00-49bb-a6d8-7911a77074d2 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:37.291585 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4d016-7e0c-4c0f-b00c-bb216f57f02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:37.292698 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4d016-7e0c-4c0f-b00c-bb216f57f02a admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:37.293220 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4d016-7e0c-4c0f-b00c-bb216f57f02a admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:37.293866 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4d016-7e0c-4c0f-b00c-bb216f57f02a admin admin] PATH_INFO: `/v3/projects/8c03e4dbbf304ab0b5c167395fd0e8cb/users/13f9034aa7754d45bac819d9a2ac9ba1/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:37.310688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4d016-7e0c-4c0f-b00c-bb216f57f02a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c03e4dbbf304ab0b5c167395fd0e8cb, user_id=13f9034aa7754d45bac819d9a2ac9ba1, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:37.313391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4d016-7e0c-4c0f-b00c-bb216f57f02a admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:37.376921 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1161/2303] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:02:37 2022] PUT /identity/v3/projects/8c03e4dbbf304ab0b5c167395fd0e8cb/users/13f9034aa7754d45bac819d9a2ac9ba1/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:02:37.380963 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfe942-06fe-46c2-818f-c7a67dffaeb6 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:37.391709 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfe942-06fe-46c2-818f-c7a67dffaeb6 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:37.425683 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:02:37.448836 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90b14f-bcde-47f1-a6cd-3a8393c96a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:37.449512 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90b14f-bcde-47f1-a6cd-3a8393c96a20 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:37.454376 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90b14f-bcde-47f1-a6cd-3a8393c96a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:37.454376 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90b14f-bcde-47f1-a6cd-3a8393c96a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:37.454376 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a90b14f-bcde-47f1-a6cd-3a8393c96a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:37.454376 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a90b14f-bcde-47f1-a6cd-3a8393c96a20 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:37.463726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1143/2304] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:02:37.468074 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4d016-7e0c-4c0f-b00c-bb216f57f02a admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:37.478546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4d016-7e0c-4c0f-b00c-bb216f57f02a admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:37.483463 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51bc920-a15e-40fa-aeb6-9ca0d8684bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:37.484948 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bc920-a15e-40fa-aeb6-9ca0d8684bfc admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:37.484948 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bc920-a15e-40fa-aeb6-9ca0d8684bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:37.485200 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bc920-a15e-40fa-aeb6-9ca0d8684bfc admin admin] PATH_INFO: `/v3/projects/8c03e4dbbf304ab0b5c167395fd0e8cb/users/13f9034aa7754d45bac819d9a2ac9ba1/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:37.487031 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51bc920-a15e-40fa-aeb6-9ca0d8684bfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c03e4dbbf304ab0b5c167395fd0e8cb, user_id=13f9034aa7754d45bac819d9a2ac9ba1, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:37.489837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51bc920-a15e-40fa-aeb6-9ca0d8684bfc admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:37.501124 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1162/2305] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:02:37 2022] PUT /identity/v3/projects/8c03e4dbbf304ab0b5c167395fd0e8cb/users/13f9034aa7754d45bac819d9a2ac9ba1/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:02:37.513201 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76452c7f-78bd-4219-b986-8ffb3c9c0e11 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:37.513611 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76452c7f-78bd-4219-b986-8ffb3c9c0e11 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:37.513897 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76452c7f-78bd-4219-b986-8ffb3c9c0e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:37.541888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-76452c7f-78bd-4219-b986-8ffb3c9c0e11 None None] MFA Rules not processed for user `13f9034aa7754d45bac819d9a2ac9ba1`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:02:37.543074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-76452c7f-78bd-4219-b986-8ffb3c9c0e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:37.612841 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1144/2306] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:02:37 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:02:37.626756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51bc920-a15e-40fa-aeb6-9ca0d8684bfc admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:37.626756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-f51bc920-a15e-40fa-aeb6-9ca0d8684bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:37.685918 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51bc920-a15e-40fa-aeb6-9ca0d8684bfc admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:37.689632 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e497d6a-77f7-4b7d-b33d-b1e69f0c68e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:37.690280 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e497d6a-77f7-4b7d-b33d-b1e69f0c68e6 service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:37.690565 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e497d6a-77f7-4b7d-b33d-b1e69f0c68e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:37.690842 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e497d6a-77f7-4b7d-b33d-b1e69f0c68e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:37.700069 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e497d6a-77f7-4b7d-b33d-b1e69f0c68e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:37.702015 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e497d6a-77f7-4b7d-b33d-b1e69f0c68e6 service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:37.712276 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1163/2307] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:02:37 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:02:37.892535 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76452c7f-78bd-4219-b986-8ffb3c9c0e11 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:37.902569 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76452c7f-78bd-4219-b986-8ffb3c9c0e11 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:37.906242 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6d66b-cdff-42e8-951e-d3cec8365c4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:37.906858 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6d66b-cdff-42e8-951e-d3cec8365c4e service cinder] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:37.907136 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6d66b-cdff-42e8-951e-d3cec8365c4e service cinder] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:37.907411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6d66b-cdff-42e8-951e-d3cec8365c4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:37.964126 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea6d66b-cdff-42e8-951e-d3cec8365c4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:37.966072 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea6d66b-cdff-42e8-951e-d3cec8365c4e service cinder] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:37.976096 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1145/2308] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:02:37 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:02:41.428610 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e497d6a-77f7-4b7d-b33d-b1e69f0c68e6 service cinder] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:41.507117 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e497d6a-77f7-4b7d-b33d-b1e69f0c68e6 service cinder] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:41.512531 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64a540-8bae-493e-b931-55e0c48c01cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:41.514086 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64a540-8bae-493e-b931-55e0c48c01cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:41.514419 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64a540-8bae-493e-b931-55e0c48c01cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:41.514707 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64a540-8bae-493e-b931-55e0c48c01cd admin admin] PATH_INFO: `/v3/users/89996d893a2c424cb930967834bb4e7e` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:41.516382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64a540-8bae-493e-b931-55e0c48c01cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=89996d893a2c424cb930967834bb4e7e)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:41.518402 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64a540-8bae-493e-b931-55e0c48c01cd admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:41.722357 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-3d64a540-8bae-493e-b931-55e0c48c01cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89996d893a2c424cb930967834bb4e7e'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:41.723542 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-3d64a540-8bae-493e-b931-55e0c48c01cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89996d893a2c424cb930967834bb4e7e'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:41.725053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-3d64a540-8bae-493e-b931-55e0c48c01cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89996d893a2c424cb930967834bb4e7e'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:41.788777 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-3d64a540-8bae-493e-b931-55e0c48c01cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89996d893a2c424cb930967834bb4e7e'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:41.797881 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-3d64a540-8bae-493e-b931-55e0c48c01cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89996d893a2c424cb930967834bb4e7e'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:41.803768 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:02:41.822009 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1164/2309] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:02:41 2022] DELETE /identity/v3/users/89996d893a2c424cb930967834bb4e7e => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:02:41.827082 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea092777-475e-45ae-a061-d779bc46f12e None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:41.827921 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea092777-475e-45ae-a061-d779bc46f12e None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:41.827921 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea092777-475e-45ae-a061-d779bc46f12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:41.846627 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-ea092777-475e-45ae-a061-d779bc46f12e None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:02:41.847925 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-ea092777-475e-45ae-a061-d779bc46f12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:41.916404 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:02:41.928113 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1146/2310] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:02:41.940781 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64a540-8bae-493e-b931-55e0c48c01cd admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:41.942293 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-3d64a540-8bae-493e-b931-55e0c48c01cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:42.010584 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64a540-8bae-493e-b931-55e0c48c01cd admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:42.015533 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad781a-2925-42b1-bbae-d76b1cb643e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:42.016319 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad781a-2925-42b1-bbae-d76b1cb643e8 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:42.016671 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad781a-2925-42b1-bbae-d76b1cb643e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:42.017018 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad781a-2925-42b1-bbae-d76b1cb643e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:42.027561 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad781a-2925-42b1-bbae-d76b1cb643e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:42.030758 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad781a-2925-42b1-bbae-d76b1cb643e8 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:42.042063 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1165/2311] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:02:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:02:42.499628 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea092777-475e-45ae-a061-d779bc46f12e None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:42.501335 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-ea092777-475e-45ae-a061-d779bc46f12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:42.520447 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea092777-475e-45ae-a061-d779bc46f12e None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:42.531796 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a81041-b6f9-4d23-9bfd-c0ff35595037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:42.532648 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a81041-b6f9-4d23-9bfd-c0ff35595037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:42.533170 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a81041-b6f9-4d23-9bfd-c0ff35595037 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:42.533577 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a81041-b6f9-4d23-9bfd-c0ff35595037 admin admin] PATH_INFO: `/v3/projects/41ee324368ba49cf9c01d5c442dbc1ad` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:42.535287 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a81041-b6f9-4d23-9bfd-c0ff35595037 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41ee324368ba49cf9c01d5c442dbc1ad)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:42.538938 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a81041-b6f9-4d23-9bfd-c0ff35595037 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:42.655909 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-88a81041-b6f9-4d23-9bfd-c0ff35595037 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41ee324368ba49cf9c01d5c442dbc1ad', 'request_id': 'req-88a81041-b6f9-4d23-9bfd-c0ff35595037'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:42.662476 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-88a81041-b6f9-4d23-9bfd-c0ff35595037 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41ee324368ba49cf9c01d5c442dbc1ad', 'request_id': 'req-88a81041-b6f9-4d23-9bfd-c0ff35595037'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:42.742261 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-88a81041-b6f9-4d23-9bfd-c0ff35595037 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41ee324368ba49cf9c01d5c442dbc1ad', 'request_id': 'req-88a81041-b6f9-4d23-9bfd-c0ff35595037'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:42.757477 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-88a81041-b6f9-4d23-9bfd-c0ff35595037 admin admin] The token cache is being invalidate because project 41ee324368ba49cf9c01d5c442dbc1ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:02:42.757983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-88a81041-b6f9-4d23-9bfd-c0ff35595037 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:42.758720 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-88a81041-b6f9-4d23-9bfd-c0ff35595037 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:42.760467 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1147/2312] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:02:42 2022] DELETE /identity/v3/projects/41ee324368ba49cf9c01d5c442dbc1ad => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:02:42.766017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad781a-2925-42b1-bbae-d76b1cb643e8 service neutron] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:42.777254 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad781a-2925-42b1-bbae-d76b1cb643e8 service neutron] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:42.843116 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821871a-f09a-46c2-a7a9-44b9e9bef46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:42.844268 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821871a-f09a-46c2-a7a9-44b9e9bef46d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:42.846979 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821871a-f09a-46c2-a7a9-44b9e9bef46d admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:42.846979 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821871a-f09a-46c2-a7a9-44b9e9bef46d admin admin] PATH_INFO: `/v3/users/13f9034aa7754d45bac819d9a2ac9ba1` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:42.847298 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b821871a-f09a-46c2-a7a9-44b9e9bef46d admin admin] RBAC: Authorizing `identity:delete_user(user_id=13f9034aa7754d45bac819d9a2ac9ba1)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:42.849825 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b821871a-f09a-46c2-a7a9-44b9e9bef46d admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:43.020463 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-b821871a-f09a-46c2-a7a9-44b9e9bef46d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13f9034aa7754d45bac819d9a2ac9ba1'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:43.021173 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-b821871a-f09a-46c2-a7a9-44b9e9bef46d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13f9034aa7754d45bac819d9a2ac9ba1'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:43.021819 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-b821871a-f09a-46c2-a7a9-44b9e9bef46d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13f9034aa7754d45bac819d9a2ac9ba1'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:43.119558 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-b821871a-f09a-46c2-a7a9-44b9e9bef46d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13f9034aa7754d45bac819d9a2ac9ba1'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:43.129612 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-b821871a-f09a-46c2-a7a9-44b9e9bef46d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13f9034aa7754d45bac819d9a2ac9ba1'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:43.150514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1166/2313] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:02:42 2022] DELETE /identity/v3/users/13f9034aa7754d45bac819d9a2ac9ba1 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:02:43.623438 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a81041-b6f9-4d23-9bfd-c0ff35595037 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:43.626826 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-88a81041-b6f9-4d23-9bfd-c0ff35595037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:43.643777 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a81041-b6f9-4d23-9bfd-c0ff35595037 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:43.710549 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0f3ba-11a5-4593-a4e0-190fb91bf19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:43.711435 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0f3ba-11a5-4593-a4e0-190fb91bf19e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:43.711762 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0f3ba-11a5-4593-a4e0-190fb91bf19e admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:43.712049 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0f3ba-11a5-4593-a4e0-190fb91bf19e admin admin] PATH_INFO: `/v3/projects/8c03e4dbbf304ab0b5c167395fd0e8cb` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:43.716149 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a0f3ba-11a5-4593-a4e0-190fb91bf19e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c03e4dbbf304ab0b5c167395fd0e8cb)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:43.719518 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a0f3ba-11a5-4593-a4e0-190fb91bf19e admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:43.866047 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-46a0f3ba-11a5-4593-a4e0-190fb91bf19e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c03e4dbbf304ab0b5c167395fd0e8cb', 'request_id': 'req-46a0f3ba-11a5-4593-a4e0-190fb91bf19e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:43.876869 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-46a0f3ba-11a5-4593-a4e0-190fb91bf19e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c03e4dbbf304ab0b5c167395fd0e8cb', 'request_id': 'req-46a0f3ba-11a5-4593-a4e0-190fb91bf19e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:43.942859 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-46a0f3ba-11a5-4593-a4e0-190fb91bf19e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c03e4dbbf304ab0b5c167395fd0e8cb', 'request_id': 'req-46a0f3ba-11a5-4593-a4e0-190fb91bf19e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:43.957879 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-46a0f3ba-11a5-4593-a4e0-190fb91bf19e admin admin] The token cache is being invalidate because project 8c03e4dbbf304ab0b5c167395fd0e8cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:02:43.958088 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-46a0f3ba-11a5-4593-a4e0-190fb91bf19e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:43.959183 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-46a0f3ba-11a5-4593-a4e0-190fb91bf19e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:43.960754 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1148/2314] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:02:43 2022] DELETE /identity/v3/projects/8c03e4dbbf304ab0b5c167395fd0e8cb => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:02:43.967855 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274d9b9-2bce-4ee0-8b12-7eb91255d63e None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:43.968403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274d9b9-2bce-4ee0-8b12-7eb91255d63e None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:43.968880 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274d9b9-2bce-4ee0-8b12-7eb91255d63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:43.993827 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-c274d9b9-2bce-4ee0-8b12-7eb91255d63e None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:02:43.996381 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-c274d9b9-2bce-4ee0-8b12-7eb91255d63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:44.001667 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:02:44.065783 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1167/2315] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:02:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:02:44.073962 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7cf82-983b-4238-9dfc-8713ee447aeb None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:44.074507 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7cf82-983b-4238-9dfc-8713ee447aeb None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:44.075343 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7cf82-983b-4238-9dfc-8713ee447aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:44.094882 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-99a7cf82-983b-4238-9dfc-8713ee447aeb None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:02:44.096246 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-99a7cf82-983b-4238-9dfc-8713ee447aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:44.104369 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1149/2316] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:02:44.109675 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274d9b9-2bce-4ee0-8b12-7eb91255d63e None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:44.120386 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274d9b9-2bce-4ee0-8b12-7eb91255d63e None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:44.125737 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef617f-ed32-49d0-b130-d23c0245fe95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:44.126397 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef617f-ed32-49d0-b130-d23c0245fe95 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:44.126682 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef617f-ed32-49d0-b130-d23c0245fe95 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:44.127027 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef617f-ed32-49d0-b130-d23c0245fe95 admin admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:44.127798 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef617f-ed32-49d0-b130-d23c0245fe95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:02:44.128112 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef617f-ed32-49d0-b130-d23c0245fe95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:44.129723 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef617f-ed32-49d0-b130-d23c0245fe95 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:44.142644 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1168/2317] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 16:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:02:44.147133 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7cf82-983b-4238-9dfc-8713ee447aeb None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:44.154286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:02:44.158354 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7cf82-983b-4238-9dfc-8713ee447aeb None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:44.163117 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05426edd-fcd7-4c18-a264-4917aa680e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:44.163798 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05426edd-fcd7-4c18-a264-4917aa680e25 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:44.164084 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05426edd-fcd7-4c18-a264-4917aa680e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:44.164361 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05426edd-fcd7-4c18-a264-4917aa680e25 admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:44.165054 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05426edd-fcd7-4c18-a264-4917aa680e25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:44.166973 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05426edd-fcd7-4c18-a264-4917aa680e25 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:44.286066 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1150/2318] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:02:44 2022] POST /identity/v3/projects => generated 369 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:02:44.292106 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef617f-ed32-49d0-b130-d23c0245fe95 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:44.301649 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef617f-ed32-49d0-b130-d23c0245fe95 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:44.362751 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f74b0d-001e-46ce-93ee-3c9e22d01751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:44.363439 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f74b0d-001e-46ce-93ee-3c9e22d01751 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:44.363757 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f74b0d-001e-46ce-93ee-3c9e22d01751 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:44.364038 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f74b0d-001e-46ce-93ee-3c9e22d01751 admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:44.364744 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f74b0d-001e-46ce-93ee-3c9e22d01751 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:44.366994 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f74b0d-001e-46ce-93ee-3c9e22d01751 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:44.461234 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1169/2319] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:02:44 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:02:44.466102 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05426edd-fcd7-4c18-a264-4917aa680e25 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:44.476625 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05426edd-fcd7-4c18-a264-4917aa680e25 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:44.481517 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafe5f3-3206-425d-a233-c8b3741b202a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:44.486302 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafe5f3-3206-425d-a233-c8b3741b202a admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:44.486302 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafe5f3-3206-425d-a233-c8b3741b202a admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:44.486302 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafe5f3-3206-425d-a233-c8b3741b202a admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:44.486302 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aafe5f3-3206-425d-a233-c8b3741b202a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:44.486302 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aafe5f3-3206-425d-a233-c8b3741b202a admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:44.495157 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1151/2320] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:02:44.499890 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f74b0d-001e-46ce-93ee-3c9e22d01751 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:44.510369 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f74b0d-001e-46ce-93ee-3c9e22d01751 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:44.516539 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b3df6-a04b-48ae-a88f-3c3c39f8b6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:44.517214 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b3df6-a04b-48ae-a88f-3c3c39f8b6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:44.517514 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b3df6-a04b-48ae-a88f-3c3c39f8b6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:44.517793 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b3df6-a04b-48ae-a88f-3c3c39f8b6c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:44.518529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b3df6-a04b-48ae-a88f-3c3c39f8b6c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:44.520192 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b3df6-a04b-48ae-a88f-3c3c39f8b6c2 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:44.531513 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1170/2321] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:02:44.535533 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafe5f3-3206-425d-a233-c8b3741b202a admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:44.545995 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafe5f3-3206-425d-a233-c8b3741b202a admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:44.551390 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b578b25-e661-4c72-ad43-993dc78c187d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:44.552307 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b578b25-e661-4c72-ad43-993dc78c187d admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:44.552589 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b578b25-e661-4c72-ad43-993dc78c187d admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:44.552867 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b578b25-e661-4c72-ad43-993dc78c187d admin admin] PATH_INFO: `/v3/projects/7603285afcfc4b769809bc9377f12f83/users/01b24573b27547ab9efd91acfb2802e7/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:44.568331 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b578b25-e661-4c72-ad43-993dc78c187d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7603285afcfc4b769809bc9377f12f83, user_id=01b24573b27547ab9efd91acfb2802e7, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:44.571023 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b578b25-e661-4c72-ad43-993dc78c187d admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:44.649980 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1152/2322] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:02:44 2022] PUT /identity/v3/projects/7603285afcfc4b769809bc9377f12f83/users/01b24573b27547ab9efd91acfb2802e7/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:02:44.661542 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b20d67-1ec8-4f8e-bd27-a882be95d2bb None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:44.661902 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b20d67-1ec8-4f8e-bd27-a882be95d2bb None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:44.662269 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b20d67-1ec8-4f8e-bd27-a882be95d2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:44.699393 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-a0b20d67-1ec8-4f8e-bd27-a882be95d2bb None None] MFA Rules not processed for user `01b24573b27547ab9efd91acfb2802e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:02:44.701254 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-a0b20d67-1ec8-4f8e-bd27-a882be95d2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:44.789302 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1171/2323] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:02:44 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:02:44.795587 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b578b25-e661-4c72-ad43-993dc78c187d admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:44.873803 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b578b25-e661-4c72-ad43-993dc78c187d admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:44.878533 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d59ea2-78ab-446c-9bb5-4660a883023c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:44.879189 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d59ea2-78ab-446c-9bb5-4660a883023c admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:44.879483 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d59ea2-78ab-446c-9bb5-4660a883023c admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:44.879793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d59ea2-78ab-446c-9bb5-4660a883023c admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:44.880480 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d59ea2-78ab-446c-9bb5-4660a883023c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:44.882523 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d59ea2-78ab-446c-9bb5-4660a883023c admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:44.997127 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1153/2324] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:02:44 2022] POST /identity/v3/projects => generated 367 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:02:44.998957 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b20d67-1ec8-4f8e-bd27-a882be95d2bb None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:45.006729 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:02:45.012376 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b20d67-1ec8-4f8e-bd27-a882be95d2bb None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:45.091909 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ef88a-c7b1-4006-b40a-021389aed7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:45.092592 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ef88a-c7b1-4006-b40a-021389aed7d4 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:45.092878 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ef88a-c7b1-4006-b40a-021389aed7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:45.093205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ef88a-c7b1-4006-b40a-021389aed7d4 admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:45.093851 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ef88a-c7b1-4006-b40a-021389aed7d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:45.095862 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ef88a-c7b1-4006-b40a-021389aed7d4 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:45.209662 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1172/2325] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:02:44 2022] POST /identity/v3/users => generated 290 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:02:45.213937 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d59ea2-78ab-446c-9bb5-4660a883023c admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:45.224627 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d59ea2-78ab-446c-9bb5-4660a883023c admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:45.229197 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db5ec6-b91a-42e6-b46f-a89bdf9b9c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:45.229856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db5ec6-b91a-42e6-b46f-a89bdf9b9c9b admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:45.230141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db5ec6-b91a-42e6-b46f-a89bdf9b9c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:45.230464 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db5ec6-b91a-42e6-b46f-a89bdf9b9c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:45.231250 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db5ec6-b91a-42e6-b46f-a89bdf9b9c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:45.232880 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db5ec6-b91a-42e6-b46f-a89bdf9b9c9b admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:45.244086 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1154/2326] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:02:45.249497 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ef88a-c7b1-4006-b40a-021389aed7d4 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:45.260070 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ef88a-c7b1-4006-b40a-021389aed7d4 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:45.265364 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a9c30-d421-4061-8675-d9be09cdfd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:45.266246 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a9c30-d421-4061-8675-d9be09cdfd2c admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:45.266526 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a9c30-d421-4061-8675-d9be09cdfd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:45.266803 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a9c30-d421-4061-8675-d9be09cdfd2c admin admin] PATH_INFO: `/v3/projects/927f2d6b85334ffebb19df2670bd5448/users/9acf53f4fa5b4b2b8fd598ea8280dd33/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:45.281574 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a9c30-d421-4061-8675-d9be09cdfd2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=927f2d6b85334ffebb19df2670bd5448, user_id=9acf53f4fa5b4b2b8fd598ea8280dd33, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:45.284310 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a9c30-d421-4061-8675-d9be09cdfd2c admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:45.346175 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1173/2327] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:02:45 2022] PUT /identity/v3/projects/927f2d6b85334ffebb19df2670bd5448/users/9acf53f4fa5b4b2b8fd598ea8280dd33/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:02:45.350571 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db5ec6-b91a-42e6-b46f-a89bdf9b9c9b admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:45.361932 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db5ec6-b91a-42e6-b46f-a89bdf9b9c9b admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:45.422009 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775563b2-b990-4ac0-a6dd-cdc372c55ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:45.422778 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775563b2-b990-4ac0-a6dd-cdc372c55ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:45.423278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775563b2-b990-4ac0-a6dd-cdc372c55ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:45.423784 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775563b2-b990-4ac0-a6dd-cdc372c55ec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:45.424621 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775563b2-b990-4ac0-a6dd-cdc372c55ec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:45.426272 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775563b2-b990-4ac0-a6dd-cdc372c55ec8 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:45.441077 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1155/2328] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:02:45.446068 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a9c30-d421-4061-8675-d9be09cdfd2c admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:45.463035 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a9c30-d421-4061-8675-d9be09cdfd2c admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:45.470810 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee009e-2636-4b77-ace2-273434840084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:45.472392 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee009e-2636-4b77-ace2-273434840084 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:45.472928 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee009e-2636-4b77-ace2-273434840084 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:45.473396 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee009e-2636-4b77-ace2-273434840084 admin admin] PATH_INFO: `/v3/projects/927f2d6b85334ffebb19df2670bd5448/users/9acf53f4fa5b4b2b8fd598ea8280dd33/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:45.476676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee009e-2636-4b77-ace2-273434840084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=927f2d6b85334ffebb19df2670bd5448, user_id=9acf53f4fa5b4b2b8fd598ea8280dd33, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:45.482209 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee009e-2636-4b77-ace2-273434840084 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:45.496438 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1174/2329] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:02:45 2022] PUT /identity/v3/projects/927f2d6b85334ffebb19df2670bd5448/users/9acf53f4fa5b4b2b8fd598ea8280dd33/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:02:45.513304 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362509b-a33b-485e-8d1f-cf59eb6278db None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:45.513592 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362509b-a33b-485e-8d1f-cf59eb6278db None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:45.513871 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362509b-a33b-485e-8d1f-cf59eb6278db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:45.541519 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-3362509b-a33b-485e-8d1f-cf59eb6278db None None] MFA Rules not processed for user `9acf53f4fa5b4b2b8fd598ea8280dd33`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:02:45.542731 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-3362509b-a33b-485e-8d1f-cf59eb6278db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:45.548913 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:02:45.625585 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1156/2330] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:02:45 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:02:45.638146 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee009e-2636-4b77-ace2-273434840084 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:45.640808 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-bfee009e-2636-4b77-ace2-273434840084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:45.704847 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee009e-2636-4b77-ace2-273434840084 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:45.708609 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932555d-26bb-416c-bb16-3b9bd9959c69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:45.709260 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932555d-26bb-416c-bb16-3b9bd9959c69 service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:45.709541 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932555d-26bb-416c-bb16-3b9bd9959c69 service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:45.709823 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932555d-26bb-416c-bb16-3b9bd9959c69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:45.720184 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4932555d-26bb-416c-bb16-3b9bd9959c69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:45.722031 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4932555d-26bb-416c-bb16-3b9bd9959c69 service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:45.732768 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1175/2331] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:02:45 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:02:45.845019 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362509b-a33b-485e-8d1f-cf59eb6278db None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:45.847309 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-3362509b-a33b-485e-8d1f-cf59eb6278db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:45.869761 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362509b-a33b-485e-8d1f-cf59eb6278db None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:45.875072 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a60a2e-15e6-4d96-85e8-35590f623a7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:45.875976 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a60a2e-15e6-4d96-85e8-35590f623a7e service cinder] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:45.876383 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a60a2e-15e6-4d96-85e8-35590f623a7e service cinder] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:45.876781 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a60a2e-15e6-4d96-85e8-35590f623a7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:45.944590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a60a2e-15e6-4d96-85e8-35590f623a7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:45.946045 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a60a2e-15e6-4d96-85e8-35590f623a7e service cinder] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:45.957155 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1157/2332] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:02:45 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:02:47.646983 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932555d-26bb-416c-bb16-3b9bd9959c69 service cinder] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:47.648476 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-4932555d-26bb-416c-bb16-3b9bd9959c69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:47.717828 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932555d-26bb-416c-bb16-3b9bd9959c69 service cinder] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:47.724005 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417eeda3-1a75-497a-890c-449e20e4882a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:47.725151 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417eeda3-1a75-497a-890c-449e20e4882a service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:47.725660 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417eeda3-1a75-497a-890c-449e20e4882a service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:47.726179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417eeda3-1a75-497a-890c-449e20e4882a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:47.729247 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-417eeda3-1a75-497a-890c-449e20e4882a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:47.755794 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:02:47.819012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417eeda3-1a75-497a-890c-449e20e4882a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:47.820420 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417eeda3-1a75-497a-890c-449e20e4882a service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:47.830297 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1176/2333] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:02:47 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:02:51.214439 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a60a2e-15e6-4d96-85e8-35590f623a7e service cinder] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:51.312621 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a60a2e-15e6-4d96-85e8-35590f623a7e service cinder] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:51.317644 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584156e-12c2-4150-b573-556fca998b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:51.318537 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584156e-12c2-4150-b573-556fca998b9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:51.319654 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584156e-12c2-4150-b573-556fca998b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:51.319950 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584156e-12c2-4150-b573-556fca998b9b admin admin] PATH_INFO: `/v3/users/01b24573b27547ab9efd91acfb2802e7` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:51.321221 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1584156e-12c2-4150-b573-556fca998b9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=01b24573b27547ab9efd91acfb2802e7)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:51.323982 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1584156e-12c2-4150-b573-556fca998b9b admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:51.541328 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:02:51.544724 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-1584156e-12c2-4150-b573-556fca998b9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01b24573b27547ab9efd91acfb2802e7'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:51.552062 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-1584156e-12c2-4150-b573-556fca998b9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01b24573b27547ab9efd91acfb2802e7'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:51.552834 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-1584156e-12c2-4150-b573-556fca998b9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01b24573b27547ab9efd91acfb2802e7'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:51.576625 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-1584156e-12c2-4150-b573-556fca998b9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01b24573b27547ab9efd91acfb2802e7'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:51.633871 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-1584156e-12c2-4150-b573-556fca998b9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01b24573b27547ab9efd91acfb2802e7'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:51.649719 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1158/2334] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:02:51 2022] DELETE /identity/v3/users/01b24573b27547ab9efd91acfb2802e7 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:02:51.655697 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9e8c9-9444-4905-8768-4ad75cd41043 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:51.656336 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9e8c9-9444-4905-8768-4ad75cd41043 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:51.656336 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9e8c9-9444-4905-8768-4ad75cd41043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:51.675925 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-cda9e8c9-9444-4905-8768-4ad75cd41043 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:02:51.677289 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-cda9e8c9-9444-4905-8768-4ad75cd41043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:51.749200 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1177/2335] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:02:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:02:51.759183 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584156e-12c2-4150-b573-556fca998b9b admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:51.760627 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-1584156e-12c2-4150-b573-556fca998b9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:51.832877 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584156e-12c2-4150-b573-556fca998b9b admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:51.836808 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbaeee-5efb-45c7-b47f-34d574c12840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:51.837340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbaeee-5efb-45c7-b47f-34d574c12840 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:51.837628 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbaeee-5efb-45c7-b47f-34d574c12840 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:51.837909 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbaeee-5efb-45c7-b47f-34d574c12840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:51.849118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbaeee-5efb-45c7-b47f-34d574c12840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:51.850581 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbaeee-5efb-45c7-b47f-34d574c12840 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:51.862133 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1159/2336] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:02:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:02:52.344716 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9e8c9-9444-4905-8768-4ad75cd41043 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:52.346547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-cda9e8c9-9444-4905-8768-4ad75cd41043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:52.361722 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9e8c9-9444-4905-8768-4ad75cd41043 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:52.366994 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164081c9-528a-4438-8eee-4fb7839fab34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:52.368062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164081c9-528a-4438-8eee-4fb7839fab34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:52.371556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164081c9-528a-4438-8eee-4fb7839fab34 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:52.371556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164081c9-528a-4438-8eee-4fb7839fab34 admin admin] PATH_INFO: `/v3/projects/7603285afcfc4b769809bc9377f12f83` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:52.371556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164081c9-528a-4438-8eee-4fb7839fab34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7603285afcfc4b769809bc9377f12f83)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:52.372433 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164081c9-528a-4438-8eee-4fb7839fab34 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:52.506919 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-164081c9-528a-4438-8eee-4fb7839fab34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7603285afcfc4b769809bc9377f12f83', 'request_id': 'req-164081c9-528a-4438-8eee-4fb7839fab34'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:52.513367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-164081c9-528a-4438-8eee-4fb7839fab34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7603285afcfc4b769809bc9377f12f83', 'request_id': 'req-164081c9-528a-4438-8eee-4fb7839fab34'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:52.597541 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-164081c9-528a-4438-8eee-4fb7839fab34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7603285afcfc4b769809bc9377f12f83', 'request_id': 'req-164081c9-528a-4438-8eee-4fb7839fab34'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:52.610093 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-164081c9-528a-4438-8eee-4fb7839fab34 admin admin] The token cache is being invalidate because project 7603285afcfc4b769809bc9377f12f83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:02:52.610340 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-164081c9-528a-4438-8eee-4fb7839fab34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:52.613765 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-164081c9-528a-4438-8eee-4fb7839fab34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:52.613765 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1178/2337] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:02:52 2022] DELETE /identity/v3/projects/7603285afcfc4b769809bc9377f12f83 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:02:52.617163 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbaeee-5efb-45c7-b47f-34d574c12840 service neutron] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:52.629803 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbaeee-5efb-45c7-b47f-34d574c12840 service neutron] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:52.696240 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c280e-7ba3-4c72-849f-c8081c2084cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:52.697123 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c280e-7ba3-4c72-849f-c8081c2084cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:52.697410 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c280e-7ba3-4c72-849f-c8081c2084cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:52.697674 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c280e-7ba3-4c72-849f-c8081c2084cb admin admin] PATH_INFO: `/v3/users/9acf53f4fa5b4b2b8fd598ea8280dd33` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:52.698873 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c280e-7ba3-4c72-849f-c8081c2084cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9acf53f4fa5b4b2b8fd598ea8280dd33)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:52.701101 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c280e-7ba3-4c72-849f-c8081c2084cb admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:52.890335 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-100c280e-7ba3-4c72-849f-c8081c2084cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9acf53f4fa5b4b2b8fd598ea8280dd33'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:52.898164 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-100c280e-7ba3-4c72-849f-c8081c2084cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9acf53f4fa5b4b2b8fd598ea8280dd33'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:52.898961 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-100c280e-7ba3-4c72-849f-c8081c2084cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9acf53f4fa5b4b2b8fd598ea8280dd33'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:52.909752 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:02:52.919298 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-100c280e-7ba3-4c72-849f-c8081c2084cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9acf53f4fa5b4b2b8fd598ea8280dd33'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:53.015179 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-100c280e-7ba3-4c72-849f-c8081c2084cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9acf53f4fa5b4b2b8fd598ea8280dd33'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:53.025411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1160/2338] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:02:52 2022] DELETE /identity/v3/users/9acf53f4fa5b4b2b8fd598ea8280dd33 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:02:53.676712 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164081c9-528a-4438-8eee-4fb7839fab34 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:53.683071 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-164081c9-528a-4438-8eee-4fb7839fab34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:53.719924 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164081c9-528a-4438-8eee-4fb7839fab34 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:53.774855 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:02:53.805331 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28821f-160c-46b9-9448-428db96ae73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:53.806203 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28821f-160c-46b9-9448-428db96ae73f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:53.806484 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28821f-160c-46b9-9448-428db96ae73f admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:53.806760 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28821f-160c-46b9-9448-428db96ae73f admin admin] PATH_INFO: `/v3/projects/927f2d6b85334ffebb19df2670bd5448` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:53.808001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa28821f-160c-46b9-9448-428db96ae73f admin admin] RBAC: Authorizing `identity:delete_project(project_id=927f2d6b85334ffebb19df2670bd5448)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:53.810601 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa28821f-160c-46b9-9448-428db96ae73f admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:53.945805 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-fa28821f-160c-46b9-9448-428db96ae73f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '927f2d6b85334ffebb19df2670bd5448', 'request_id': 'req-fa28821f-160c-46b9-9448-428db96ae73f'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:53.956883 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-fa28821f-160c-46b9-9448-428db96ae73f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '927f2d6b85334ffebb19df2670bd5448', 'request_id': 'req-fa28821f-160c-46b9-9448-428db96ae73f'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:54.037365 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-fa28821f-160c-46b9-9448-428db96ae73f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '927f2d6b85334ffebb19df2670bd5448', 'request_id': 'req-fa28821f-160c-46b9-9448-428db96ae73f'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:54.050356 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-fa28821f-160c-46b9-9448-428db96ae73f admin admin] The token cache is being invalidate because project 927f2d6b85334ffebb19df2670bd5448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:02:54.050722 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-fa28821f-160c-46b9-9448-428db96ae73f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:54.051377 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-fa28821f-160c-46b9-9448-428db96ae73f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:02:54.053156 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1179/2339] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:02:53 2022] DELETE /identity/v3/projects/927f2d6b85334ffebb19df2670bd5448 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:02:54.058599 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3670a-a34f-4200-96cd-f45f8116025f None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:54.059222 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3670a-a34f-4200-96cd-f45f8116025f None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:54.059659 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3670a-a34f-4200-96cd-f45f8116025f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:54.078200 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-55a3670a-a34f-4200-96cd-f45f8116025f None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:02:54.079462 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-55a3670a-a34f-4200-96cd-f45f8116025f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:54.142763 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1161/2340] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:02:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:02:54.151010 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3427b-2a91-486a-8b85-fc08ec0ee88d None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:54.151688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3427b-2a91-486a-8b85-fc08ec0ee88d None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:54.162863 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3427b-2a91-486a-8b85-fc08ec0ee88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:54.172610 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-26b3427b-2a91-486a-8b85-fc08ec0ee88d None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:02:54.173853 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-26b3427b-2a91-486a-8b85-fc08ec0ee88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:54.182452 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1180/2341] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:02:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:02:54.186930 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a3670a-a34f-4200-96cd-f45f8116025f None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:54.197086 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a3670a-a34f-4200-96cd-f45f8116025f None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:54.201824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541d079-b881-4ca6-9b8d-493719ed1be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:54.202505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541d079-b881-4ca6-9b8d-493719ed1be3 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:54.202786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541d079-b881-4ca6-9b8d-493719ed1be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:54.203059 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541d079-b881-4ca6-9b8d-493719ed1be3 admin admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:54.203817 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8541d079-b881-4ca6-9b8d-493719ed1be3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:02:54.204122 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8541d079-b881-4ca6-9b8d-493719ed1be3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:54.205734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8541d079-b881-4ca6-9b8d-493719ed1be3 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:54.218795 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1162/2342] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 16:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:02:54.223354 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3427b-2a91-486a-8b85-fc08ec0ee88d None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:54.236329 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3427b-2a91-486a-8b85-fc08ec0ee88d None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:54.241620 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6469e8d-3233-4630-82cf-be7dd67b46c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:54.243276 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6469e8d-3233-4630-82cf-be7dd67b46c4 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:54.243276 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6469e8d-3233-4630-82cf-be7dd67b46c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:54.243276 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6469e8d-3233-4630-82cf-be7dd67b46c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:54.243760 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6469e8d-3233-4630-82cf-be7dd67b46c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:54.245844 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6469e8d-3233-4630-82cf-be7dd67b46c4 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:54.330921 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1181/2343] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:02:54 2022] POST /identity/v3/projects => generated 393 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:02:54.335278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541d079-b881-4ca6-9b8d-493719ed1be3 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:54.345673 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541d079-b881-4ca6-9b8d-493719ed1be3 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:54.401677 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3263c4-2d97-4235-a6f5-89a2b7d9cfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:54.402334 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3263c4-2d97-4235-a6f5-89a2b7d9cfa6 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:54.402666 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3263c4-2d97-4235-a6f5-89a2b7d9cfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:54.403076 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3263c4-2d97-4235-a6f5-89a2b7d9cfa6 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:54.404293 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3263c4-2d97-4235-a6f5-89a2b7d9cfa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:54.405908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3263c4-2d97-4235-a6f5-89a2b7d9cfa6 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:54.514286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1163/2344] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:02:54 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:02:54.518720 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6469e8d-3233-4630-82cf-be7dd67b46c4 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:54.530136 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6469e8d-3233-4630-82cf-be7dd67b46c4 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:54.535177 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9c2ba-71e4-4409-96fb-f868df7f7769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:54.535899 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9c2ba-71e4-4409-96fb-f868df7f7769 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:54.536185 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9c2ba-71e4-4409-96fb-f868df7f7769 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:54.542078 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9c2ba-71e4-4409-96fb-f868df7f7769 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:54.542078 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9c2ba-71e4-4409-96fb-f868df7f7769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:54.542078 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9c2ba-71e4-4409-96fb-f868df7f7769 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:54.550638 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1182/2345] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:02:54.555171 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3263c4-2d97-4235-a6f5-89a2b7d9cfa6 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:54.566188 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3263c4-2d97-4235-a6f5-89a2b7d9cfa6 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:54.570881 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f8564-01a5-4900-bf06-df31309ccca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:54.571537 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f8564-01a5-4900-bf06-df31309ccca7 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:54.571852 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f8564-01a5-4900-bf06-df31309ccca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:54.572125 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f8564-01a5-4900-bf06-df31309ccca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:54.572846 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f8564-01a5-4900-bf06-df31309ccca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:54.574621 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f8564-01a5-4900-bf06-df31309ccca7 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:54.584627 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1164/2346] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:02:54.589008 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9c2ba-71e4-4409-96fb-f868df7f7769 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:54.599930 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9c2ba-71e4-4409-96fb-f868df7f7769 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:54.604755 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e2d1d-d7b4-4d5b-a6e2-ba8db627f889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:54.606263 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e2d1d-d7b4-4d5b-a6e2-ba8db627f889 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:54.607262 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e2d1d-d7b4-4d5b-a6e2-ba8db627f889 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:54.607555 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e2d1d-d7b4-4d5b-a6e2-ba8db627f889 admin admin] PATH_INFO: `/v3/projects/0e90c685ff0e45fda1e1db251e650817/users/984deaa85cc94481907c60b4a01cf3cf/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:54.624046 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e2d1d-d7b4-4d5b-a6e2-ba8db627f889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e90c685ff0e45fda1e1db251e650817, user_id=984deaa85cc94481907c60b4a01cf3cf, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:54.626731 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e2d1d-d7b4-4d5b-a6e2-ba8db627f889 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:54.714222 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1183/2347] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:02:54 2022] PUT /identity/v3/projects/0e90c685ff0e45fda1e1db251e650817/users/984deaa85cc94481907c60b4a01cf3cf/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:02:54.725697 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cdf71-ac69-4a27-9146-d725e93ddd92 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:54.725989 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cdf71-ac69-4a27-9146-d725e93ddd92 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:54.726267 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cdf71-ac69-4a27-9146-d725e93ddd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:54.758980 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-3e2cdf71-ac69-4a27-9146-d725e93ddd92 None None] MFA Rules not processed for user `984deaa85cc94481907c60b4a01cf3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:02:54.760218 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-3e2cdf71-ac69-4a27-9146-d725e93ddd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:54.801433 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:02:54.830003 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1165/2348] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:02:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:02:54.834388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e2d1d-d7b4-4d5b-a6e2-ba8db627f889 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:54.898917 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e2d1d-d7b4-4d5b-a6e2-ba8db627f889 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:54.903967 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabc4c9-2a0b-432b-874e-c0914f868d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:54.904631 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabc4c9-2a0b-432b-874e-c0914f868d9b admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:54.904918 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabc4c9-2a0b-432b-874e-c0914f868d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:54.905200 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabc4c9-2a0b-432b-874e-c0914f868d9b admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:54.905902 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebabc4c9-2a0b-432b-874e-c0914f868d9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:54.907880 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebabc4c9-2a0b-432b-874e-c0914f868d9b admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:54.911051 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:02:55.045825 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1184/2349] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:02:54 2022] POST /identity/v3/projects => generated 393 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:02:55.049917 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cdf71-ac69-4a27-9146-d725e93ddd92 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:55.061809 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cdf71-ac69-4a27-9146-d725e93ddd92 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:55.119219 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50787b7-dca9-4aeb-8c0d-2eadc6a2f3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:55.119932 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50787b7-dca9-4aeb-8c0d-2eadc6a2f3b8 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:55.120217 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50787b7-dca9-4aeb-8c0d-2eadc6a2f3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:55.120495 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50787b7-dca9-4aeb-8c0d-2eadc6a2f3b8 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:55.121794 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50787b7-dca9-4aeb-8c0d-2eadc6a2f3b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:55.123946 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50787b7-dca9-4aeb-8c0d-2eadc6a2f3b8 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:55.222536 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1166/2350] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:02:55 2022] POST /identity/v3/users => generated 303 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:02:55.226690 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabc4c9-2a0b-432b-874e-c0914f868d9b admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:55.238159 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabc4c9-2a0b-432b-874e-c0914f868d9b admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:55.242869 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518de048-fa78-433d-96aa-f9ee7cd4f37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:55.243570 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518de048-fa78-433d-96aa-f9ee7cd4f37e admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:55.243884 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518de048-fa78-433d-96aa-f9ee7cd4f37e admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:55.244161 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518de048-fa78-433d-96aa-f9ee7cd4f37e admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:55.244886 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518de048-fa78-433d-96aa-f9ee7cd4f37e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:55.246542 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518de048-fa78-433d-96aa-f9ee7cd4f37e admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:55.258483 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1185/2351] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:02:55.263400 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50787b7-dca9-4aeb-8c0d-2eadc6a2f3b8 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:55.273802 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50787b7-dca9-4aeb-8c0d-2eadc6a2f3b8 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:55.278959 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e216b00-f64d-4698-9c81-74d5eca8d5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:55.279867 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e216b00-f64d-4698-9c81-74d5eca8d5db admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:55.280158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e216b00-f64d-4698-9c81-74d5eca8d5db admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:55.280463 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e216b00-f64d-4698-9c81-74d5eca8d5db admin admin] PATH_INFO: `/v3/projects/d5e1f099378044d58d54fef49eb435d3/users/830a3bc8a9284b97b521b2f745d09a15/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:55.296482 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e216b00-f64d-4698-9c81-74d5eca8d5db admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e1f099378044d58d54fef49eb435d3, user_id=830a3bc8a9284b97b521b2f745d09a15, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:55.299157 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e216b00-f64d-4698-9c81-74d5eca8d5db admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:55.406236 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1167/2352] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:02:55 2022] PUT /identity/v3/projects/d5e1f099378044d58d54fef49eb435d3/users/830a3bc8a9284b97b521b2f745d09a15/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:02:55.410191 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518de048-fa78-433d-96aa-f9ee7cd4f37e admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:55.421289 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518de048-fa78-433d-96aa-f9ee7cd4f37e admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:55.479759 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b395d5-44f0-44d1-80f1-6e1efbf6a30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:55.480429 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b395d5-44f0-44d1-80f1-6e1efbf6a30f admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:55.480713 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b395d5-44f0-44d1-80f1-6e1efbf6a30f admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:55.481577 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b395d5-44f0-44d1-80f1-6e1efbf6a30f admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:55.482470 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b395d5-44f0-44d1-80f1-6e1efbf6a30f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:55.484093 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b395d5-44f0-44d1-80f1-6e1efbf6a30f admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:55.494168 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1186/2353] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:02:55.498979 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e216b00-f64d-4698-9c81-74d5eca8d5db admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:55.509579 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e216b00-f64d-4698-9c81-74d5eca8d5db admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:55.514948 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443608ff-bb40-4817-9b31-4b6acefd6a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:55.515875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443608ff-bb40-4817-9b31-4b6acefd6a25 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:55.516163 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443608ff-bb40-4817-9b31-4b6acefd6a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:55.516440 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443608ff-bb40-4817-9b31-4b6acefd6a25 admin admin] PATH_INFO: `/v3/projects/d5e1f099378044d58d54fef49eb435d3/users/830a3bc8a9284b97b521b2f745d09a15/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:55.518425 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443608ff-bb40-4817-9b31-4b6acefd6a25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e1f099378044d58d54fef49eb435d3, user_id=830a3bc8a9284b97b521b2f745d09a15, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:55.521119 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443608ff-bb40-4817-9b31-4b6acefd6a25 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:55.533076 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1168/2354] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:02:55 2022] PUT /identity/v3/projects/d5e1f099378044d58d54fef49eb435d3/users/830a3bc8a9284b97b521b2f745d09a15/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:02:55.545228 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a5291-71b9-40b6-8299-cc7b814fd36e None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:55.545521 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a5291-71b9-40b6-8299-cc7b814fd36e None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:55.545801 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a5291-71b9-40b6-8299-cc7b814fd36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:55.572859 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-1e1a5291-71b9-40b6-8299-cc7b814fd36e None None] MFA Rules not processed for user `830a3bc8a9284b97b521b2f745d09a15`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:02:55.574064 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-1e1a5291-71b9-40b6-8299-cc7b814fd36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:55.641481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1187/2355] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:02:55 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:02:55.652095 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443608ff-bb40-4817-9b31-4b6acefd6a25 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:55.654302 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-443608ff-bb40-4817-9b31-4b6acefd6a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:55.720341 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443608ff-bb40-4817-9b31-4b6acefd6a25 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:55.723965 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230457ad-d2b0-489e-8cd6-6db3ce843b32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:55.724611 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230457ad-d2b0-489e-8cd6-6db3ce843b32 service cinder] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:55.724893 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230457ad-d2b0-489e-8cd6-6db3ce843b32 service cinder] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:55.725170 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230457ad-d2b0-489e-8cd6-6db3ce843b32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:55.734916 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230457ad-d2b0-489e-8cd6-6db3ce843b32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:55.736406 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230457ad-d2b0-489e-8cd6-6db3ce843b32 service cinder] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:55.745759 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1169/2356] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:02:55 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:02:55.790090 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a5291-71b9-40b6-8299-cc7b814fd36e None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:02:55.791460 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-1e1a5291-71b9-40b6-8299-cc7b814fd36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:02:55.804503 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a5291-71b9-40b6-8299-cc7b814fd36e None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:02:55.808218 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bfa5ea-2b58-46ff-a33a-00decb6bd32b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:02:55.808859 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bfa5ea-2b58-46ff-a33a-00decb6bd32b service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:02:55.809187 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bfa5ea-2b58-46ff-a33a-00decb6bd32b service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:02:55.809469 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bfa5ea-2b58-46ff-a33a-00decb6bd32b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:02:55.864199 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:02:55.867888 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bfa5ea-2b58-46ff-a33a-00decb6bd32b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:02:55.869351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bfa5ea-2b58-46ff-a33a-00decb6bd32b service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:02:55.878480 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1188/2357] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:02:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:03:01.559928 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230457ad-d2b0-489e-8cd6-6db3ce843b32 service cinder] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:01.594819 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:03:01.621806 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230457ad-d2b0-489e-8cd6-6db3ce843b32 service cinder] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:01.626362 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32897f-1832-4444-a7d7-82c8033d6d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:01.627459 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32897f-1832-4444-a7d7-82c8033d6d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:01.627826 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32897f-1832-4444-a7d7-82c8033d6d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:01.628264 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32897f-1832-4444-a7d7-82c8033d6d94 admin admin] PATH_INFO: `/v3/users/984deaa85cc94481907c60b4a01cf3cf` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:01.629730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad32897f-1832-4444-a7d7-82c8033d6d94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=984deaa85cc94481907c60b4a01cf3cf)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:01.631665 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad32897f-1832-4444-a7d7-82c8033d6d94 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:01.793709 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-ad32897f-1832-4444-a7d7-82c8033d6d94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '984deaa85cc94481907c60b4a01cf3cf'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:01.800888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-ad32897f-1832-4444-a7d7-82c8033d6d94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '984deaa85cc94481907c60b4a01cf3cf'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:01.801539 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-ad32897f-1832-4444-a7d7-82c8033d6d94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '984deaa85cc94481907c60b4a01cf3cf'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:01.813690 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-ad32897f-1832-4444-a7d7-82c8033d6d94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '984deaa85cc94481907c60b4a01cf3cf'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:01.894060 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-ad32897f-1832-4444-a7d7-82c8033d6d94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '984deaa85cc94481907c60b4a01cf3cf'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:01.900575 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1170/2358] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:03:01 2022] DELETE /identity/v3/users/984deaa85cc94481907c60b4a01cf3cf => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:03:01.905700 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec204efe-2cf8-45e4-acfe-cc4411f789a1 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:01.909809 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec204efe-2cf8-45e4-acfe-cc4411f789a1 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:01.909809 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec204efe-2cf8-45e4-acfe-cc4411f789a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:01.923425 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-ec204efe-2cf8-45e4-acfe-cc4411f789a1 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:03:01.924839 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-ec204efe-2cf8-45e4-acfe-cc4411f789a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:03:01.984355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1189/2359] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:03:01.993971 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32897f-1832-4444-a7d7-82c8033d6d94 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:01.995383 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-ad32897f-1832-4444-a7d7-82c8033d6d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:03:02.052561 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32897f-1832-4444-a7d7-82c8033d6d94 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:02.056423 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62ac88-c19c-48db-9f46-66403d249041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:02.057058 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62ac88-c19c-48db-9f46-66403d249041 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:02.057339 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62ac88-c19c-48db-9f46-66403d249041 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:02.057610 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62ac88-c19c-48db-9f46-66403d249041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:02.068036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b62ac88-c19c-48db-9f46-66403d249041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:02.069508 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b62ac88-c19c-48db-9f46-66403d249041 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:02.079774 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1171/2360] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:03:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:03:02.583477 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec204efe-2cf8-45e4-acfe-cc4411f789a1 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:02.584918 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-ec204efe-2cf8-45e4-acfe-cc4411f789a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:03:02.598029 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec204efe-2cf8-45e4-acfe-cc4411f789a1 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:02.605265 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8f1a4-3cf0-44cf-bfeb-a7f17892ca9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:02.605265 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8f1a4-3cf0-44cf-bfeb-a7f17892ca9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:02.605265 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8f1a4-3cf0-44cf-bfeb-a7f17892ca9f admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:02.605265 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8f1a4-3cf0-44cf-bfeb-a7f17892ca9f admin admin] PATH_INFO: `/v3/projects/0e90c685ff0e45fda1e1db251e650817` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:02.605694 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8f1a4-3cf0-44cf-bfeb-a7f17892ca9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e90c685ff0e45fda1e1db251e650817)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:02.607813 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8f1a4-3cf0-44cf-bfeb-a7f17892ca9f admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:02.741629 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7aa8f1a4-3cf0-44cf-bfeb-a7f17892ca9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e90c685ff0e45fda1e1db251e650817', 'request_id': 'req-7aa8f1a4-3cf0-44cf-bfeb-a7f17892ca9f'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:02.751803 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7aa8f1a4-3cf0-44cf-bfeb-a7f17892ca9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e90c685ff0e45fda1e1db251e650817', 'request_id': 'req-7aa8f1a4-3cf0-44cf-bfeb-a7f17892ca9f'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:02.825937 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7aa8f1a4-3cf0-44cf-bfeb-a7f17892ca9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e90c685ff0e45fda1e1db251e650817', 'request_id': 'req-7aa8f1a4-3cf0-44cf-bfeb-a7f17892ca9f'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:02.842063 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7aa8f1a4-3cf0-44cf-bfeb-a7f17892ca9f admin admin] The token cache is being invalidate because project 0e90c685ff0e45fda1e1db251e650817 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:03:02.842063 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7aa8f1a4-3cf0-44cf-bfeb-a7f17892ca9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:02.842063 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7aa8f1a4-3cf0-44cf-bfeb-a7f17892ca9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:02.842063 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1190/2361] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:03:02 2022] DELETE /identity/v3/projects/0e90c685ff0e45fda1e1db251e650817 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:03:02.844538 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62ac88-c19c-48db-9f46-66403d249041 service neutron] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:02.854237 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62ac88-c19c-48db-9f46-66403d249041 service neutron] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:02.904750 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:03:02.911489 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a52a3f-679f-43ae-90be-b556f76d1e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:02.916579 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a52a3f-679f-43ae-90be-b556f76d1e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:02.916579 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a52a3f-679f-43ae-90be-b556f76d1e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:02.916579 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a52a3f-679f-43ae-90be-b556f76d1e5d admin admin] PATH_INFO: `/v3/users/830a3bc8a9284b97b521b2f745d09a15` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:02.916579 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a52a3f-679f-43ae-90be-b556f76d1e5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=830a3bc8a9284b97b521b2f745d09a15)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:02.916579 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a52a3f-679f-43ae-90be-b556f76d1e5d admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:03.161127 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-86a52a3f-679f-43ae-90be-b556f76d1e5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '830a3bc8a9284b97b521b2f745d09a15'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:03.167934 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-86a52a3f-679f-43ae-90be-b556f76d1e5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '830a3bc8a9284b97b521b2f745d09a15'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:03.168594 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-86a52a3f-679f-43ae-90be-b556f76d1e5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '830a3bc8a9284b97b521b2f745d09a15'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:03.181090 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-86a52a3f-679f-43ae-90be-b556f76d1e5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '830a3bc8a9284b97b521b2f745d09a15'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:03.250343 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-86a52a3f-679f-43ae-90be-b556f76d1e5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '830a3bc8a9284b97b521b2f745d09a15'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:03.256991 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1172/2362] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:03:02 2022] DELETE /identity/v3/users/830a3bc8a9284b97b521b2f745d09a15 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:03:03.880016 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8f1a4-3cf0-44cf-bfeb-a7f17892ca9f admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:03.881576 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-7aa8f1a4-3cf0-44cf-bfeb-a7f17892ca9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:03:03.896314 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8f1a4-3cf0-44cf-bfeb-a7f17892ca9f admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:03.954142 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86199c0-cdef-4627-994a-e071d95ea8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:03.955103 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86199c0-cdef-4627-994a-e071d95ea8c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:03.955388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86199c0-cdef-4627-994a-e071d95ea8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:03.955703 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86199c0-cdef-4627-994a-e071d95ea8c9 admin admin] PATH_INFO: `/v3/projects/d5e1f099378044d58d54fef49eb435d3` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:03.956915 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86199c0-cdef-4627-994a-e071d95ea8c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5e1f099378044d58d54fef49eb435d3)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:03.958871 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86199c0-cdef-4627-994a-e071d95ea8c9 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:03.979830 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:03:04.049247 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-b86199c0-cdef-4627-994a-e071d95ea8c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5e1f099378044d58d54fef49eb435d3', 'request_id': 'req-b86199c0-cdef-4627-994a-e071d95ea8c9'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:04.055683 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-b86199c0-cdef-4627-994a-e071d95ea8c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5e1f099378044d58d54fef49eb435d3', 'request_id': 'req-b86199c0-cdef-4627-994a-e071d95ea8c9'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:04.118555 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-b86199c0-cdef-4627-994a-e071d95ea8c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5e1f099378044d58d54fef49eb435d3', 'request_id': 'req-b86199c0-cdef-4627-994a-e071d95ea8c9'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:04.130509 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-b86199c0-cdef-4627-994a-e071d95ea8c9 admin admin] The token cache is being invalidate because project d5e1f099378044d58d54fef49eb435d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:03:04.131212 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-b86199c0-cdef-4627-994a-e071d95ea8c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:04.131406 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-b86199c0-cdef-4627-994a-e071d95ea8c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:04.133001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1191/2363] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:03:03 2022] DELETE /identity/v3/projects/d5e1f099378044d58d54fef49eb435d3 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:03:04.139271 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35fc4d-d7c3-41b5-b31c-366401bda6d2 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:04.139806 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35fc4d-d7c3-41b5-b31c-366401bda6d2 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:04.139914 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35fc4d-d7c3-41b5-b31c-366401bda6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:04.158506 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-ac35fc4d-d7c3-41b5-b31c-366401bda6d2 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:03:04.159734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-ac35fc4d-d7c3-41b5-b31c-366401bda6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:03:04.220322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1173/2364] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:03:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:03:04.228321 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897a39e-3e93-4465-9570-8f87e36394f7 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:04.228704 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897a39e-3e93-4465-9570-8f87e36394f7 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:04.229088 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897a39e-3e93-4465-9570-8f87e36394f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:04.247699 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-0897a39e-3e93-4465-9570-8f87e36394f7 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:03:04.248848 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-0897a39e-3e93-4465-9570-8f87e36394f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:03:04.257025 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1192/2365] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:03:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:03:04.261277 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35fc4d-d7c3-41b5-b31c-366401bda6d2 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:04.271412 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35fc4d-d7c3-41b5-b31c-366401bda6d2 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:04.275982 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a333bc6-c3b5-4214-916f-c44afa356723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:04.276625 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a333bc6-c3b5-4214-916f-c44afa356723 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:04.276912 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a333bc6-c3b5-4214-916f-c44afa356723 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:04.277189 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a333bc6-c3b5-4214-916f-c44afa356723 admin admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:04.277915 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a333bc6-c3b5-4214-916f-c44afa356723 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:03:04.278223 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a333bc6-c3b5-4214-916f-c44afa356723 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:04.280626 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a333bc6-c3b5-4214-916f-c44afa356723 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:04.292190 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1174/2366] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 16:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:03:04.296409 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897a39e-3e93-4465-9570-8f87e36394f7 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:04.306008 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897a39e-3e93-4465-9570-8f87e36394f7 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:04.310798 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d35c80-de6c-425d-be29-546c42430535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:04.311442 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d35c80-de6c-425d-be29-546c42430535 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:04.311771 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d35c80-de6c-425d-be29-546c42430535 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:04.312053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d35c80-de6c-425d-be29-546c42430535 admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:04.312761 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d35c80-de6c-425d-be29-546c42430535 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:04.314642 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d35c80-de6c-425d-be29-546c42430535 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:04.469076 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1193/2367] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:03:04 2022] POST /identity/v3/projects => generated 409 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:03:04.473344 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a333bc6-c3b5-4214-916f-c44afa356723 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:04.483721 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a333bc6-c3b5-4214-916f-c44afa356723 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:04.539379 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b50a4-fea2-4415-bd83-4ebdf760b116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:04.540009 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b50a4-fea2-4415-bd83-4ebdf760b116 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:04.540290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b50a4-fea2-4415-bd83-4ebdf760b116 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:04.540561 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b50a4-fea2-4415-bd83-4ebdf760b116 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:04.541244 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b50a4-fea2-4415-bd83-4ebdf760b116 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:04.543159 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b50a4-fea2-4415-bd83-4ebdf760b116 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:04.550730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:03:04.655360 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1175/2368] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:03:04 2022] POST /identity/v3/users => generated 305 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:03:04.659470 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d35c80-de6c-425d-be29-546c42430535 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:04.669696 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d35c80-de6c-425d-be29-546c42430535 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:04.674516 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585b436-9af5-4ec0-a51a-2b131adfd861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:04.675183 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585b436-9af5-4ec0-a51a-2b131adfd861 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:04.675470 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585b436-9af5-4ec0-a51a-2b131adfd861 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:04.675863 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585b436-9af5-4ec0-a51a-2b131adfd861 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:04.676619 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0585b436-9af5-4ec0-a51a-2b131adfd861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:04.678223 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0585b436-9af5-4ec0-a51a-2b131adfd861 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:04.689908 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1194/2369] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:03:04.693825 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b50a4-fea2-4415-bd83-4ebdf760b116 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:04.704419 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b50a4-fea2-4415-bd83-4ebdf760b116 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:04.709140 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0d91b-ad67-460b-99fc-2c645c21c6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:04.709780 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0d91b-ad67-460b-99fc-2c645c21c6ac admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:04.710064 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0d91b-ad67-460b-99fc-2c645c21c6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:04.710340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0d91b-ad67-460b-99fc-2c645c21c6ac admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:04.711076 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0d91b-ad67-460b-99fc-2c645c21c6ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:04.713491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0d91b-ad67-460b-99fc-2c645c21c6ac admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:04.723574 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1176/2370] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:03:04.727186 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585b436-9af5-4ec0-a51a-2b131adfd861 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:04.737058 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585b436-9af5-4ec0-a51a-2b131adfd861 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:04.741616 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3057c8c-ad22-4da1-a4c7-7283e0c7a5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:04.742482 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3057c8c-ad22-4da1-a4c7-7283e0c7a5a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:04.742762 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3057c8c-ad22-4da1-a4c7-7283e0c7a5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:04.743037 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3057c8c-ad22-4da1-a4c7-7283e0c7a5a6 admin admin] PATH_INFO: `/v3/projects/378133e9a3bc41b5b8884bd6a54d214b/users/3164d822d8ae4687bf3c8379908b9820/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:04.758233 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3057c8c-ad22-4da1-a4c7-7283e0c7a5a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=378133e9a3bc41b5b8884bd6a54d214b, user_id=3164d822d8ae4687bf3c8379908b9820, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:04.760915 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3057c8c-ad22-4da1-a4c7-7283e0c7a5a6 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:04.843136 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1195/2371] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:03:04 2022] PUT /identity/v3/projects/378133e9a3bc41b5b8884bd6a54d214b/users/3164d822d8ae4687bf3c8379908b9820/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:03:04.854339 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339a819-83a0-47bd-b159-2de65d5da49d None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:04.854630 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339a819-83a0-47bd-b159-2de65d5da49d None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:04.854905 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339a819-83a0-47bd-b159-2de65d5da49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:04.887349 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-7339a819-83a0-47bd-b159-2de65d5da49d None None] MFA Rules not processed for user `3164d822d8ae4687bf3c8379908b9820`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:03:04.888610 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-7339a819-83a0-47bd-b159-2de65d5da49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:03:04.962322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1177/2372] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:03:04 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:03:04.967091 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3057c8c-ad22-4da1-a4c7-7283e0c7a5a6 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:05.029353 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3057c8c-ad22-4da1-a4c7-7283e0c7a5a6 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:05.034146 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89608886-621d-4ef8-9066-4919e52f1089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:05.034799 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89608886-621d-4ef8-9066-4919e52f1089 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:05.035082 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89608886-621d-4ef8-9066-4919e52f1089 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:05.035356 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89608886-621d-4ef8-9066-4919e52f1089 admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:05.036080 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89608886-621d-4ef8-9066-4919e52f1089 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:05.038083 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89608886-621d-4ef8-9066-4919e52f1089 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:05.120316 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1196/2373] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:03:04 2022] POST /identity/v3/projects => generated 409 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:03:05.124883 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339a819-83a0-47bd-b159-2de65d5da49d None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:05.135763 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339a819-83a0-47bd-b159-2de65d5da49d None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:05.190480 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059de262-756c-43b0-8ba9-42844c38f753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:05.191165 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059de262-756c-43b0-8ba9-42844c38f753 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:05.191413 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059de262-756c-43b0-8ba9-42844c38f753 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:05.191723 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059de262-756c-43b0-8ba9-42844c38f753 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:05.192415 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059de262-756c-43b0-8ba9-42844c38f753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:05.194348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059de262-756c-43b0-8ba9-42844c38f753 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:05.273449 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1178/2374] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:03:05 2022] POST /identity/v3/users => generated 311 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:03:05.277460 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89608886-621d-4ef8-9066-4919e52f1089 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:05.288646 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89608886-621d-4ef8-9066-4919e52f1089 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:05.293300 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ade64f-f7f2-46e7-8557-bf428a0356f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:05.293959 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ade64f-f7f2-46e7-8557-bf428a0356f4 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:05.294987 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ade64f-f7f2-46e7-8557-bf428a0356f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:05.295281 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ade64f-f7f2-46e7-8557-bf428a0356f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:05.296049 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ade64f-f7f2-46e7-8557-bf428a0356f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:05.297648 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ade64f-f7f2-46e7-8557-bf428a0356f4 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:05.308255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1197/2375] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:03:05.312600 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059de262-756c-43b0-8ba9-42844c38f753 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:05.322558 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059de262-756c-43b0-8ba9-42844c38f753 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:05.327340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59577e11-6e72-46b3-9913-58e9826e4851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:05.328238 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59577e11-6e72-46b3-9913-58e9826e4851 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:05.328520 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59577e11-6e72-46b3-9913-58e9826e4851 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:05.328801 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59577e11-6e72-46b3-9913-58e9826e4851 admin admin] PATH_INFO: `/v3/projects/eec44b52d2814c79a7d7091fa1928960/users/a381a8a97ec14247925f3da477a4d40e/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:05.343787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59577e11-6e72-46b3-9913-58e9826e4851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec44b52d2814c79a7d7091fa1928960, user_id=a381a8a97ec14247925f3da477a4d40e, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:05.346444 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59577e11-6e72-46b3-9913-58e9826e4851 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:05.405112 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1179/2376] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:03:05 2022] PUT /identity/v3/projects/eec44b52d2814c79a7d7091fa1928960/users/a381a8a97ec14247925f3da477a4d40e/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:03:05.409109 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ade64f-f7f2-46e7-8557-bf428a0356f4 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:05.419966 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ade64f-f7f2-46e7-8557-bf428a0356f4 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:05.432363 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:03:05.477487 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424ce13-e318-42e3-8c49-defd519877f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:05.478159 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424ce13-e318-42e3-8c49-defd519877f6 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:05.478448 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424ce13-e318-42e3-8c49-defd519877f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:05.478752 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424ce13-e318-42e3-8c49-defd519877f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:05.479485 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424ce13-e318-42e3-8c49-defd519877f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:05.481191 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424ce13-e318-42e3-8c49-defd519877f6 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:05.491717 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1198/2377] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:03:05.495801 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59577e11-6e72-46b3-9913-58e9826e4851 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:05.506121 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59577e11-6e72-46b3-9913-58e9826e4851 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:05.510915 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa4cc0-a7be-4a5a-8b2f-3f4e48cd6202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:05.511853 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa4cc0-a7be-4a5a-8b2f-3f4e48cd6202 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:05.512132 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa4cc0-a7be-4a5a-8b2f-3f4e48cd6202 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:05.512404 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa4cc0-a7be-4a5a-8b2f-3f4e48cd6202 admin admin] PATH_INFO: `/v3/projects/eec44b52d2814c79a7d7091fa1928960/users/a381a8a97ec14247925f3da477a4d40e/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:05.514852 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa4cc0-a7be-4a5a-8b2f-3f4e48cd6202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec44b52d2814c79a7d7091fa1928960, user_id=a381a8a97ec14247925f3da477a4d40e, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:05.517523 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa4cc0-a7be-4a5a-8b2f-3f4e48cd6202 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:05.528005 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1180/2378] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:03:05 2022] PUT /identity/v3/projects/eec44b52d2814c79a7d7091fa1928960/users/a381a8a97ec14247925f3da477a4d40e/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:03:05.538696 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c225e0-d5af-4e4e-8d85-cfb48ccd0536 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:05.538990 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c225e0-d5af-4e4e-8d85-cfb48ccd0536 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:05.539301 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c225e0-d5af-4e4e-8d85-cfb48ccd0536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:05.566582 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-04c225e0-d5af-4e4e-8d85-cfb48ccd0536 None None] MFA Rules not processed for user `a381a8a97ec14247925f3da477a4d40e`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:03:05.567830 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-04c225e0-d5af-4e4e-8d85-cfb48ccd0536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:03:05.635450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1199/2379] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:03:05 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:03:05.646511 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa4cc0-a7be-4a5a-8b2f-3f4e48cd6202 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:05.648207 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-bffa4cc0-a7be-4a5a-8b2f-3f4e48cd6202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:03:05.674422 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:03:05.705538 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa4cc0-a7be-4a5a-8b2f-3f4e48cd6202 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:05.709778 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55dcd1-9097-4691-ab55-f15a83926a12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:05.710451 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55dcd1-9097-4691-ab55-f15a83926a12 service cinder] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:05.710737 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55dcd1-9097-4691-ab55-f15a83926a12 service cinder] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:05.711014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55dcd1-9097-4691-ab55-f15a83926a12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:05.721289 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc55dcd1-9097-4691-ab55-f15a83926a12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:05.726714 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc55dcd1-9097-4691-ab55-f15a83926a12 service cinder] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:05.732158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1181/2380] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:03:05 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:03:06.101001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c225e0-d5af-4e4e-8d85-cfb48ccd0536 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:06.109925 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c225e0-d5af-4e4e-8d85-cfb48ccd0536 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:06.113528 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afacb5-f626-4293-9529-2e2f1322323a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:06.114255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afacb5-f626-4293-9529-2e2f1322323a service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:06.114538 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afacb5-f626-4293-9529-2e2f1322323a service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:06.114819 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afacb5-f626-4293-9529-2e2f1322323a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:06.170975 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1afacb5-f626-4293-9529-2e2f1322323a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:06.172440 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1afacb5-f626-4293-9529-2e2f1322323a service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:06.181497 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1200/2381] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:03:06 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:03:13.086363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55dcd1-9097-4691-ab55-f15a83926a12 service cinder] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:13.146714 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55dcd1-9097-4691-ab55-f15a83926a12 service cinder] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:13.151107 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487ad26-78e3-4b49-a88d-65144ac5e684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:13.151995 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487ad26-78e3-4b49-a88d-65144ac5e684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:13.152276 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487ad26-78e3-4b49-a88d-65144ac5e684 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:13.152551 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487ad26-78e3-4b49-a88d-65144ac5e684 admin admin] PATH_INFO: `/v3/users/3164d822d8ae4687bf3c8379908b9820` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:13.154385 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d487ad26-78e3-4b49-a88d-65144ac5e684 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3164d822d8ae4687bf3c8379908b9820)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:13.156333 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d487ad26-78e3-4b49-a88d-65144ac5e684 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:13.312995 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-d487ad26-78e3-4b49-a88d-65144ac5e684 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3164d822d8ae4687bf3c8379908b9820'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:13.319999 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-d487ad26-78e3-4b49-a88d-65144ac5e684 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3164d822d8ae4687bf3c8379908b9820'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:13.320692 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-d487ad26-78e3-4b49-a88d-65144ac5e684 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3164d822d8ae4687bf3c8379908b9820'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:13.333223 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-d487ad26-78e3-4b49-a88d-65144ac5e684 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3164d822d8ae4687bf3c8379908b9820'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:13.425508 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-d487ad26-78e3-4b49-a88d-65144ac5e684 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3164d822d8ae4687bf3c8379908b9820'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:13.432431 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1182/2382] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:03:13 2022] DELETE /identity/v3/users/3164d822d8ae4687bf3c8379908b9820 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:03:13.437556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2f703-7046-44f6-acf7-960d08bbee4d None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:13.438046 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2f703-7046-44f6-acf7-960d08bbee4d None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:13.438158 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2f703-7046-44f6-acf7-960d08bbee4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:13.455954 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-3cd2f703-7046-44f6-acf7-960d08bbee4d None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:03:13.457175 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-3cd2f703-7046-44f6-acf7-960d08bbee4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:03:13.490171 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:03:13.518172 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1201/2383] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:03:13.527953 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487ad26-78e3-4b49-a88d-65144ac5e684 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:13.529563 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-d487ad26-78e3-4b49-a88d-65144ac5e684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:03:13.582028 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:03:13.592794 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487ad26-78e3-4b49-a88d-65144ac5e684 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:13.596552 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7803d3f-91d7-47c6-9c87-d5a271abc565 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:13.597194 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7803d3f-91d7-47c6-9c87-d5a271abc565 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:13.597477 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7803d3f-91d7-47c6-9c87-d5a271abc565 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:13.597754 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7803d3f-91d7-47c6-9c87-d5a271abc565 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:13.607013 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7803d3f-91d7-47c6-9c87-d5a271abc565 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:13.608562 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7803d3f-91d7-47c6-9c87-d5a271abc565 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:13.618017 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1183/2384] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:03:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:03:13.998591 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2f703-7046-44f6-acf7-960d08bbee4d None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:14.000211 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-3cd2f703-7046-44f6-acf7-960d08bbee4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:03:14.013607 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2f703-7046-44f6-acf7-960d08bbee4d None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:14.018549 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372a791-1479-4bea-bf7a-2f810ea0a722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:14.019444 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372a791-1479-4bea-bf7a-2f810ea0a722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:14.019754 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372a791-1479-4bea-bf7a-2f810ea0a722 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:14.020542 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372a791-1479-4bea-bf7a-2f810ea0a722 admin admin] PATH_INFO: `/v3/projects/378133e9a3bc41b5b8884bd6a54d214b` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:14.021924 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6372a791-1479-4bea-bf7a-2f810ea0a722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=378133e9a3bc41b5b8884bd6a54d214b)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:14.023927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6372a791-1479-4bea-bf7a-2f810ea0a722 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:14.163497 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-6372a791-1479-4bea-bf7a-2f810ea0a722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '378133e9a3bc41b5b8884bd6a54d214b', 'request_id': 'req-6372a791-1479-4bea-bf7a-2f810ea0a722'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:14.170582 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-6372a791-1479-4bea-bf7a-2f810ea0a722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '378133e9a3bc41b5b8884bd6a54d214b', 'request_id': 'req-6372a791-1479-4bea-bf7a-2f810ea0a722'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:14.248375 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-6372a791-1479-4bea-bf7a-2f810ea0a722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '378133e9a3bc41b5b8884bd6a54d214b', 'request_id': 'req-6372a791-1479-4bea-bf7a-2f810ea0a722'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:14.259289 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-6372a791-1479-4bea-bf7a-2f810ea0a722 admin admin] The token cache is being invalidate because project 378133e9a3bc41b5b8884bd6a54d214b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:03:14.259580 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-6372a791-1479-4bea-bf7a-2f810ea0a722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:14.260235 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-6372a791-1479-4bea-bf7a-2f810ea0a722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:14.261783 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1202/2385] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:03:13 2022] DELETE /identity/v3/projects/378133e9a3bc41b5b8884bd6a54d214b => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:03:14.268764 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7803d3f-91d7-47c6-9c87-d5a271abc565 service neutron] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:14.275467 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7803d3f-91d7-47c6-9c87-d5a271abc565 service neutron] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:14.332156 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596e537-9d2b-4c89-a33f-4280370710fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:14.333016 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596e537-9d2b-4c89-a33f-4280370710fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:14.333297 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596e537-9d2b-4c89-a33f-4280370710fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:14.333571 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596e537-9d2b-4c89-a33f-4280370710fc admin admin] PATH_INFO: `/v3/users/a381a8a97ec14247925f3da477a4d40e` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:14.334730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596e537-9d2b-4c89-a33f-4280370710fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a381a8a97ec14247925f3da477a4d40e)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:14.336671 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596e537-9d2b-4c89-a33f-4280370710fc admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:14.515343 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-c596e537-9d2b-4c89-a33f-4280370710fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a381a8a97ec14247925f3da477a4d40e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:14.522465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-c596e537-9d2b-4c89-a33f-4280370710fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a381a8a97ec14247925f3da477a4d40e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:14.523050 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-c596e537-9d2b-4c89-a33f-4280370710fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a381a8a97ec14247925f3da477a4d40e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:14.536023 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-c596e537-9d2b-4c89-a33f-4280370710fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a381a8a97ec14247925f3da477a4d40e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:14.620961 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-c596e537-9d2b-4c89-a33f-4280370710fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a381a8a97ec14247925f3da477a4d40e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:14.627438 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1184/2386] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:03:14 2022] DELETE /identity/v3/users/a381a8a97ec14247925f3da477a4d40e => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:03:15.034605 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372a791-1479-4bea-bf7a-2f810ea0a722 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:15.036109 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-6372a791-1479-4bea-bf7a-2f810ea0a722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:03:15.049408 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372a791-1479-4bea-bf7a-2f810ea0a722 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:15.108239 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46403f3a-2409-46b5-bcd7-37d22700312c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:15.109107 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46403f3a-2409-46b5-bcd7-37d22700312c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:15.109396 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46403f3a-2409-46b5-bcd7-37d22700312c admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:15.109679 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46403f3a-2409-46b5-bcd7-37d22700312c admin admin] PATH_INFO: `/v3/projects/eec44b52d2814c79a7d7091fa1928960` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:15.110864 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46403f3a-2409-46b5-bcd7-37d22700312c admin admin] RBAC: Authorizing `identity:delete_project(project_id=eec44b52d2814c79a7d7091fa1928960)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:15.112811 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46403f3a-2409-46b5-bcd7-37d22700312c admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:15.254321 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-46403f3a-2409-46b5-bcd7-37d22700312c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eec44b52d2814c79a7d7091fa1928960', 'request_id': 'req-46403f3a-2409-46b5-bcd7-37d22700312c'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:15.260494 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-46403f3a-2409-46b5-bcd7-37d22700312c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eec44b52d2814c79a7d7091fa1928960', 'request_id': 'req-46403f3a-2409-46b5-bcd7-37d22700312c'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:15.335265 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-46403f3a-2409-46b5-bcd7-37d22700312c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eec44b52d2814c79a7d7091fa1928960', 'request_id': 'req-46403f3a-2409-46b5-bcd7-37d22700312c'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:15.337372 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:03:15.346127 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-46403f3a-2409-46b5-bcd7-37d22700312c admin admin] The token cache is being invalidate because project eec44b52d2814c79a7d7091fa1928960 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:03:15.346413 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-46403f3a-2409-46b5-bcd7-37d22700312c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:15.350001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-46403f3a-2409-46b5-bcd7-37d22700312c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:03:15.350001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1203/2387] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:03:15 2022] DELETE /identity/v3/projects/eec44b52d2814c79a7d7091fa1928960 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:03:15.353634 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba20c61-4e7c-41ad-969a-0ebd8774557b None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:15.354122 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba20c61-4e7c-41ad-969a-0ebd8774557b None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:15.354215 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba20c61-4e7c-41ad-969a-0ebd8774557b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:15.373153 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-cba20c61-4e7c-41ad-969a-0ebd8774557b None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:03:15.374422 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-cba20c61-4e7c-41ad-969a-0ebd8774557b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:03:15.433337 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1185/2388] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:03:15.441685 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d1f60-83f4-45df-a20b-58ef1592241b None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:15.441974 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d1f60-83f4-45df-a20b-58ef1592241b None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:15.442278 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d1f60-83f4-45df-a20b-58ef1592241b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:15.461685 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-dd6d1f60-83f4-45df-a20b-58ef1592241b None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:03:15.462918 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-dd6d1f60-83f4-45df-a20b-58ef1592241b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:03:15.471294 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1204/2389] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:03:15.475617 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba20c61-4e7c-41ad-969a-0ebd8774557b None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:15.485915 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba20c61-4e7c-41ad-969a-0ebd8774557b None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:15.490461 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8be076-7f4e-4870-93df-9ba61e42645a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:15.491114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8be076-7f4e-4870-93df-9ba61e42645a admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:15.491398 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8be076-7f4e-4870-93df-9ba61e42645a admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:15.491712 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8be076-7f4e-4870-93df-9ba61e42645a admin admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:15.492443 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8be076-7f4e-4870-93df-9ba61e42645a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:03:15.492753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8be076-7f4e-4870-93df-9ba61e42645a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:15.494353 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8be076-7f4e-4870-93df-9ba61e42645a admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:15.495855 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:03:15.507829 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1186/2390] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 16:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:03:15.512985 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d1f60-83f4-45df-a20b-58ef1592241b None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:15.521710 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d1f60-83f4-45df-a20b-58ef1592241b None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:15.526420 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3d2ca-4d9f-44f9-9484-190d617dde7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:15.527097 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3d2ca-4d9f-44f9-9484-190d617dde7a admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:15.527382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3d2ca-4d9f-44f9-9484-190d617dde7a admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:15.527700 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3d2ca-4d9f-44f9-9484-190d617dde7a admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:15.528589 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df3d2ca-4d9f-44f9-9484-190d617dde7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:15.530494 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df3d2ca-4d9f-44f9-9484-190d617dde7a admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:15.686318 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1205/2391] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:03:15 2022] POST /identity/v3/projects => generated 371 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:03:15.690189 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8be076-7f4e-4870-93df-9ba61e42645a admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:15.700297 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8be076-7f4e-4870-93df-9ba61e42645a admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:15.756880 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffbc930-daa3-4e52-a5af-97397f6644e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:15.757540 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbc930-daa3-4e52-a5af-97397f6644e0 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:15.757821 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbc930-daa3-4e52-a5af-97397f6644e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:15.758094 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbc930-daa3-4e52-a5af-97397f6644e0 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:15.758777 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffbc930-daa3-4e52-a5af-97397f6644e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:15.760849 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffbc930-daa3-4e52-a5af-97397f6644e0 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:15.845596 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1187/2392] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:03:15 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:03:15.848895 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3d2ca-4d9f-44f9-9484-190d617dde7a admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:15.859766 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3d2ca-4d9f-44f9-9484-190d617dde7a admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:15.864336 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106c6b9-6d7b-404e-be48-8cbedbb9a8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:15.864984 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106c6b9-6d7b-404e-be48-8cbedbb9a8ba admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:15.865267 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106c6b9-6d7b-404e-be48-8cbedbb9a8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:15.865543 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106c6b9-6d7b-404e-be48-8cbedbb9a8ba admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:15.866260 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6106c6b9-6d7b-404e-be48-8cbedbb9a8ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:15.867869 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6106c6b9-6d7b-404e-be48-8cbedbb9a8ba admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:15.878186 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1206/2393] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:03:15.882191 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffbc930-daa3-4e52-a5af-97397f6644e0 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:15.892461 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffbc930-daa3-4e52-a5af-97397f6644e0 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:15.897071 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4ddd2-f0f7-44e5-ab05-b775f4f66cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:15.897753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4ddd2-f0f7-44e5-ab05-b775f4f66cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:15.898038 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4ddd2-f0f7-44e5-ab05-b775f4f66cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:15.898315 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4ddd2-f0f7-44e5-ab05-b775f4f66cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:15.899037 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4ddd2-f0f7-44e5-ab05-b775f4f66cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:15.900686 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4ddd2-f0f7-44e5-ab05-b775f4f66cb2 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:15.914505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1188/2394] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:03:15.915645 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106c6b9-6d7b-404e-be48-8cbedbb9a8ba admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:15.926335 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106c6b9-6d7b-404e-be48-8cbedbb9a8ba admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:15.931231 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96006f-16dd-460e-a030-a273c3ab9cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:15.932139 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96006f-16dd-460e-a030-a273c3ab9cf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:15.932425 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96006f-16dd-460e-a030-a273c3ab9cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:15.932708 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96006f-16dd-460e-a030-a273c3ab9cf8 admin admin] PATH_INFO: `/v3/projects/57af8c1d6caf40e28091e6ca0494f846/users/45313b404d534c89aeba7dea928c2a40/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:15.947488 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96006f-16dd-460e-a030-a273c3ab9cf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57af8c1d6caf40e28091e6ca0494f846, user_id=45313b404d534c89aeba7dea928c2a40, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:15.950183 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96006f-16dd-460e-a030-a273c3ab9cf8 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:16.056226 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1207/2395] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:03:15 2022] PUT /identity/v3/projects/57af8c1d6caf40e28091e6ca0494f846/users/45313b404d534c89aeba7dea928c2a40/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:03:16.061411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958d8d6-b13a-41b0-9aca-2787a810578b None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:16.061700 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958d8d6-b13a-41b0-9aca-2787a810578b None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:16.061977 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958d8d6-b13a-41b0-9aca-2787a810578b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:16.084399 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-4958d8d6-b13a-41b0-9aca-2787a810578b None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:03:16.085641 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-4958d8d6-b13a-41b0-9aca-2787a810578b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:03:16.146317 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1189/2396] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:03:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:03:16.156496 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96006f-16dd-460e-a030-a273c3ab9cf8 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:16.158180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-4a96006f-16dd-460e-a030-a273c3ab9cf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:03:16.217063 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96006f-16dd-460e-a030-a273c3ab9cf8 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:16.220809 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd3a18-3832-4d4e-bb00-2010820877ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:16.221394 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd3a18-3832-4d4e-bb00-2010820877ea service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:16.221677 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd3a18-3832-4d4e-bb00-2010820877ea service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:16.221989 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd3a18-3832-4d4e-bb00-2010820877ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:16.230875 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd3a18-3832-4d4e-bb00-2010820877ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:16.232335 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd3a18-3832-4d4e-bb00-2010820877ea service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:16.241661 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1208/2397] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:03:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:03:17.457496 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9210f-50b7-446a-a8f2-dc444bacdc37 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:17.458067 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9210f-50b7-446a-a8f2-dc444bacdc37 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:17.458067 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9210f-50b7-446a-a8f2-dc444bacdc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:17.487383 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-94b9210f-50b7-446a-a8f2-dc444bacdc37 None None] MFA Rules not processed for user `45313b404d534c89aeba7dea928c2a40`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:03:17.488620 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-94b9210f-50b7-446a-a8f2-dc444bacdc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:03:17.561866 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1190/2398] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:03:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:03:17.566331 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd3a18-3832-4d4e-bb00-2010820877ea service neutron] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:17.577067 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd3a18-3832-4d4e-bb00-2010820877ea service neutron] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:17.581719 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bccdc-0df2-4f5e-962f-b1d78964496f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:17.582368 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bccdc-0df2-4f5e-962f-b1d78964496f admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:17.582651 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bccdc-0df2-4f5e-962f-b1d78964496f admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:17.582929 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bccdc-0df2-4f5e-962f-b1d78964496f admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:17.583785 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79bccdc-0df2-4f5e-962f-b1d78964496f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:17.585805 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79bccdc-0df2-4f5e-962f-b1d78964496f admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:17.657225 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1209/2399] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:03:17 2022] POST /identity/v3/projects => generated 371 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:03:17.661184 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9210f-50b7-446a-a8f2-dc444bacdc37 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:17.666538 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:03:17.672434 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9210f-50b7-446a-a8f2-dc444bacdc37 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:17.737597 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760524a-cc30-413d-a627-02454fa49687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:17.738564 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760524a-cc30-413d-a627-02454fa49687 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:17.739052 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760524a-cc30-413d-a627-02454fa49687 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:17.739512 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760524a-cc30-413d-a627-02454fa49687 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:17.740766 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760524a-cc30-413d-a627-02454fa49687 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:17.743069 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760524a-cc30-413d-a627-02454fa49687 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:17.821878 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1191/2400] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:03:17 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:03:17.826525 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bccdc-0df2-4f5e-962f-b1d78964496f admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:17.837186 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bccdc-0df2-4f5e-962f-b1d78964496f admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:17.842580 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70e8db-46ad-432e-bbd1-71a3a5324569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:17.843249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70e8db-46ad-432e-bbd1-71a3a5324569 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:17.843524 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70e8db-46ad-432e-bbd1-71a3a5324569 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:17.843824 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70e8db-46ad-432e-bbd1-71a3a5324569 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:17.844554 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70e8db-46ad-432e-bbd1-71a3a5324569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:17.846165 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70e8db-46ad-432e-bbd1-71a3a5324569 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:17.857059 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1210/2401] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:03:17.861482 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760524a-cc30-413d-a627-02454fa49687 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:17.873061 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760524a-cc30-413d-a627-02454fa49687 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:17.878043 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b32b3-bc42-4391-badf-d82cef8af560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:17.878988 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b32b3-bc42-4391-badf-d82cef8af560 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:17.879269 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b32b3-bc42-4391-badf-d82cef8af560 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:17.879544 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b32b3-bc42-4391-badf-d82cef8af560 admin admin] PATH_INFO: `/v3/projects/3c440a55771948eda42c8e067f0878a9/users/00917591f1e24a18acddff70e0d20145/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:17.896083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b32b3-bc42-4391-badf-d82cef8af560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c440a55771948eda42c8e067f0878a9, user_id=00917591f1e24a18acddff70e0d20145, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:17.898903 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b32b3-bc42-4391-badf-d82cef8af560 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:17.958880 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1192/2402] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:03:17 2022] PUT /identity/v3/projects/3c440a55771948eda42c8e067f0878a9/users/00917591f1e24a18acddff70e0d20145/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:03:17.963128 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70e8db-46ad-432e-bbd1-71a3a5324569 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:17.973811 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70e8db-46ad-432e-bbd1-71a3a5324569 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:18.025613 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:03:18.031657 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab561052-a5eb-4b4b-9e42-7d495285bf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:18.033001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab561052-a5eb-4b4b-9e42-7d495285bf0d admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:18.033001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab561052-a5eb-4b4b-9e42-7d495285bf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:18.033001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab561052-a5eb-4b4b-9e42-7d495285bf0d admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:18.034633 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab561052-a5eb-4b4b-9e42-7d495285bf0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:18.035218 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab561052-a5eb-4b4b-9e42-7d495285bf0d admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:18.047010 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1211/2403] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:03:18.051655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b32b3-bc42-4391-badf-d82cef8af560 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:18.064112 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b32b3-bc42-4391-badf-d82cef8af560 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:18.070193 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de03d9-3503-48de-8f3e-376418ee775a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:18.076310 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de03d9-3503-48de-8f3e-376418ee775a admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:18.076310 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de03d9-3503-48de-8f3e-376418ee775a admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:18.076310 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de03d9-3503-48de-8f3e-376418ee775a admin admin] PATH_INFO: `/v3/projects/3c440a55771948eda42c8e067f0878a9/users/00917591f1e24a18acddff70e0d20145/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:18.076310 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de03d9-3503-48de-8f3e-376418ee775a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c440a55771948eda42c8e067f0878a9, user_id=00917591f1e24a18acddff70e0d20145, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:18.078151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de03d9-3503-48de-8f3e-376418ee775a admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:18.091106 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1193/2404] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:03:18 2022] PUT /identity/v3/projects/3c440a55771948eda42c8e067f0878a9/users/00917591f1e24a18acddff70e0d20145/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:03:19.397565 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e28e7-69b9-42cf-acd9-792de1f335e5 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:19.398073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e28e7-69b9-42cf-acd9-792de1f335e5 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:19.398291 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e28e7-69b9-42cf-acd9-792de1f335e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:19.425331 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-381e28e7-69b9-42cf-acd9-792de1f335e5 None None] MFA Rules not processed for user `00917591f1e24a18acddff70e0d20145`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:03:19.426435 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-381e28e7-69b9-42cf-acd9-792de1f335e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:03:19.496288 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1212/2405] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:03:19 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:03:19.508818 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35712d-b925-4a82-895e-cec8035fc337 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:19.509421 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35712d-b925-4a82-895e-cec8035fc337 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:19.509421 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35712d-b925-4a82-895e-cec8035fc337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:19.528437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-df35712d-b925-4a82-895e-cec8035fc337 None None] MFA Rules not processed for user `45313b404d534c89aeba7dea928c2a40`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:03:19.530312 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-df35712d-b925-4a82-895e-cec8035fc337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:03:19.591844 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1194/2406] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:03:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:03:19.606006 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e28e7-69b9-42cf-acd9-792de1f335e5 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:19.609324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-381e28e7-69b9-42cf-acd9-792de1f335e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:03:19.686455 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e28e7-69b9-42cf-acd9-792de1f335e5 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:19.691887 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd277d91-eaaa-43fd-8167-bc8bba3f716a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:19.692540 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd277d91-eaaa-43fd-8167-bc8bba3f716a service nova] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:19.692835 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd277d91-eaaa-43fd-8167-bc8bba3f716a service nova] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:19.693105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd277d91-eaaa-43fd-8167-bc8bba3f716a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:19.701034 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd277d91-eaaa-43fd-8167-bc8bba3f716a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:19.703255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd277d91-eaaa-43fd-8167-bc8bba3f716a service nova] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:19.712317 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1213/2407] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:03:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:03:29.584523 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=68,keystone:INSERT=5 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:03:29.708223 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=71 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:03:37.767679 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35712d-b925-4a82-895e-cec8035fc337 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:03:37.769061 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-df35712d-b925-4a82-895e-cec8035fc337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:03:37.832887 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35712d-b925-4a82-895e-cec8035fc337 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:03:37.837238 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970cf4fa-3e10-4a10-9779-73cb72405a7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:03:37.837884 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cf4fa-3e10-4a10-9779-73cb72405a7f service cinder] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:37.838166 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cf4fa-3e10-4a10-9779-73cb72405a7f service cinder] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:37.838442 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cf4fa-3e10-4a10-9779-73cb72405a7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:37.847982 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970cf4fa-3e10-4a10-9779-73cb72405a7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:03:37.849403 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970cf4fa-3e10-4a10-9779-73cb72405a7f service cinder] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:03:37.859826 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1195/2408] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:03:37 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:03:41.045379 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446aade-cf98-4003-bd67-5ace37fed740 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:03:41.046531 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446aade-cf98-4003-bd67-5ace37fed740 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:03:41.046531 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446aade-cf98-4003-bd67-5ace37fed740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:03:41.070640 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-f446aade-cf98-4003-bd67-5ace37fed740 None None] MFA Rules not processed for user `ce2a9dc6fbae42dfbfa4cb8b326c3de5`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:03:41.070640 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-f446aade-cf98-4003-bd67-5ace37fed740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:03:41.122885 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1214/2409] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:03:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:03:47.854526 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=26 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:03:51.115787 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=25 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:04:02.568344 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e08b9b-1430-4b75-b541-d152ca8d0e11 None None] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:02.569128 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e08b9b-1430-4b75-b541-d152ca8d0e11 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:02.569650 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e08b9b-1430-4b75-b541-d152ca8d0e11 None None] PATH_INFO: `/` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:02.571406 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1196/2410] 10.222.0.39 () {54 vars in 921 bytes} [Mon May 23 16:04:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:04:02.580153 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24903bdb-63a4-48cb-8048-3e3af21035ad None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:02.581251 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24903bdb-63a4-48cb-8048-3e3af21035ad None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:02.581457 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24903bdb-63a4-48cb-8048-3e3af21035ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:02.624850 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-24903bdb-63a4-48cb-8048-3e3af21035ad None None] MFA Rules not processed for user `84f06d35d7cc48658262bf79d9c72280`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:04:02.626217 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-24903bdb-63a4-48cb-8048-3e3af21035ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:04:02.693092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1215/2411] 10.222.0.39 () {58 vars in 1018 bytes} [Mon May 23 16:04:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:04:02.708357 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e08b9b-1430-4b75-b541-d152ca8d0e11 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:04:02.710064 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-e1e08b9b-1430-4b75-b541-d152ca8d0e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:04:02.726506 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e08b9b-1430-4b75-b541-d152ca8d0e11 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:04:02.731782 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6c6e8-2518-41f1-a20c-dd1d5277ecf7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f06d35d7cc48658262bf79d9c72280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:04:02.732437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6c6e8-2518-41f1-a20c-dd1d5277ecf7 service placement] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:02.732720 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6c6e8-2518-41f1-a20c-dd1d5277ecf7 service placement] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:02.732995 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6c6e8-2518-41f1-a20c-dd1d5277ecf7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:02.753608 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24903bdb-63a4-48cb-8048-3e3af21035ad None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:04:02.753958 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6c6e8-2518-41f1-a20c-dd1d5277ecf7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:04:02.753958 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6c6e8-2518-41f1-a20c-dd1d5277ecf7 service placement] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:04:02.756792 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1197/2412] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:04:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:04:02.821019 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24903bdb-63a4-48cb-8048-3e3af21035ad None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:04:02.825690 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc616252-4d2e-4840-a194-3df7231709f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:04:02.826664 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc616252-4d2e-4840-a194-3df7231709f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:02.826954 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc616252-4d2e-4840-a194-3df7231709f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:02.827253 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc616252-4d2e-4840-a194-3df7231709f3 admin admin] PATH_INFO: `/v3/users/45313b404d534c89aeba7dea928c2a40` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:02.828492 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc616252-4d2e-4840-a194-3df7231709f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45313b404d534c89aeba7dea928c2a40)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:04:02.830977 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc616252-4d2e-4840-a194-3df7231709f3 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:04:03.039289 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-cc616252-4d2e-4840-a194-3df7231709f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45313b404d534c89aeba7dea928c2a40'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:04:03.039888 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-cc616252-4d2e-4840-a194-3df7231709f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45313b404d534c89aeba7dea928c2a40'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:04:03.040513 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-cc616252-4d2e-4840-a194-3df7231709f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45313b404d534c89aeba7dea928c2a40'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:04:03.116705 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-cc616252-4d2e-4840-a194-3df7231709f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45313b404d534c89aeba7dea928c2a40'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:04:03.125019 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-cc616252-4d2e-4840-a194-3df7231709f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45313b404d534c89aeba7dea928c2a40'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:04:03.143705 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1216/2413] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:04:02 2022] DELETE /identity/v3/users/45313b404d534c89aeba7dea928c2a40 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:04:03.409666 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6c6e8-2518-41f1-a20c-dd1d5277ecf7 service placement] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:04:03.422422 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6c6e8-2518-41f1-a20c-dd1d5277ecf7 service placement] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:04:03.483715 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2a5f7-6171-4138-98bb-f5ab4180087e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:04:03.484577 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2a5f7-6171-4138-98bb-f5ab4180087e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:03.484858 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2a5f7-6171-4138-98bb-f5ab4180087e admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:03.485131 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2a5f7-6171-4138-98bb-f5ab4180087e admin admin] PATH_INFO: `/v3/projects/57af8c1d6caf40e28091e6ca0494f846` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:03.486406 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2a5f7-6171-4138-98bb-f5ab4180087e admin admin] RBAC: Authorizing `identity:delete_project(project_id=57af8c1d6caf40e28091e6ca0494f846)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:04:03.488875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2a5f7-6171-4138-98bb-f5ab4180087e admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:04:03.579587 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-10f2a5f7-6171-4138-98bb-f5ab4180087e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57af8c1d6caf40e28091e6ca0494f846', 'request_id': 'req-10f2a5f7-6171-4138-98bb-f5ab4180087e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:04:03.585620 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-10f2a5f7-6171-4138-98bb-f5ab4180087e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57af8c1d6caf40e28091e6ca0494f846', 'request_id': 'req-10f2a5f7-6171-4138-98bb-f5ab4180087e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:04:03.642520 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-10f2a5f7-6171-4138-98bb-f5ab4180087e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57af8c1d6caf40e28091e6ca0494f846', 'request_id': 'req-10f2a5f7-6171-4138-98bb-f5ab4180087e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:04:03.654528 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-10f2a5f7-6171-4138-98bb-f5ab4180087e admin admin] The token cache is being invalidate because project 57af8c1d6caf40e28091e6ca0494f846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:04:03.654754 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-10f2a5f7-6171-4138-98bb-f5ab4180087e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:04:03.655383 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-10f2a5f7-6171-4138-98bb-f5ab4180087e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:04:03.657029 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1198/2414] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:04:03 2022] DELETE /identity/v3/projects/57af8c1d6caf40e28091e6ca0494f846 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:04:03.661961 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc616252-4d2e-4840-a194-3df7231709f3 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:04:03.663361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-cc616252-4d2e-4840-a194-3df7231709f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:04:03.671647 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:04:03.678113 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc616252-4d2e-4840-a194-3df7231709f3 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:04:03.734796 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913632e-007c-409e-9459-34c6095f271c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:04:03.735706 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913632e-007c-409e-9459-34c6095f271c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:03.735995 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913632e-007c-409e-9459-34c6095f271c admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:03.736275 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913632e-007c-409e-9459-34c6095f271c admin admin] PATH_INFO: `/v3/users/00917591f1e24a18acddff70e0d20145` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:03.738151 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913632e-007c-409e-9459-34c6095f271c admin admin] RBAC: Authorizing `identity:delete_user(user_id=00917591f1e24a18acddff70e0d20145)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:04:03.740109 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913632e-007c-409e-9459-34c6095f271c admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:04:03.892408 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-c913632e-007c-409e-9459-34c6095f271c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00917591f1e24a18acddff70e0d20145'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:04:03.893310 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-c913632e-007c-409e-9459-34c6095f271c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00917591f1e24a18acddff70e0d20145'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:04:03.893951 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-c913632e-007c-409e-9459-34c6095f271c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00917591f1e24a18acddff70e0d20145'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:04:03.939100 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-c913632e-007c-409e-9459-34c6095f271c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00917591f1e24a18acddff70e0d20145'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:04:03.946825 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-c913632e-007c-409e-9459-34c6095f271c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00917591f1e24a18acddff70e0d20145'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:04:03.964020 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1217/2415] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:04:03 2022] DELETE /identity/v3/users/00917591f1e24a18acddff70e0d20145 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:04:04.227419 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2a5f7-6171-4138-98bb-f5ab4180087e admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:04:04.229108 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-10f2a5f7-6171-4138-98bb-f5ab4180087e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:04:04.243535 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2a5f7-6171-4138-98bb-f5ab4180087e admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:04:04.306139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859976c-1fee-4758-b7de-391e2a66cf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:04:04.306996 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859976c-1fee-4758-b7de-391e2a66cf5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:04.307274 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859976c-1fee-4758-b7de-391e2a66cf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:04.307547 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859976c-1fee-4758-b7de-391e2a66cf5a admin admin] PATH_INFO: `/v3/projects/3c440a55771948eda42c8e067f0878a9` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:04.308746 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859976c-1fee-4758-b7de-391e2a66cf5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c440a55771948eda42c8e067f0878a9)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:04:04.310649 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859976c-1fee-4758-b7de-391e2a66cf5a admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:04:04.331741 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:04:04.414473 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-3859976c-1fee-4758-b7de-391e2a66cf5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c440a55771948eda42c8e067f0878a9', 'request_id': 'req-3859976c-1fee-4758-b7de-391e2a66cf5a'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:04:04.421183 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-3859976c-1fee-4758-b7de-391e2a66cf5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c440a55771948eda42c8e067f0878a9', 'request_id': 'req-3859976c-1fee-4758-b7de-391e2a66cf5a'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:04:04.493747 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-3859976c-1fee-4758-b7de-391e2a66cf5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c440a55771948eda42c8e067f0878a9', 'request_id': 'req-3859976c-1fee-4758-b7de-391e2a66cf5a'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:04:04.505518 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-3859976c-1fee-4758-b7de-391e2a66cf5a admin admin] The token cache is being invalidate because project 3c440a55771948eda42c8e067f0878a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:04:04.505803 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-3859976c-1fee-4758-b7de-391e2a66cf5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:04:04.506471 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-3859976c-1fee-4758-b7de-391e2a66cf5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:04:04.508166 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1199/2416] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:04:04 2022] DELETE /identity/v3/projects/3c440a55771948eda42c8e067f0878a9 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:04:04.513324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aa88f-3344-4ead-b75f-a1fba449fc14 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:04.513616 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aa88f-3344-4ead-b75f-a1fba449fc14 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:04.513900 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aa88f-3344-4ead-b75f-a1fba449fc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:04.532901 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-939aa88f-3344-4ead-b75f-a1fba449fc14 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:04:04.540118 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-939aa88f-3344-4ead-b75f-a1fba449fc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:04:04.592665 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1218/2417] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:04:04.601139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eada280-62a0-4a70-abab-e489bd793612 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:04.601616 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eada280-62a0-4a70-abab-e489bd793612 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:04.601724 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eada280-62a0-4a70-abab-e489bd793612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:04.619744 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-9eada280-62a0-4a70-abab-e489bd793612 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:04:04.620932 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-9eada280-62a0-4a70-abab-e489bd793612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:04:04.629449 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1200/2418] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:04:04.633709 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939aa88f-3344-4ead-b75f-a1fba449fc14 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:04:04.644951 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939aa88f-3344-4ead-b75f-a1fba449fc14 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:04:04.649872 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56683f29-e3b1-4310-b438-311351cd1553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:04:04.650538 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56683f29-e3b1-4310-b438-311351cd1553 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:04.650828 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56683f29-e3b1-4310-b438-311351cd1553 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:04.651113 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56683f29-e3b1-4310-b438-311351cd1553 admin admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:04.651887 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56683f29-e3b1-4310-b438-311351cd1553 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:04:04.652199 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56683f29-e3b1-4310-b438-311351cd1553 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:04:04.653811 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56683f29-e3b1-4310-b438-311351cd1553 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:04:04.666718 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1219/2419] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 16:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:04:04.671127 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eada280-62a0-4a70-abab-e489bd793612 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:04:04.680786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eada280-62a0-4a70-abab-e489bd793612 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:04:04.685455 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa289c31-1ad5-4deb-9dab-275c94513c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:04:04.686101 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa289c31-1ad5-4deb-9dab-275c94513c0f admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:04.686383 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa289c31-1ad5-4deb-9dab-275c94513c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:04.686658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa289c31-1ad5-4deb-9dab-275c94513c0f admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:04.687352 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa289c31-1ad5-4deb-9dab-275c94513c0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:04:04.689352 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa289c31-1ad5-4deb-9dab-275c94513c0f admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:04:04.809420 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1201/2420] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:04:04 2022] POST /identity/v3/projects => generated 371 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:04:04.813881 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56683f29-e3b1-4310-b438-311351cd1553 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:04:04.825302 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56683f29-e3b1-4310-b438-311351cd1553 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:04:04.829964 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:04:04.883491 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89747472-3858-46b1-aa6f-e502f04429f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:04:04.884198 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89747472-3858-46b1-aa6f-e502f04429f0 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:04.884484 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89747472-3858-46b1-aa6f-e502f04429f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:04.884761 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89747472-3858-46b1-aa6f-e502f04429f0 admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:04.885451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89747472-3858-46b1-aa6f-e502f04429f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:04:04.887398 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89747472-3858-46b1-aa6f-e502f04429f0 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:04:04.974959 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1220/2421] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:04:04 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:04:04.981727 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa289c31-1ad5-4deb-9dab-275c94513c0f admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:04:04.993406 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa289c31-1ad5-4deb-9dab-275c94513c0f admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:04:04.997985 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf18e77-a476-43f1-8813-7b186102be09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:04:04.998644 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf18e77-a476-43f1-8813-7b186102be09 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:04.998924 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf18e77-a476-43f1-8813-7b186102be09 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:04.999198 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf18e77-a476-43f1-8813-7b186102be09 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:04.999960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf18e77-a476-43f1-8813-7b186102be09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:04:05.001600 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf18e77-a476-43f1-8813-7b186102be09 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:04:05.013024 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1202/2422] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:04:05.017080 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89747472-3858-46b1-aa6f-e502f04429f0 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:04:05.027928 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89747472-3858-46b1-aa6f-e502f04429f0 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:04:05.032665 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0adbb8-9ff6-49c7-af89-49d2614f6638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:04:05.033375 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0adbb8-9ff6-49c7-af89-49d2614f6638 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:05.033743 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0adbb8-9ff6-49c7-af89-49d2614f6638 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:05.034218 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0adbb8-9ff6-49c7-af89-49d2614f6638 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:05.035070 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0adbb8-9ff6-49c7-af89-49d2614f6638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:04:05.036727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0adbb8-9ff6-49c7-af89-49d2614f6638 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:04:05.047486 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1221/2423] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:04:05.052920 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf18e77-a476-43f1-8813-7b186102be09 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:04:05.063500 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf18e77-a476-43f1-8813-7b186102be09 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:04:05.068780 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b7e62-73fb-4777-b726-d966a64f72b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:04:05.069718 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b7e62-73fb-4777-b726-d966a64f72b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:05.069998 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b7e62-73fb-4777-b726-d966a64f72b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:05.070268 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b7e62-73fb-4777-b726-d966a64f72b6 admin admin] PATH_INFO: `/v3/projects/41ba6972f2284cdd8d4d05c824b7bee4/users/627d686138c74e3a92fc82cd5554cb83/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:05.085886 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b7e62-73fb-4777-b726-d966a64f72b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ba6972f2284cdd8d4d05c824b7bee4, user_id=627d686138c74e3a92fc82cd5554cb83, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:04:05.088612 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b7e62-73fb-4777-b726-d966a64f72b6 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:04:05.157390 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1203/2424] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:04:05 2022] PUT /identity/v3/projects/41ba6972f2284cdd8d4d05c824b7bee4/users/627d686138c74e3a92fc82cd5554cb83/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:04:05.162448 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55068ed-26fc-4ac2-9f1e-e09cd5473307 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:05.162740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55068ed-26fc-4ac2-9f1e-e09cd5473307 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:05.163021 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55068ed-26fc-4ac2-9f1e-e09cd5473307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:05.181295 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-a55068ed-26fc-4ac2-9f1e-e09cd5473307 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:04:05.182487 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-a55068ed-26fc-4ac2-9f1e-e09cd5473307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:04:05.243141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1222/2425] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:04:05.253286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b7e62-73fb-4777-b726-d966a64f72b6 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:04:05.255180 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-c65b7e62-73fb-4777-b726-d966a64f72b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:04:05.312642 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b7e62-73fb-4777-b726-d966a64f72b6 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:04:05.317311 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35456dd2-fd8f-4738-b997-a56e7153b636 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:04:05.317912 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35456dd2-fd8f-4738-b997-a56e7153b636 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:05.318195 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35456dd2-fd8f-4738-b997-a56e7153b636 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:05.318474 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35456dd2-fd8f-4738-b997-a56e7153b636 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:05.327842 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35456dd2-fd8f-4738-b997-a56e7153b636 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:04:05.329274 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35456dd2-fd8f-4738-b997-a56e7153b636 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:04:05.338711 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1204/2426] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:04:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:04:06.620068 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009fc4f-a3b6-4c71-83af-300f6959c87f None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:06.620597 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009fc4f-a3b6-4c71-83af-300f6959c87f None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:06.620770 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009fc4f-a3b6-4c71-83af-300f6959c87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:06.652023 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-f009fc4f-a3b6-4c71-83af-300f6959c87f None None] MFA Rules not processed for user `627d686138c74e3a92fc82cd5554cb83`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:04:06.652023 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-f009fc4f-a3b6-4c71-83af-300f6959c87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:04:06.718886 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1223/2427] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:04:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:04:06.737794 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35456dd2-fd8f-4738-b997-a56e7153b636 service neutron] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:04:06.739181 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-35456dd2-fd8f-4738-b997-a56e7153b636 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:04:06.790865 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:04:06.795726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35456dd2-fd8f-4738-b997-a56e7153b636 service neutron] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:04:06.799917 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28548c-c715-4418-ae42-34a8ab235802 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:04:06.800602 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28548c-c715-4418-ae42-34a8ab235802 service cinder] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:06.800886 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28548c-c715-4418-ae42-34a8ab235802 service cinder] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:06.801165 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28548c-c715-4418-ae42-34a8ab235802 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:06.809860 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28548c-c715-4418-ae42-34a8ab235802 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:04:06.812370 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28548c-c715-4418-ae42-34a8ab235802 service cinder] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:04:06.821226 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1205/2428] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:04:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:04:09.620762 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb465948-34f3-4d04-90ff-222950d0a9be None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:09.621343 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb465948-34f3-4d04-90ff-222950d0a9be None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:09.621449 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb465948-34f3-4d04-90ff-222950d0a9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:09.638965 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-bb465948-34f3-4d04-90ff-222950d0a9be None None] MFA Rules not processed for user `627d686138c74e3a92fc82cd5554cb83`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:04:09.640173 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-bb465948-34f3-4d04-90ff-222950d0a9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:04:09.647507 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1224/2429] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:04:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:04:11.833280 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28548c-c715-4418-ae42-34a8ab235802 service cinder] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:04:11.834780 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-5e28548c-c715-4418-ae42-34a8ab235802 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:04:11.905398 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28548c-c715-4418-ae42-34a8ab235802 service cinder] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:04:11.911712 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ec0c3-d4e5-4027-9541-4bbc3ccbbfc7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f06d35d7cc48658262bf79d9c72280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:04:11.912365 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ec0c3-d4e5-4027-9541-4bbc3ccbbfc7 service placement] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:11.912653 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ec0c3-d4e5-4027-9541-4bbc3ccbbfc7 service placement] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:11.912933 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ec0c3-d4e5-4027-9541-4bbc3ccbbfc7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:11.914737 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-0c8ec0c3-d4e5-4027-9541-4bbc3ccbbfc7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:04:11.927197 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ec0c3-d4e5-4027-9541-4bbc3ccbbfc7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:04:11.928975 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ec0c3-d4e5-4027-9541-4bbc3ccbbfc7 service placement] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:04:11.939258 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1206/2430] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:04:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:04:14.141869 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c54c8-3f23-4608-b62c-1388155ebf27 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:14.142366 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c54c8-3f23-4608-b62c-1388155ebf27 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:14.142983 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c54c8-3f23-4608-b62c-1388155ebf27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:14.162988 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-ec6c54c8-3f23-4608-b62c-1388155ebf27 None None] MFA Rules not processed for user `048fc48dd55a43f7b342533a9484c3ad`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:04:14.164237 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-ec6c54c8-3f23-4608-b62c-1388155ebf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:04:14.169809 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:04:14.224200 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1225/2431] 10.222.0.39 () {58 vars in 1009 bytes} [Mon May 23 16:04:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:04:14.360928 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ec0c3-d4e5-4027-9541-4bbc3ccbbfc7 service placement] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:04:14.364702 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-0c8ec0c3-d4e5-4027-9541-4bbc3ccbbfc7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:04:14.436238 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ec0c3-d4e5-4027-9541-4bbc3ccbbfc7 service placement] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:04:14.441595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96176a5f-a70c-48ce-a48d-5c8177d4b9cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b275a110936a44ce8d54793af1a34808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:04:14.442298 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96176a5f-a70c-48ce-a48d-5c8177d4b9cc service swift] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:14.442592 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96176a5f-a70c-48ce-a48d-5c8177d4b9cc service swift] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:14.442884 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96176a5f-a70c-48ce-a48d-5c8177d4b9cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:14.451298 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96176a5f-a70c-48ce-a48d-5c8177d4b9cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:04:14.452984 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96176a5f-a70c-48ce-a48d-5c8177d4b9cc service swift] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:04:14.461907 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1207/2432] 10.222.0.39 () {60 vars in 1384 bytes} [Mon May 23 16:04:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 16:04:24.344453 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=20 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:04:24.458146 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=69 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:04:36.796302 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255affc0-2f48-457c-ab74-4323adb0885c None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:36.796865 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255affc0-2f48-457c-ab74-4323adb0885c None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:36.796865 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255affc0-2f48-457c-ab74-4323adb0885c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:36.815969 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-255affc0-2f48-457c-ab74-4323adb0885c None None] MFA Rules not processed for user `627d686138c74e3a92fc82cd5554cb83`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:04:36.817073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-255affc0-2f48-457c-ab74-4323adb0885c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:04:36.824012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1226/2433] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:04:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:04:42.590136 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c7888-fed6-4f76-a1b4-b86e3fb0e56d None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:42.591006 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c7888-fed6-4f76-a1b4-b86e3fb0e56d None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:42.591292 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c7888-fed6-4f76-a1b4-b86e3fb0e56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:42.617712 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-b25c7888-fed6-4f76-a1b4-b86e3fb0e56d None None] MFA Rules not processed for user `048fc48dd55a43f7b342533a9484c3ad`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:04:42.618947 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-b25c7888-fed6-4f76-a1b4-b86e3fb0e56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:04:42.627264 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1208/2434] 10.222.0.39 () {58 vars in 1009 bytes} [Mon May 23 16:04:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:04:42.639899 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255affc0-2f48-457c-ab74-4323adb0885c None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:04:42.652965 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255affc0-2f48-457c-ab74-4323adb0885c None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:04:42.658589 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63993c3-547d-4b5c-9c58-0c9dcf1bf79f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b275a110936a44ce8d54793af1a34808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:04:42.660352 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63993c3-547d-4b5c-9c58-0c9dcf1bf79f service swift] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:42.660352 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63993c3-547d-4b5c-9c58-0c9dcf1bf79f service swift] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:42.660352 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63993c3-547d-4b5c-9c58-0c9dcf1bf79f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:42.668864 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63993c3-547d-4b5c-9c58-0c9dcf1bf79f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:04:42.671503 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63993c3-547d-4b5c-9c58-0c9dcf1bf79f service swift] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:04:42.684790 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1227/2435] 10.222.0.39 () {60 vars in 1384 bytes} [Mon May 23 16:04:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 16:04:47.860139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c7888-fed6-4f76-a1b4-b86e3fb0e56d None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:04:47.877244 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c7888-fed6-4f76-a1b4-b86e3fb0e56d None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:04:47.882839 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97f757-6a2e-4fae-a76d-0f8be61cba91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:04:47.883931 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97f757-6a2e-4fae-a76d-0f8be61cba91 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:47.884404 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97f757-6a2e-4fae-a76d-0f8be61cba91 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:47.884872 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97f757-6a2e-4fae-a76d-0f8be61cba91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:47.887954 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-1b97f757-6a2e-4fae-a76d-0f8be61cba91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:04:47.911352 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97f757-6a2e-4fae-a76d-0f8be61cba91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:04:47.912819 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97f757-6a2e-4fae-a76d-0f8be61cba91 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:04:47.925464 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1209/2436] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:04:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:04:52.681376 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=9 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:04:52.961697 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63993c3-547d-4b5c-9c58-0c9dcf1bf79f service swift] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:04:52.963184 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-f63993c3-547d-4b5c-9c58-0c9dcf1bf79f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:04:52.980181 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63993c3-547d-4b5c-9c58-0c9dcf1bf79f service swift] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:04:52.984842 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bce74-628e-4aeb-83de-3194393c897e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:04:52.986786 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bce74-628e-4aeb-83de-3194393c897e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:52.987080 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bce74-628e-4aeb-83de-3194393c897e admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:52.987366 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bce74-628e-4aeb-83de-3194393c897e admin admin] PATH_INFO: `/v3/users/5a57fd95e0714be6b124d5abc2422dbc` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:52.988614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bce74-628e-4aeb-83de-3194393c897e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a57fd95e0714be6b124d5abc2422dbc)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:04:52.990639 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bce74-628e-4aeb-83de-3194393c897e admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:04:53.185434 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-394bce74-628e-4aeb-83de-3194393c897e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a57fd95e0714be6b124d5abc2422dbc'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:04:53.186049 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-394bce74-628e-4aeb-83de-3194393c897e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a57fd95e0714be6b124d5abc2422dbc'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:04:53.186641 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-394bce74-628e-4aeb-83de-3194393c897e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a57fd95e0714be6b124d5abc2422dbc'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:04:53.235563 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-394bce74-628e-4aeb-83de-3194393c897e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a57fd95e0714be6b124d5abc2422dbc'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:04:53.243150 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-394bce74-628e-4aeb-83de-3194393c897e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a57fd95e0714be6b124d5abc2422dbc'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:04:53.260843 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1228/2437] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:04:52 2022] DELETE /identity/v3/users/5a57fd95e0714be6b124d5abc2422dbc => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:04:53.525475 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97f757-6a2e-4fae-a76d-0f8be61cba91 service neutron] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:04:53.525475 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97f757-6a2e-4fae-a76d-0f8be61cba91 service neutron] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:04:53.582079 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d73b5-6b63-4f08-942e-4ce64a3aa83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:04:53.582947 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d73b5-6b63-4f08-942e-4ce64a3aa83d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:53.583230 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d73b5-6b63-4f08-942e-4ce64a3aa83d admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:53.583507 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d73b5-6b63-4f08-942e-4ce64a3aa83d admin admin] PATH_INFO: `/v3/projects/8d23dc4d351a49d1992c2f0eb3f05a65` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:53.584720 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d73b5-6b63-4f08-942e-4ce64a3aa83d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d23dc4d351a49d1992c2f0eb3f05a65)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:04:53.586628 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d73b5-6b63-4f08-942e-4ce64a3aa83d admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:04:53.726532 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-bd2d73b5-6b63-4f08-942e-4ce64a3aa83d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d23dc4d351a49d1992c2f0eb3f05a65', 'request_id': 'req-bd2d73b5-6b63-4f08-942e-4ce64a3aa83d'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:04:53.731969 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-bd2d73b5-6b63-4f08-942e-4ce64a3aa83d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d23dc4d351a49d1992c2f0eb3f05a65', 'request_id': 'req-bd2d73b5-6b63-4f08-942e-4ce64a3aa83d'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:04:53.794411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-bd2d73b5-6b63-4f08-942e-4ce64a3aa83d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d23dc4d351a49d1992c2f0eb3f05a65', 'request_id': 'req-bd2d73b5-6b63-4f08-942e-4ce64a3aa83d'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:04:53.807209 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-bd2d73b5-6b63-4f08-942e-4ce64a3aa83d admin admin] The token cache is being invalidate because project 8d23dc4d351a49d1992c2f0eb3f05a65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:04:53.807497 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-bd2d73b5-6b63-4f08-942e-4ce64a3aa83d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:04:53.808156 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-bd2d73b5-6b63-4f08-942e-4ce64a3aa83d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:04:53.809714 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1210/2438] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:04:53 2022] DELETE /identity/v3/projects/8d23dc4d351a49d1992c2f0eb3f05a65 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:04:53.815437 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63987de3-41d1-4fcc-bfe8-36e75f8d5278 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:53.815981 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63987de3-41d1-4fcc-bfe8-36e75f8d5278 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:53.816114 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63987de3-41d1-4fcc-bfe8-36e75f8d5278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:53.834399 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-63987de3-41d1-4fcc-bfe8-36e75f8d5278 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:04:53.835586 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-63987de3-41d1-4fcc-bfe8-36e75f8d5278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:04:53.898450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1229/2439] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:04:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:04:53.906192 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13841c-1f49-477c-ae4c-2f3e673775a4 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:53.906480 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13841c-1f49-477c-ae4c-2f3e673775a4 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:53.906820 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13841c-1f49-477c-ae4c-2f3e673775a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:53.925808 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-9e13841c-1f49-477c-ae4c-2f3e673775a4 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:04:53.927126 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-9e13841c-1f49-477c-ae4c-2f3e673775a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:04:53.935387 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1211/2440] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:04:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:04:53.940624 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63987de3-41d1-4fcc-bfe8-36e75f8d5278 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:04:53.950407 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63987de3-41d1-4fcc-bfe8-36e75f8d5278 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:04:53.955167 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6cbb2-9fca-4909-9ab0-84beab017d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:04:53.955951 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6cbb2-9fca-4909-9ab0-84beab017d0a admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:53.956236 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6cbb2-9fca-4909-9ab0-84beab017d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:53.956512 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6cbb2-9fca-4909-9ab0-84beab017d0a admin admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:53.957232 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b6cbb2-9fca-4909-9ab0-84beab017d0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:04:53.957565 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b6cbb2-9fca-4909-9ab0-84beab017d0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:04:53.959164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b6cbb2-9fca-4909-9ab0-84beab017d0a admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:04:53.975157 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1230/2441] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 16:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:04:53.976368 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13841c-1f49-477c-ae4c-2f3e673775a4 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:04:53.986871 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13841c-1f49-477c-ae4c-2f3e673775a4 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:04:53.991721 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784861c-31f0-47dc-b311-2cbb6f7a8adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:04:53.992378 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784861c-31f0-47dc-b311-2cbb6f7a8adb admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:53.992662 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784861c-31f0-47dc-b311-2cbb6f7a8adb admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:53.992941 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784861c-31f0-47dc-b311-2cbb6f7a8adb admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:53.993630 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784861c-31f0-47dc-b311-2cbb6f7a8adb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:04:53.995546 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784861c-31f0-47dc-b311-2cbb6f7a8adb admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:04:54.089220 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1212/2442] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:04:53 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:04:54.093151 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6cbb2-9fca-4909-9ab0-84beab017d0a admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:04:54.104122 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6cbb2-9fca-4909-9ab0-84beab017d0a admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:04:54.162449 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0c0e6-e1d4-441d-a305-52876bd5415a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:04:54.163124 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0c0e6-e1d4-441d-a305-52876bd5415a admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:54.163405 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0c0e6-e1d4-441d-a305-52876bd5415a admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:54.163710 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0c0e6-e1d4-441d-a305-52876bd5415a admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:54.164420 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0c0e6-e1d4-441d-a305-52876bd5415a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:04:54.166346 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0c0e6-e1d4-441d-a305-52876bd5415a admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:04:54.173502 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:04:54.218610 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1231/2443] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:04:54 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:04:54.223377 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784861c-31f0-47dc-b311-2cbb6f7a8adb admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:04:54.233779 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784861c-31f0-47dc-b311-2cbb6f7a8adb admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:04:54.239061 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c8f0d-00df-4c18-bdbd-5ef07a4e6da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:04:54.239751 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c8f0d-00df-4c18-bdbd-5ef07a4e6da5 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:54.240036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c8f0d-00df-4c18-bdbd-5ef07a4e6da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:54.240313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c8f0d-00df-4c18-bdbd-5ef07a4e6da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:54.241037 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c8f0d-00df-4c18-bdbd-5ef07a4e6da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:04:54.242636 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c8f0d-00df-4c18-bdbd-5ef07a4e6da5 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:04:54.252643 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1213/2444] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:04:54.256627 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0c0e6-e1d4-441d-a305-52876bd5415a admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:04:54.267874 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0c0e6-e1d4-441d-a305-52876bd5415a admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:04:54.272538 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0c67d-399c-4c63-bb23-bec515ed4120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:04:54.273196 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0c67d-399c-4c63-bb23-bec515ed4120 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:54.273484 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0c67d-399c-4c63-bb23-bec515ed4120 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:54.273758 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0c67d-399c-4c63-bb23-bec515ed4120 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:54.274597 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0c67d-399c-4c63-bb23-bec515ed4120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:04:54.276313 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0c67d-399c-4c63-bb23-bec515ed4120 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:04:54.287125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1232/2445] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:04:54.291112 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c8f0d-00df-4c18-bdbd-5ef07a4e6da5 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:04:54.301827 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c8f0d-00df-4c18-bdbd-5ef07a4e6da5 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:04:54.306368 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17b0ff-cb9c-45a0-ab44-565214387e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:04:54.307223 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17b0ff-cb9c-45a0-ab44-565214387e43 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:54.307504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17b0ff-cb9c-45a0-ab44-565214387e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:54.307806 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17b0ff-cb9c-45a0-ab44-565214387e43 admin admin] PATH_INFO: `/v3/projects/98456937778d4449bb8cf1643eb30bd2/users/7733b3e4244e4dbf8d20524e303c32a3/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:54.322094 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17b0ff-cb9c-45a0-ab44-565214387e43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98456937778d4449bb8cf1643eb30bd2, user_id=7733b3e4244e4dbf8d20524e303c32a3, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:04:54.324731 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17b0ff-cb9c-45a0-ab44-565214387e43 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:04:54.389268 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1214/2446] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:04:54 2022] PUT /identity/v3/projects/98456937778d4449bb8cf1643eb30bd2/users/7733b3e4244e4dbf8d20524e303c32a3/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:04:54.400123 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62201465-1969-4fa6-bfb7-7d87267f8b59 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:54.402353 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62201465-1969-4fa6-bfb7-7d87267f8b59 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:54.402353 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62201465-1969-4fa6-bfb7-7d87267f8b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:54.428878 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-62201465-1969-4fa6-bfb7-7d87267f8b59 None None] MFA Rules not processed for user `7733b3e4244e4dbf8d20524e303c32a3`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:04:54.430085 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-62201465-1969-4fa6-bfb7-7d87267f8b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:04:54.494677 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1233/2447] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:04:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:04:54.505794 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17b0ff-cb9c-45a0-ab44-565214387e43 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:04:54.507689 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-1a17b0ff-cb9c-45a0-ab44-565214387e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:04:54.518510 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:04:54.582070 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17b0ff-cb9c-45a0-ab44-565214387e43 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:04:54.587503 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24361b-2302-4e83-8fc7-b1d10c86d85f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:04:54.593531 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24361b-2302-4e83-8fc7-b1d10c86d85f service nova] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:04:54.593531 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24361b-2302-4e83-8fc7-b1d10c86d85f service nova] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:04:54.593531 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24361b-2302-4e83-8fc7-b1d10c86d85f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:04:54.597338 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24361b-2302-4e83-8fc7-b1d10c86d85f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:04:54.598939 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24361b-2302-4e83-8fc7-b1d10c86d85f service nova] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:04:54.607912 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1215/2448] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:04:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:05:01.843266 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62201465-1969-4fa6-bfb7-7d87267f8b59 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:01.904800 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62201465-1969-4fa6-bfb7-7d87267f8b59 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:01.910225 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb7936-db70-4cc4-b351-e92f398926eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:01.911105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb7936-db70-4cc4-b351-e92f398926eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:01.911387 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb7936-db70-4cc4-b351-e92f398926eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:01.911692 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb7936-db70-4cc4-b351-e92f398926eb admin admin] PATH_INFO: `/v3/users/7733b3e4244e4dbf8d20524e303c32a3` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:01.912890 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb7936-db70-4cc4-b351-e92f398926eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7733b3e4244e4dbf8d20524e303c32a3)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:01.915729 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb7936-db70-4cc4-b351-e92f398926eb admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:02.106757 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-5fdb7936-db70-4cc4-b351-e92f398926eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7733b3e4244e4dbf8d20524e303c32a3'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:02.107434 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-5fdb7936-db70-4cc4-b351-e92f398926eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7733b3e4244e4dbf8d20524e303c32a3'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:02.108066 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-5fdb7936-db70-4cc4-b351-e92f398926eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7733b3e4244e4dbf8d20524e303c32a3'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:02.200502 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-5fdb7936-db70-4cc4-b351-e92f398926eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7733b3e4244e4dbf8d20524e303c32a3'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:02.210258 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-5fdb7936-db70-4cc4-b351-e92f398926eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7733b3e4244e4dbf8d20524e303c32a3'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:02.218301 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:02.231692 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1234/2449] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:05:01 2022] DELETE /identity/v3/users/7733b3e4244e4dbf8d20524e303c32a3 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:02.236846 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f062f17-9e52-4007-aff4-b9d5284df563 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:02.237308 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f062f17-9e52-4007-aff4-b9d5284df563 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:02.237527 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f062f17-9e52-4007-aff4-b9d5284df563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:02.255179 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-3f062f17-9e52-4007-aff4-b9d5284df563 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:02.256464 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-3f062f17-9e52-4007-aff4-b9d5284df563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:02.317494 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1216/2450] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:05:02.327207 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb7936-db70-4cc4-b351-e92f398926eb admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:02.329259 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-5fdb7936-db70-4cc4-b351-e92f398926eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:02.388260 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb7936-db70-4cc4-b351-e92f398926eb admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:02.392825 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b365e04-862d-4d8c-bd45-92508fbd8c36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:02.393554 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b365e04-862d-4d8c-bd45-92508fbd8c36 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:02.393840 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b365e04-862d-4d8c-bd45-92508fbd8c36 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:02.394118 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b365e04-862d-4d8c-bd45-92508fbd8c36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:02.404177 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b365e04-862d-4d8c-bd45-92508fbd8c36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:02.405622 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b365e04-862d-4d8c-bd45-92508fbd8c36 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:02.415903 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1235/2451] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:05:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:05:02.882266 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f062f17-9e52-4007-aff4-b9d5284df563 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:02.883851 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-3f062f17-9e52-4007-aff4-b9d5284df563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:02.896392 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f062f17-9e52-4007-aff4-b9d5284df563 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:02.901088 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf2c00-02bc-48dd-b8ec-8cb965690eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:02.901947 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf2c00-02bc-48dd-b8ec-8cb965690eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:02.902429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf2c00-02bc-48dd-b8ec-8cb965690eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:02.902703 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf2c00-02bc-48dd-b8ec-8cb965690eaf admin admin] PATH_INFO: `/v3/projects/98456937778d4449bb8cf1643eb30bd2` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:02.903904 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf2c00-02bc-48dd-b8ec-8cb965690eaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=98456937778d4449bb8cf1643eb30bd2)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:02.905831 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf2c00-02bc-48dd-b8ec-8cb965690eaf admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:03.028936 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e8cf2c00-02bc-48dd-b8ec-8cb965690eaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98456937778d4449bb8cf1643eb30bd2', 'request_id': 'req-e8cf2c00-02bc-48dd-b8ec-8cb965690eaf'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:03.034578 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e8cf2c00-02bc-48dd-b8ec-8cb965690eaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98456937778d4449bb8cf1643eb30bd2', 'request_id': 'req-e8cf2c00-02bc-48dd-b8ec-8cb965690eaf'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:03.091811 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e8cf2c00-02bc-48dd-b8ec-8cb965690eaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98456937778d4449bb8cf1643eb30bd2', 'request_id': 'req-e8cf2c00-02bc-48dd-b8ec-8cb965690eaf'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:03.104016 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e8cf2c00-02bc-48dd-b8ec-8cb965690eaf admin admin] The token cache is being invalidate because project 98456937778d4449bb8cf1643eb30bd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:05:03.104269 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e8cf2c00-02bc-48dd-b8ec-8cb965690eaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:03.104934 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e8cf2c00-02bc-48dd-b8ec-8cb965690eaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:03.106472 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1217/2452] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:05:02 2022] DELETE /identity/v3/projects/98456937778d4449bb8cf1643eb30bd2 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:03.112095 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda7169-4b83-4f77-babd-fe2c40fc9e4e None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:03.112584 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda7169-4b83-4f77-babd-fe2c40fc9e4e None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:03.112681 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda7169-4b83-4f77-babd-fe2c40fc9e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:03.129898 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-edda7169-4b83-4f77-babd-fe2c40fc9e4e None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:03.132078 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-edda7169-4b83-4f77-babd-fe2c40fc9e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:03.190181 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1236/2453] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:05:03.198680 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3416c-7804-448e-9ac1-d04f090894fc None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:03.199072 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3416c-7804-448e-9ac1-d04f090894fc None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:03.199407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3416c-7804-448e-9ac1-d04f090894fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:03.218958 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-5ec3416c-7804-448e-9ac1-d04f090894fc None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:03.221246 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-5ec3416c-7804-448e-9ac1-d04f090894fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:03.229371 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1218/2454] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:05:03.233735 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda7169-4b83-4f77-babd-fe2c40fc9e4e None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:03.244908 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda7169-4b83-4f77-babd-fe2c40fc9e4e None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:03.249664 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051db072-f59e-4e29-9b0c-9784cb50baf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:03.250347 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051db072-f59e-4e29-9b0c-9784cb50baf9 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:03.251171 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051db072-f59e-4e29-9b0c-9784cb50baf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:03.251462 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051db072-f59e-4e29-9b0c-9784cb50baf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:03.252245 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051db072-f59e-4e29-9b0c-9784cb50baf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:05:03.252559 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051db072-f59e-4e29-9b0c-9784cb50baf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:03.254179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051db072-f59e-4e29-9b0c-9784cb50baf9 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:03.266254 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1237/2455] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 16:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:05:03.270431 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3416c-7804-448e-9ac1-d04f090894fc None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:03.280032 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3416c-7804-448e-9ac1-d04f090894fc None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:03.285441 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fc01e-ed5e-46af-8fc6-f511aae61288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:03.286099 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fc01e-ed5e-46af-8fc6-f511aae61288 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:03.286510 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fc01e-ed5e-46af-8fc6-f511aae61288 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:03.286794 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fc01e-ed5e-46af-8fc6-f511aae61288 admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:03.287482 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220fc01e-ed5e-46af-8fc6-f511aae61288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:03.289436 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220fc01e-ed5e-46af-8fc6-f511aae61288 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:03.294147 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:03.402846 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1219/2456] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:05:03 2022] POST /identity/v3/projects => generated 403 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:05:03.407362 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051db072-f59e-4e29-9b0c-9784cb50baf9 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:03.419054 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051db072-f59e-4e29-9b0c-9784cb50baf9 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:03.487226 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4ed58-ac46-4a91-a52a-ca0016209e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:03.489789 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4ed58-ac46-4a91-a52a-ca0016209e1e admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:03.489789 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4ed58-ac46-4a91-a52a-ca0016209e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:03.489789 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4ed58-ac46-4a91-a52a-ca0016209e1e admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:03.489789 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4ed58-ac46-4a91-a52a-ca0016209e1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:03.491141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4ed58-ac46-4a91-a52a-ca0016209e1e admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:03.601241 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1238/2457] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:05:03 2022] POST /identity/v3/users => generated 302 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:05:03.605383 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fc01e-ed5e-46af-8fc6-f511aae61288 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:03.615679 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fc01e-ed5e-46af-8fc6-f511aae61288 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:03.620176 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb09f2b-3b50-4915-8fab-b656ec0b2c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:03.621036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb09f2b-3b50-4915-8fab-b656ec0b2c97 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:03.621367 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb09f2b-3b50-4915-8fab-b656ec0b2c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:03.621722 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb09f2b-3b50-4915-8fab-b656ec0b2c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:03.622447 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb09f2b-3b50-4915-8fab-b656ec0b2c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:03.624064 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb09f2b-3b50-4915-8fab-b656ec0b2c97 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:03.634006 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1220/2458] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:05:03.637864 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4ed58-ac46-4a91-a52a-ca0016209e1e admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:03.648687 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4ed58-ac46-4a91-a52a-ca0016209e1e admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:03.654160 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f5d59-7e0c-41d9-ba18-64103412a584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:03.654781 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f5d59-7e0c-41d9-ba18-64103412a584 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:03.655067 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f5d59-7e0c-41d9-ba18-64103412a584 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:03.655345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f5d59-7e0c-41d9-ba18-64103412a584 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:03.656224 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f5d59-7e0c-41d9-ba18-64103412a584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:03.658588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f5d59-7e0c-41d9-ba18-64103412a584 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:03.659865 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:03.669674 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1239/2459] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:05:03.673916 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb09f2b-3b50-4915-8fab-b656ec0b2c97 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:03.684009 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb09f2b-3b50-4915-8fab-b656ec0b2c97 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:03.688592 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafb4c6-8ace-4b09-8ff8-414781ecd98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:03.689579 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafb4c6-8ace-4b09-8ff8-414781ecd98b admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:03.689863 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafb4c6-8ace-4b09-8ff8-414781ecd98b admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:03.690211 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafb4c6-8ace-4b09-8ff8-414781ecd98b admin admin] PATH_INFO: `/v3/projects/dfb9db8647d34ce5bf716e021bdd232c/users/f14d7fd0888c458b8e1ed99ae814852a/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:03.705649 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafb4c6-8ace-4b09-8ff8-414781ecd98b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfb9db8647d34ce5bf716e021bdd232c, user_id=f14d7fd0888c458b8e1ed99ae814852a, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:03.708477 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafb4c6-8ace-4b09-8ff8-414781ecd98b admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:03.806731 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1221/2460] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:05:03 2022] PUT /identity/v3/projects/dfb9db8647d34ce5bf716e021bdd232c/users/f14d7fd0888c458b8e1ed99ae814852a/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:05:03.811778 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865affef-5eb8-4103-a5be-86fef1df6789 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:03.812072 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865affef-5eb8-4103-a5be-86fef1df6789 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:03.812409 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865affef-5eb8-4103-a5be-86fef1df6789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:03.830948 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-865affef-5eb8-4103-a5be-86fef1df6789 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:03.833489 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-865affef-5eb8-4103-a5be-86fef1df6789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:03.892434 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1240/2461] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:05:03.902107 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafb4c6-8ace-4b09-8ff8-414781ecd98b admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:03.903873 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-1dafb4c6-8ace-4b09-8ff8-414781ecd98b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:03.958173 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7741509-d026-4085-9120-9a09b9cfabc8 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:03.958548 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7741509-d026-4085-9120-9a09b9cfabc8 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:03.958938 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7741509-d026-4085-9120-9a09b9cfabc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:03.967346 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafb4c6-8ace-4b09-8ff8-414781ecd98b admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:03.971613 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6ea81-b120-481b-9e18-3f44acc235ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:03.972779 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6ea81-b120-481b-9e18-3f44acc235ca service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:03.973062 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6ea81-b120-481b-9e18-3f44acc235ca service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:03.973338 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6ea81-b120-481b-9e18-3f44acc235ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:03.977937 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-a7741509-d026-4085-9120-9a09b9cfabc8 None None] MFA Rules not processed for user `048fc48dd55a43f7b342533a9484c3ad`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:03.979170 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-a7741509-d026-4085-9120-9a09b9cfabc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:03.982521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6ea81-b120-481b-9e18-3f44acc235ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:03.983993 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6ea81-b120-481b-9e18-3f44acc235ca service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:03.994364 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1222/2462] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:05:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:05:04.038099 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1241/2463] 10.222.0.39 () {58 vars in 967 bytes} [Mon May 23 16:05:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:05:04.050539 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6ea81-b120-481b-9e18-3f44acc235ca service neutron] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:04.051976 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-2ac6ea81-b120-481b-9e18-3f44acc235ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:04.126097 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6ea81-b120-481b-9e18-3f44acc235ca service neutron] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:04.131435 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc586ea-abc1-4d35-952b-cbb18109d5fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b275a110936a44ce8d54793af1a34808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:04.132298 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc586ea-abc1-4d35-952b-cbb18109d5fb service swift] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:04.132400 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc586ea-abc1-4d35-952b-cbb18109d5fb service swift] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:04.132979 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc586ea-abc1-4d35-952b-cbb18109d5fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:04.143709 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc586ea-abc1-4d35-952b-cbb18109d5fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:04.145387 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc586ea-abc1-4d35-952b-cbb18109d5fb service swift] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:04.154861 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1223/2464] 10.222.0.39 () {60 vars in 1384 bytes} [Mon May 23 16:05:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 16:05:05.214506 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea11bc-1c42-41db-b555-cfd47b91ef8a None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:05.216811 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea11bc-1c42-41db-b555-cfd47b91ef8a None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:05.217104 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea11bc-1c42-41db-b555-cfd47b91ef8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:05.245989 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-b0ea11bc-1c42-41db-b555-cfd47b91ef8a None None] MFA Rules not processed for user `f14d7fd0888c458b8e1ed99ae814852a`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:05.247206 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-b0ea11bc-1c42-41db-b555-cfd47b91ef8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:05.318996 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1242/2465] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:05:05.331705 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc586ea-abc1-4d35-952b-cbb18109d5fb service swift] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:05.343515 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc586ea-abc1-4d35-952b-cbb18109d5fb service swift] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:05.349317 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b4acb-ace8-4dbc-8ed3-692aa0f5b386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:05.349970 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b4acb-ace8-4dbc-8ed3-692aa0f5b386 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:05.350256 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b4acb-ace8-4dbc-8ed3-692aa0f5b386 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:05.350548 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b4acb-ace8-4dbc-8ed3-692aa0f5b386 admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:05.351263 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b4acb-ace8-4dbc-8ed3-692aa0f5b386 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:05.353252 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b4acb-ace8-4dbc-8ed3-692aa0f5b386 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:05.441607 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1224/2466] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:05:05 2022] POST /identity/v3/projects => generated 405 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:05:05.444834 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea11bc-1c42-41db-b555-cfd47b91ef8a None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:05.455585 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea11bc-1c42-41db-b555-cfd47b91ef8a None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:05.483895 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:05.512720 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d6720-b81a-4942-b8f4-0367cb0b037f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:05.513406 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d6720-b81a-4942-b8f4-0367cb0b037f admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:05.513871 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d6720-b81a-4942-b8f4-0367cb0b037f admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:05.514199 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d6720-b81a-4942-b8f4-0367cb0b037f admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:05.515114 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d6720-b81a-4942-b8f4-0367cb0b037f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:05.517866 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d6720-b81a-4942-b8f4-0367cb0b037f admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:05.589203 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1243/2467] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:05:05 2022] POST /identity/v3/users => generated 309 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:05:05.593422 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b4acb-ace8-4dbc-8ed3-692aa0f5b386 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:05.604435 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b4acb-ace8-4dbc-8ed3-692aa0f5b386 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:05.609020 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ee9fd-0462-4bdb-add4-e3f3df3b4f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:05.610307 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ee9fd-0462-4bdb-add4-e3f3df3b4f74 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:05.610590 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ee9fd-0462-4bdb-add4-e3f3df3b4f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:05.610888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ee9fd-0462-4bdb-add4-e3f3df3b4f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:05.611765 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ee9fd-0462-4bdb-add4-e3f3df3b4f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:05.613284 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ee9fd-0462-4bdb-add4-e3f3df3b4f74 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:05.624517 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1225/2468] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:05:05.628765 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d6720-b81a-4942-b8f4-0367cb0b037f admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:05.639205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d6720-b81a-4942-b8f4-0367cb0b037f admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:05.644331 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6d324-962c-463d-953e-acad85d80e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:05.645246 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6d324-962c-463d-953e-acad85d80e49 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:05.645523 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6d324-962c-463d-953e-acad85d80e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:05.645796 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6d324-962c-463d-953e-acad85d80e49 admin admin] PATH_INFO: `/v3/projects/e3ccc02fc7a240f08ba4d669180a25e9/users/e04eb4119a2c41a2afef0099fed7fc63/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:05.661357 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c6d324-962c-463d-953e-acad85d80e49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ccc02fc7a240f08ba4d669180a25e9, user_id=e04eb4119a2c41a2afef0099fed7fc63, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:05.665086 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c6d324-962c-463d-953e-acad85d80e49 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:05.721312 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1244/2469] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:05:05 2022] PUT /identity/v3/projects/e3ccc02fc7a240f08ba4d669180a25e9/users/e04eb4119a2c41a2afef0099fed7fc63/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:05:05.725220 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ee9fd-0462-4bdb-add4-e3f3df3b4f74 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:05.736309 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ee9fd-0462-4bdb-add4-e3f3df3b4f74 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:05.744307 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:05.795238 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c9ed4c-c3c4-454a-8458-294ab25b0716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:05.796069 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9ed4c-c3c4-454a-8458-294ab25b0716 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:05.796878 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9ed4c-c3c4-454a-8458-294ab25b0716 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:05.797236 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9ed4c-c3c4-454a-8458-294ab25b0716 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:05.798309 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c9ed4c-c3c4-454a-8458-294ab25b0716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:05.800235 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c9ed4c-c3c4-454a-8458-294ab25b0716 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:05.813379 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1226/2470] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:05:05.814862 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6d324-962c-463d-953e-acad85d80e49 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:05.825168 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6d324-962c-463d-953e-acad85d80e49 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:05.830543 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3933f0-e559-4b6d-9f02-3da1b336a584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:05.831423 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3933f0-e559-4b6d-9f02-3da1b336a584 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:05.831743 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3933f0-e559-4b6d-9f02-3da1b336a584 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:05.832023 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3933f0-e559-4b6d-9f02-3da1b336a584 admin admin] PATH_INFO: `/v3/projects/e3ccc02fc7a240f08ba4d669180a25e9/users/e04eb4119a2c41a2afef0099fed7fc63/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:05.833981 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3933f0-e559-4b6d-9f02-3da1b336a584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ccc02fc7a240f08ba4d669180a25e9, user_id=e04eb4119a2c41a2afef0099fed7fc63, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:05.836694 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3933f0-e559-4b6d-9f02-3da1b336a584 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:05.847728 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1245/2471] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:05:05 2022] PUT /identity/v3/projects/e3ccc02fc7a240f08ba4d669180a25e9/users/e04eb4119a2c41a2afef0099fed7fc63/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:07.042225 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cd31d-fc1f-4c35-adeb-9cd343ed4604 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:07.042725 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cd31d-fc1f-4c35-adeb-9cd343ed4604 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:07.042856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cd31d-fc1f-4c35-adeb-9cd343ed4604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:07.071431 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-818cd31d-fc1f-4c35-adeb-9cd343ed4604 None None] MFA Rules not processed for user `e04eb4119a2c41a2afef0099fed7fc63`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:07.073149 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-818cd31d-fc1f-4c35-adeb-9cd343ed4604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:07.147986 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1227/2472] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:07 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:05:08.561423 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3933f0-e559-4b6d-9f02-3da1b336a584 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:08.635777 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3933f0-e559-4b6d-9f02-3da1b336a584 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:08.640825 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e05ee-7132-408a-b817-2239667006c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:08.643490 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e05ee-7132-408a-b817-2239667006c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:08.643490 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e05ee-7132-408a-b817-2239667006c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:08.643490 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e05ee-7132-408a-b817-2239667006c1 admin admin] PATH_INFO: `/v3/users/f14d7fd0888c458b8e1ed99ae814852a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:08.643847 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e05ee-7132-408a-b817-2239667006c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f14d7fd0888c458b8e1ed99ae814852a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:08.645703 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e05ee-7132-408a-b817-2239667006c1 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:08.849733 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-d93e05ee-7132-408a-b817-2239667006c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f14d7fd0888c458b8e1ed99ae814852a'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:08.850385 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-d93e05ee-7132-408a-b817-2239667006c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f14d7fd0888c458b8e1ed99ae814852a'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:08.851011 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-d93e05ee-7132-408a-b817-2239667006c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f14d7fd0888c458b8e1ed99ae814852a'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:08.926254 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-d93e05ee-7132-408a-b817-2239667006c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f14d7fd0888c458b8e1ed99ae814852a'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:08.934161 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-d93e05ee-7132-408a-b817-2239667006c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f14d7fd0888c458b8e1ed99ae814852a'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:08.951931 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1246/2473] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:05:08 2022] DELETE /identity/v3/users/f14d7fd0888c458b8e1ed99ae814852a => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:05:09.202335 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cd31d-fc1f-4c35-adeb-9cd343ed4604 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:09.219802 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cd31d-fc1f-4c35-adeb-9cd343ed4604 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:09.282637 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863417c-7327-4324-b16b-ad4a4068863d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:09.283646 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863417c-7327-4324-b16b-ad4a4068863d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:09.283939 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863417c-7327-4324-b16b-ad4a4068863d admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:09.284220 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863417c-7327-4324-b16b-ad4a4068863d admin admin] PATH_INFO: `/v3/projects/dfb9db8647d34ce5bf716e021bdd232c` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:09.285403 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863417c-7327-4324-b16b-ad4a4068863d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfb9db8647d34ce5bf716e021bdd232c)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:09.287313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863417c-7327-4324-b16b-ad4a4068863d admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:09.386055 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:09.396537 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-5863417c-7327-4324-b16b-ad4a4068863d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfb9db8647d34ce5bf716e021bdd232c', 'request_id': 'req-5863417c-7327-4324-b16b-ad4a4068863d'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:09.401984 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-5863417c-7327-4324-b16b-ad4a4068863d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfb9db8647d34ce5bf716e021bdd232c', 'request_id': 'req-5863417c-7327-4324-b16b-ad4a4068863d'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:09.470421 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-5863417c-7327-4324-b16b-ad4a4068863d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfb9db8647d34ce5bf716e021bdd232c', 'request_id': 'req-5863417c-7327-4324-b16b-ad4a4068863d'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:09.482319 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-5863417c-7327-4324-b16b-ad4a4068863d admin admin] The token cache is being invalidate because project dfb9db8647d34ce5bf716e021bdd232c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:05:09.482610 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-5863417c-7327-4324-b16b-ad4a4068863d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:09.483257 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-5863417c-7327-4324-b16b-ad4a4068863d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:09.485968 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1228/2474] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:05:09 2022] DELETE /identity/v3/projects/dfb9db8647d34ce5bf716e021bdd232c => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:05:09.489913 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e05ee-7132-408a-b817-2239667006c1 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:09.491322 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-d93e05ee-7132-408a-b817-2239667006c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:09.499481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:09.505320 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e05ee-7132-408a-b817-2239667006c1 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:09.565121 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e710c0-b707-4ea9-9930-4777a4966b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:09.566022 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e710c0-b707-4ea9-9930-4777a4966b3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:09.566308 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e710c0-b707-4ea9-9930-4777a4966b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:09.566643 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e710c0-b707-4ea9-9930-4777a4966b3a admin admin] PATH_INFO: `/v3/users/e04eb4119a2c41a2afef0099fed7fc63` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:09.567871 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e710c0-b707-4ea9-9930-4777a4966b3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e04eb4119a2c41a2afef0099fed7fc63)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:09.569794 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e710c0-b707-4ea9-9930-4777a4966b3a admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:09.734060 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-34e710c0-b707-4ea9-9930-4777a4966b3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e04eb4119a2c41a2afef0099fed7fc63'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:09.735318 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-34e710c0-b707-4ea9-9930-4777a4966b3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e04eb4119a2c41a2afef0099fed7fc63'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:09.735962 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-34e710c0-b707-4ea9-9930-4777a4966b3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e04eb4119a2c41a2afef0099fed7fc63'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:09.784014 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-34e710c0-b707-4ea9-9930-4777a4966b3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e04eb4119a2c41a2afef0099fed7fc63'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:09.791986 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-34e710c0-b707-4ea9-9930-4777a4966b3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e04eb4119a2c41a2afef0099fed7fc63'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:09.813743 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1247/2475] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:05:09 2022] DELETE /identity/v3/users/e04eb4119a2c41a2afef0099fed7fc63 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:10.065178 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863417c-7327-4324-b16b-ad4a4068863d admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:10.066647 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-5863417c-7327-4324-b16b-ad4a4068863d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:10.081523 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863417c-7327-4324-b16b-ad4a4068863d admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:10.139318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369651bb-a25a-4957-8bd1-c7ce16213816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:10.140220 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369651bb-a25a-4957-8bd1-c7ce16213816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:10.140509 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369651bb-a25a-4957-8bd1-c7ce16213816 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:10.141458 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369651bb-a25a-4957-8bd1-c7ce16213816 admin admin] PATH_INFO: `/v3/projects/e3ccc02fc7a240f08ba4d669180a25e9` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:10.146793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369651bb-a25a-4957-8bd1-c7ce16213816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3ccc02fc7a240f08ba4d669180a25e9)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:10.146793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369651bb-a25a-4957-8bd1-c7ce16213816 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:10.274683 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-369651bb-a25a-4957-8bd1-c7ce16213816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3ccc02fc7a240f08ba4d669180a25e9', 'request_id': 'req-369651bb-a25a-4957-8bd1-c7ce16213816'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:10.280475 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-369651bb-a25a-4957-8bd1-c7ce16213816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3ccc02fc7a240f08ba4d669180a25e9', 'request_id': 'req-369651bb-a25a-4957-8bd1-c7ce16213816'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:10.337148 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-369651bb-a25a-4957-8bd1-c7ce16213816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3ccc02fc7a240f08ba4d669180a25e9', 'request_id': 'req-369651bb-a25a-4957-8bd1-c7ce16213816'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:10.348723 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-369651bb-a25a-4957-8bd1-c7ce16213816 admin admin] The token cache is being invalidate because project e3ccc02fc7a240f08ba4d669180a25e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:05:10.349009 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-369651bb-a25a-4957-8bd1-c7ce16213816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:10.349642 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-369651bb-a25a-4957-8bd1-c7ce16213816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:10.351186 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1229/2476] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:05:10 2022] DELETE /identity/v3/projects/e3ccc02fc7a240f08ba4d669180a25e9 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:10.356239 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5c089-9f34-4e29-8935-b43a46421499 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:10.356540 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5c089-9f34-4e29-8935-b43a46421499 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:10.356820 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5c089-9f34-4e29-8935-b43a46421499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:10.377023 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-efa5c089-9f34-4e29-8935-b43a46421499 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:10.378219 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-efa5c089-9f34-4e29-8935-b43a46421499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:10.437409 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1248/2477] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:05:10.454314 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81292835-e5c9-4d54-9617-eab768791ffc None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:10.454606 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81292835-e5c9-4d54-9617-eab768791ffc None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:10.454891 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81292835-e5c9-4d54-9617-eab768791ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:10.473291 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-81292835-e5c9-4d54-9617-eab768791ffc None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:10.474486 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-81292835-e5c9-4d54-9617-eab768791ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:10.482595 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1230/2478] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:05:10.487926 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5c089-9f34-4e29-8935-b43a46421499 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:10.497853 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5c089-9f34-4e29-8935-b43a46421499 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:10.503407 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ddc7f5-041a-4429-85ea-a6be943ffb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:10.504114 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddc7f5-041a-4429-85ea-a6be943ffb3e admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:10.504399 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddc7f5-041a-4429-85ea-a6be943ffb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:10.504679 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddc7f5-041a-4429-85ea-a6be943ffb3e admin admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:10.505408 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ddc7f5-041a-4429-85ea-a6be943ffb3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:05:10.505718 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ddc7f5-041a-4429-85ea-a6be943ffb3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:10.507321 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ddc7f5-041a-4429-85ea-a6be943ffb3e admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:10.523468 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1249/2479] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 16:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:05:10.524387 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81292835-e5c9-4d54-9617-eab768791ffc None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:10.534011 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81292835-e5c9-4d54-9617-eab768791ffc None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:10.538758 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b00778-8d50-4caa-b465-bc15244c1363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:10.539414 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b00778-8d50-4caa-b465-bc15244c1363 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:10.539745 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b00778-8d50-4caa-b465-bc15244c1363 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:10.540063 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b00778-8d50-4caa-b465-bc15244c1363 admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:10.545340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b00778-8d50-4caa-b465-bc15244c1363 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:10.545340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b00778-8d50-4caa-b465-bc15244c1363 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:10.625320 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1231/2480] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:05:10 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:05:10.629632 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ddc7f5-041a-4429-85ea-a6be943ffb3e admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:10.640090 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ddc7f5-041a-4429-85ea-a6be943ffb3e admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:10.645261 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:10.697240 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d974035-971f-4e0c-84c0-a31e4f2f0fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:10.697917 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d974035-971f-4e0c-84c0-a31e4f2f0fef admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:10.698206 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d974035-971f-4e0c-84c0-a31e4f2f0fef admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:10.698489 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d974035-971f-4e0c-84c0-a31e4f2f0fef admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:10.699184 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d974035-971f-4e0c-84c0-a31e4f2f0fef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:10.701177 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d974035-971f-4e0c-84c0-a31e4f2f0fef admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:10.789419 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1250/2481] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:05:10 2022] POST /identity/v3/users => generated 283 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:05:10.793505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b00778-8d50-4caa-b465-bc15244c1363 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:10.805546 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b00778-8d50-4caa-b465-bc15244c1363 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:10.810213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716f75f-1ebd-4df5-a6f5-eac4bd91f5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:10.810870 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716f75f-1ebd-4df5-a6f5-eac4bd91f5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:10.811156 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716f75f-1ebd-4df5-a6f5-eac4bd91f5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:10.811434 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716f75f-1ebd-4df5-a6f5-eac4bd91f5c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:10.812210 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716f75f-1ebd-4df5-a6f5-eac4bd91f5c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:10.814312 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716f75f-1ebd-4df5-a6f5-eac4bd91f5c2 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:10.824779 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1232/2482] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:05:10.828872 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d974035-971f-4e0c-84c0-a31e4f2f0fef admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:10.838949 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d974035-971f-4e0c-84c0-a31e4f2f0fef admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:10.843676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88225df6-30a8-4d02-abbb-bf4f9597f539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:10.844917 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88225df6-30a8-4d02-abbb-bf4f9597f539 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:10.845126 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88225df6-30a8-4d02-abbb-bf4f9597f539 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:10.845404 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88225df6-30a8-4d02-abbb-bf4f9597f539 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:10.846133 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88225df6-30a8-4d02-abbb-bf4f9597f539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:10.847756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88225df6-30a8-4d02-abbb-bf4f9597f539 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:10.857758 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1251/2483] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:05:10.862196 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716f75f-1ebd-4df5-a6f5-eac4bd91f5c2 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:10.872095 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716f75f-1ebd-4df5-a6f5-eac4bd91f5c2 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:10.876669 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3aaa9-1b08-4f91-b783-c8b31367c946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:10.877529 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3aaa9-1b08-4f91-b783-c8b31367c946 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:10.877812 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3aaa9-1b08-4f91-b783-c8b31367c946 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:10.878085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3aaa9-1b08-4f91-b783-c8b31367c946 admin admin] PATH_INFO: `/v3/projects/7344f40475ac4777a4faeb6dbd111243/users/cc1a90700dd74181b1f7f54fd82a0c49/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:10.889131 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:10.893467 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3aaa9-1b08-4f91-b783-c8b31367c946 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7344f40475ac4777a4faeb6dbd111243, user_id=cc1a90700dd74181b1f7f54fd82a0c49, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:10.899734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3aaa9-1b08-4f91-b783-c8b31367c946 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:10.978034 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1233/2484] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:05:10 2022] PUT /identity/v3/projects/7344f40475ac4777a4faeb6dbd111243/users/cc1a90700dd74181b1f7f54fd82a0c49/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:05:10.989046 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13774efd-8df9-4eb2-820e-5e694aa18140 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:10.989357 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13774efd-8df9-4eb2-820e-5e694aa18140 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:10.989642 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13774efd-8df9-4eb2-820e-5e694aa18140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:11.017686 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-13774efd-8df9-4eb2-820e-5e694aa18140 None None] MFA Rules not processed for user `cc1a90700dd74181b1f7f54fd82a0c49`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:11.018904 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-13774efd-8df9-4eb2-820e-5e694aa18140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:11.084138 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1252/2485] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:05:11.088795 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3aaa9-1b08-4f91-b783-c8b31367c946 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:11.153460 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3aaa9-1b08-4f91-b783-c8b31367c946 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:11.158197 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7693c0e-a7ae-4df2-bb33-6221070f0b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:11.158850 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7693c0e-a7ae-4df2-bb33-6221070f0b95 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:11.159131 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7693c0e-a7ae-4df2-bb33-6221070f0b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:11.159411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7693c0e-a7ae-4df2-bb33-6221070f0b95 admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:11.160140 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7693c0e-a7ae-4df2-bb33-6221070f0b95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:11.162051 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7693c0e-a7ae-4df2-bb33-6221070f0b95 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:11.273068 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1234/2486] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:05:11 2022] POST /identity/v3/projects => generated 365 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:05:11.274292 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13774efd-8df9-4eb2-820e-5e694aa18140 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:11.285566 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13774efd-8df9-4eb2-820e-5e694aa18140 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:11.362406 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862f623-1144-4ea4-8fe4-cf613400bc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:11.363118 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862f623-1144-4ea4-8fe4-cf613400bc14 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:11.363520 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862f623-1144-4ea4-8fe4-cf613400bc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:11.363733 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862f623-1144-4ea4-8fe4-cf613400bc14 admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:11.368983 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862f623-1144-4ea4-8fe4-cf613400bc14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:11.368983 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862f623-1144-4ea4-8fe4-cf613400bc14 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:11.469532 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1253/2487] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:05:11 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:05:11.473472 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7693c0e-a7ae-4df2-bb33-6221070f0b95 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:11.483684 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7693c0e-a7ae-4df2-bb33-6221070f0b95 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:11.488988 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b17bce-c4a2-431d-a826-40d311778563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:11.489660 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b17bce-c4a2-431d-a826-40d311778563 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:11.489941 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b17bce-c4a2-431d-a826-40d311778563 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:11.490214 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b17bce-c4a2-431d-a826-40d311778563 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:11.490959 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b17bce-c4a2-431d-a826-40d311778563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:11.492572 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b17bce-c4a2-431d-a826-40d311778563 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:11.503071 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1235/2488] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:05:11.507240 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862f623-1144-4ea4-8fe4-cf613400bc14 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:11.517694 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862f623-1144-4ea4-8fe4-cf613400bc14 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:11.522230 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fc13f-0b05-4189-aca4-44069e1aaf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:11.523126 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fc13f-0b05-4189-aca4-44069e1aaf6a admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:11.523408 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fc13f-0b05-4189-aca4-44069e1aaf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:11.523784 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fc13f-0b05-4189-aca4-44069e1aaf6a admin admin] PATH_INFO: `/v3/projects/6b086923ead641cc8c14478835d07e1e/users/6679aa41dfd54a53b499194ec99d72e8/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:11.526008 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:11.539373 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4fc13f-0b05-4189-aca4-44069e1aaf6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b086923ead641cc8c14478835d07e1e, user_id=6679aa41dfd54a53b499194ec99d72e8, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:11.542059 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4fc13f-0b05-4189-aca4-44069e1aaf6a admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:11.646469 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1254/2489] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:05:11 2022] PUT /identity/v3/projects/6b086923ead641cc8c14478835d07e1e/users/6679aa41dfd54a53b499194ec99d72e8/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:11.648980 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b17bce-c4a2-431d-a826-40d311778563 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:11.661966 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b17bce-c4a2-431d-a826-40d311778563 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:11.739026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8797e7d-b027-4e09-9b5b-3045bbe776e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:11.739737 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8797e7d-b027-4e09-9b5b-3045bbe776e4 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:11.747059 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8797e7d-b027-4e09-9b5b-3045bbe776e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:11.747059 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8797e7d-b027-4e09-9b5b-3045bbe776e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:11.747059 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8797e7d-b027-4e09-9b5b-3045bbe776e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:11.747059 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8797e7d-b027-4e09-9b5b-3045bbe776e4 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:11.754370 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1236/2490] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:05:11.758317 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fc13f-0b05-4189-aca4-44069e1aaf6a admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:11.770070 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fc13f-0b05-4189-aca4-44069e1aaf6a admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:11.774774 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea7db1-b878-4139-be73-fb33c0e0058c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:11.775740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea7db1-b878-4139-be73-fb33c0e0058c admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:11.776030 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea7db1-b878-4139-be73-fb33c0e0058c admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:11.776304 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea7db1-b878-4139-be73-fb33c0e0058c admin admin] PATH_INFO: `/v3/projects/6b086923ead641cc8c14478835d07e1e/users/6679aa41dfd54a53b499194ec99d72e8/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:11.778410 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea7db1-b878-4139-be73-fb33c0e0058c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b086923ead641cc8c14478835d07e1e, user_id=6679aa41dfd54a53b499194ec99d72e8, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:11.781113 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea7db1-b878-4139-be73-fb33c0e0058c admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:11.792470 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1255/2491] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:05:11 2022] PUT /identity/v3/projects/6b086923ead641cc8c14478835d07e1e/users/6679aa41dfd54a53b499194ec99d72e8/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:11.804340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fea8eb-b333-4df8-8951-6955ee9dd195 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:11.804633 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fea8eb-b333-4df8-8951-6955ee9dd195 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:11.804914 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fea8eb-b333-4df8-8951-6955ee9dd195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:11.832776 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-02fea8eb-b333-4df8-8951-6955ee9dd195 None None] MFA Rules not processed for user `6679aa41dfd54a53b499194ec99d72e8`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:11.833960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-02fea8eb-b333-4df8-8951-6955ee9dd195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:11.883006 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:11.907402 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1237/2492] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:11 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:05:11.919112 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea7db1-b878-4139-be73-fb33c0e0058c admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:11.921095 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-d3ea7db1-b878-4139-be73-fb33c0e0058c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:11.979123 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea7db1-b878-4139-be73-fb33c0e0058c admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:11.982889 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a890d4d-e687-44bf-a634-2f043e3e37a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:11.983528 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a890d4d-e687-44bf-a634-2f043e3e37a3 service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:11.983840 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a890d4d-e687-44bf-a634-2f043e3e37a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:11.984117 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a890d4d-e687-44bf-a634-2f043e3e37a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:11.995804 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a890d4d-e687-44bf-a634-2f043e3e37a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:11.997235 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a890d4d-e687-44bf-a634-2f043e3e37a3 service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:12.006794 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1256/2493] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:05:11 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:05:12.922987 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fea8eb-b333-4df8-8951-6955ee9dd195 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:12.990638 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fea8eb-b333-4df8-8951-6955ee9dd195 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:12.995208 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e717a-906a-44bf-acf0-261ace8f5842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:12.996141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e717a-906a-44bf-acf0-261ace8f5842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:12.996422 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e717a-906a-44bf-acf0-261ace8f5842 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:12.996697 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e717a-906a-44bf-acf0-261ace8f5842 admin admin] PATH_INFO: `/v3/users/cc1a90700dd74181b1f7f54fd82a0c49` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:12.998653 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e717a-906a-44bf-acf0-261ace8f5842 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc1a90700dd74181b1f7f54fd82a0c49)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:13.001188 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e717a-906a-44bf-acf0-261ace8f5842 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:13.176389 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-145e717a-906a-44bf-acf0-261ace8f5842 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc1a90700dd74181b1f7f54fd82a0c49'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:13.183415 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-145e717a-906a-44bf-acf0-261ace8f5842 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc1a90700dd74181b1f7f54fd82a0c49'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:13.184132 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-145e717a-906a-44bf-acf0-261ace8f5842 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc1a90700dd74181b1f7f54fd82a0c49'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:13.197390 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-145e717a-906a-44bf-acf0-261ace8f5842 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc1a90700dd74181b1f7f54fd82a0c49'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:13.252193 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-145e717a-906a-44bf-acf0-261ace8f5842 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc1a90700dd74181b1f7f54fd82a0c49'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:13.259251 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1238/2494] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:05:12 2022] DELETE /identity/v3/users/cc1a90700dd74181b1f7f54fd82a0c49 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:13.263849 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7006a-fe82-4ff6-a268-dad181063659 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:13.264342 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7006a-fe82-4ff6-a268-dad181063659 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:13.264439 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7006a-fe82-4ff6-a268-dad181063659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:13.288031 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-b5e7006a-fe82-4ff6-a268-dad181063659 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:13.289257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-b5e7006a-fe82-4ff6-a268-dad181063659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:13.349168 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1257/2495] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:05:13.358508 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e717a-906a-44bf-acf0-261ace8f5842 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:13.360621 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-145e717a-906a-44bf-acf0-261ace8f5842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:13.421567 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e717a-906a-44bf-acf0-261ace8f5842 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:13.426460 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bebfe49-ae3c-4ab8-93a8-186192021605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:13.427108 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebfe49-ae3c-4ab8-93a8-186192021605 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:13.427387 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebfe49-ae3c-4ab8-93a8-186192021605 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:13.427691 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebfe49-ae3c-4ab8-93a8-186192021605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:13.437288 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bebfe49-ae3c-4ab8-93a8-186192021605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:13.441869 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bebfe49-ae3c-4ab8-93a8-186192021605 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:13.449509 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1239/2496] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:05:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:05:13.904613 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7006a-fe82-4ff6-a268-dad181063659 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:13.906111 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-b5e7006a-fe82-4ff6-a268-dad181063659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:13.921138 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7006a-fe82-4ff6-a268-dad181063659 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:13.927644 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0972b-7a44-4375-83a8-2f9774cc4bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:13.928627 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0972b-7a44-4375-83a8-2f9774cc4bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:13.929099 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0972b-7a44-4375-83a8-2f9774cc4bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:13.929398 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0972b-7a44-4375-83a8-2f9774cc4bdb admin admin] PATH_INFO: `/v3/projects/7344f40475ac4777a4faeb6dbd111243` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:13.931451 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0972b-7a44-4375-83a8-2f9774cc4bdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7344f40475ac4777a4faeb6dbd111243)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:13.936638 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0972b-7a44-4375-83a8-2f9774cc4bdb admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:14.058057 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-32f0972b-7a44-4375-83a8-2f9774cc4bdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7344f40475ac4777a4faeb6dbd111243', 'request_id': 'req-32f0972b-7a44-4375-83a8-2f9774cc4bdb'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:14.064657 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-32f0972b-7a44-4375-83a8-2f9774cc4bdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7344f40475ac4777a4faeb6dbd111243', 'request_id': 'req-32f0972b-7a44-4375-83a8-2f9774cc4bdb'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:14.137313 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-32f0972b-7a44-4375-83a8-2f9774cc4bdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7344f40475ac4777a4faeb6dbd111243', 'request_id': 'req-32f0972b-7a44-4375-83a8-2f9774cc4bdb'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:14.143382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:14.154353 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-32f0972b-7a44-4375-83a8-2f9774cc4bdb admin admin] The token cache is being invalidate because project 7344f40475ac4777a4faeb6dbd111243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:05:14.154353 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-32f0972b-7a44-4375-83a8-2f9774cc4bdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:14.154353 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-32f0972b-7a44-4375-83a8-2f9774cc4bdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:14.154353 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1258/2497] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:05:13 2022] DELETE /identity/v3/projects/7344f40475ac4777a4faeb6dbd111243 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:14.157474 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bebfe49-ae3c-4ab8-93a8-186192021605 service neutron] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:14.166935 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bebfe49-ae3c-4ab8-93a8-186192021605 service neutron] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:14.170465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:14.225384 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7c5b3-ea03-4472-af14-be1d800932e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:14.226249 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7c5b3-ea03-4472-af14-be1d800932e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:14.226528 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7c5b3-ea03-4472-af14-be1d800932e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:14.226797 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7c5b3-ea03-4472-af14-be1d800932e3 admin admin] PATH_INFO: `/v3/users/6679aa41dfd54a53b499194ec99d72e8` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:14.228099 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a7c5b3-ea03-4472-af14-be1d800932e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6679aa41dfd54a53b499194ec99d72e8)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:14.230088 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a7c5b3-ea03-4472-af14-be1d800932e3 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:14.419363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-94a7c5b3-ea03-4472-af14-be1d800932e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6679aa41dfd54a53b499194ec99d72e8'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:14.427182 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-94a7c5b3-ea03-4472-af14-be1d800932e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6679aa41dfd54a53b499194ec99d72e8'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:14.427869 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-94a7c5b3-ea03-4472-af14-be1d800932e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6679aa41dfd54a53b499194ec99d72e8'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:14.439622 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-94a7c5b3-ea03-4472-af14-be1d800932e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6679aa41dfd54a53b499194ec99d72e8'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:14.519772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-94a7c5b3-ea03-4472-af14-be1d800932e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6679aa41dfd54a53b499194ec99d72e8'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:14.526372 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1240/2498] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:05:14 2022] DELETE /identity/v3/users/6679aa41dfd54a53b499194ec99d72e8 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:14.915794 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0972b-7a44-4375-83a8-2f9774cc4bdb admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:14.917332 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-32f0972b-7a44-4375-83a8-2f9774cc4bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:14.930829 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0972b-7a44-4375-83a8-2f9774cc4bdb admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:14.989602 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6de18-2923-44e1-9ef4-4f6cdcdb5a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:14.990409 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6de18-2923-44e1-9ef4-4f6cdcdb5a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:14.990690 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6de18-2923-44e1-9ef4-4f6cdcdb5a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:14.990966 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6de18-2923-44e1-9ef4-4f6cdcdb5a71 admin admin] PATH_INFO: `/v3/projects/6b086923ead641cc8c14478835d07e1e` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:14.992219 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6de18-2923-44e1-9ef4-4f6cdcdb5a71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b086923ead641cc8c14478835d07e1e)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:14.994100 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6de18-2923-44e1-9ef4-4f6cdcdb5a71 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:15.092387 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-26d6de18-2923-44e1-9ef4-4f6cdcdb5a71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b086923ead641cc8c14478835d07e1e', 'request_id': 'req-26d6de18-2923-44e1-9ef4-4f6cdcdb5a71'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:15.099204 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-26d6de18-2923-44e1-9ef4-4f6cdcdb5a71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b086923ead641cc8c14478835d07e1e', 'request_id': 'req-26d6de18-2923-44e1-9ef4-4f6cdcdb5a71'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:15.115329 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205112c-a78b-4795-97a7-54be2fe22f81 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:15.116341 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205112c-a78b-4795-97a7-54be2fe22f81 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:15.116341 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205112c-a78b-4795-97a7-54be2fe22f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:15.134943 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-d205112c-a78b-4795-97a7-54be2fe22f81 None None] MFA Rules not processed for user `048fc48dd55a43f7b342533a9484c3ad`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:15.136300 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-d205112c-a78b-4795-97a7-54be2fe22f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:15.143759 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-26d6de18-2923-44e1-9ef4-4f6cdcdb5a71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b086923ead641cc8c14478835d07e1e', 'request_id': 'req-26d6de18-2923-44e1-9ef4-4f6cdcdb5a71'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:15.157406 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-26d6de18-2923-44e1-9ef4-4f6cdcdb5a71 admin admin] The token cache is being invalidate because project 6b086923ead641cc8c14478835d07e1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:05:15.157693 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-26d6de18-2923-44e1-9ef4-4f6cdcdb5a71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:15.158350 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-26d6de18-2923-44e1-9ef4-4f6cdcdb5a71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:15.159973 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1259/2499] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:05:14 2022] DELETE /identity/v3/projects/6b086923ead641cc8c14478835d07e1e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:15.168714 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedee662-eb40-4cb2-8ec8-19cef74af88c None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:15.169007 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedee662-eb40-4cb2-8ec8-19cef74af88c None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:15.169291 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedee662-eb40-4cb2-8ec8-19cef74af88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:15.189533 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-dedee662-eb40-4cb2-8ec8-19cef74af88c None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:15.190756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-dedee662-eb40-4cb2-8ec8-19cef74af88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:15.197079 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1241/2500] 10.222.0.39 () {58 vars in 1009 bytes} [Mon May 23 16:05:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:05:15.220046 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205112c-a78b-4795-97a7-54be2fe22f81 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:15.221521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-d205112c-a78b-4795-97a7-54be2fe22f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:15.255435 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1260/2501] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:05:15.257445 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:15.263022 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3ecd9-e313-4756-a283-cc67ef116e82 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:15.263333 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3ecd9-e313-4756-a283-cc67ef116e82 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:15.263592 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3ecd9-e313-4756-a283-cc67ef116e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:15.282637 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-79e3ecd9-e313-4756-a283-cc67ef116e82 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:15.285928 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-79e3ecd9-e313-4756-a283-cc67ef116e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:15.292023 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1261/2502] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:05:15.295018 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205112c-a78b-4795-97a7-54be2fe22f81 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:15.296125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3ecd9-e313-4756-a283-cc67ef116e82 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:15.301184 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c26dd-4ace-4663-b883-6306561622ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b275a110936a44ce8d54793af1a34808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:15.301834 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c26dd-4ace-4663-b883-6306561622ae service swift] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:15.302124 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c26dd-4ace-4663-b883-6306561622ae service swift] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:15.302402 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c26dd-4ace-4663-b883-6306561622ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:15.305437 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3ecd9-e313-4756-a283-cc67ef116e82 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:15.310076 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83104a-8e5a-4b7f-b2a7-fedfe2e31100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:15.310722 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c26dd-4ace-4663-b883-6306561622ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:15.310855 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83104a-8e5a-4b7f-b2a7-fedfe2e31100 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:15.310998 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83104a-8e5a-4b7f-b2a7-fedfe2e31100 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:15.311308 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83104a-8e5a-4b7f-b2a7-fedfe2e31100 admin admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:15.312164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83104a-8e5a-4b7f-b2a7-fedfe2e31100 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:05:15.312935 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c26dd-4ace-4663-b883-6306561622ae service swift] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:15.313064 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83104a-8e5a-4b7f-b2a7-fedfe2e31100 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:15.314795 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83104a-8e5a-4b7f-b2a7-fedfe2e31100 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:15.321738 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1242/2503] 10.222.0.39 () {60 vars in 1384 bytes} [Mon May 23 16:05:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 23 16:05:15.331948 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1262/2504] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 16:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:05:15.333309 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c26dd-4ace-4663-b883-6306561622ae service swift] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:15.343592 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c26dd-4ace-4663-b883-6306561622ae service swift] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:15.350039 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e1e1fb-ef64-4477-8e68-176feea64b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:15.350684 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1e1fb-ef64-4477-8e68-176feea64b20 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:15.350973 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1e1fb-ef64-4477-8e68-176feea64b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:15.351250 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1e1fb-ef64-4477-8e68-176feea64b20 admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:15.351985 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e1e1fb-ef64-4477-8e68-176feea64b20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:15.353918 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e1e1fb-ef64-4477-8e68-176feea64b20 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:15.458999 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1243/2505] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:05:15 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:05:15.463344 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83104a-8e5a-4b7f-b2a7-fedfe2e31100 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:15.474746 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83104a-8e5a-4b7f-b2a7-fedfe2e31100 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:15.481211 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:15.558491 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7b834-6efe-4905-b297-5e5ed4c18bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:15.559421 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7b834-6efe-4905-b297-5e5ed4c18bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:15.559916 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7b834-6efe-4905-b297-5e5ed4c18bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:15.560336 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7b834-6efe-4905-b297-5e5ed4c18bd2 admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:15.561235 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7b834-6efe-4905-b297-5e5ed4c18bd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:15.563453 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7b834-6efe-4905-b297-5e5ed4c18bd2 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:15.659766 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1263/2506] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:05:15 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:05:15.663933 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e1e1fb-ef64-4477-8e68-176feea64b20 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:15.679819 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e1e1fb-ef64-4477-8e68-176feea64b20 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:15.686450 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56411d4-9136-4a9b-b197-cf69b8825b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:15.687204 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56411d4-9136-4a9b-b197-cf69b8825b7d admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:15.687716 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56411d4-9136-4a9b-b197-cf69b8825b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:15.688235 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56411d4-9136-4a9b-b197-cf69b8825b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:15.689194 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56411d4-9136-4a9b-b197-cf69b8825b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:15.691308 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56411d4-9136-4a9b-b197-cf69b8825b7d admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:15.707961 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1244/2507] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:05:15.712968 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7b834-6efe-4905-b297-5e5ed4c18bd2 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:15.727442 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7b834-6efe-4905-b297-5e5ed4c18bd2 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:15.733547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de98707-f9cb-4e85-bd9b-7dae9343c4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:15.735235 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de98707-f9cb-4e85-bd9b-7dae9343c4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:15.735726 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de98707-f9cb-4e85-bd9b-7dae9343c4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:15.736126 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de98707-f9cb-4e85-bd9b-7dae9343c4c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:15.737081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de98707-f9cb-4e85-bd9b-7dae9343c4c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:15.739222 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de98707-f9cb-4e85-bd9b-7dae9343c4c8 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:15.755663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1264/2508] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:05:15.757378 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56411d4-9136-4a9b-b197-cf69b8825b7d admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:15.768720 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56411d4-9136-4a9b-b197-cf69b8825b7d admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:15.773603 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1275293-cc1d-4e23-8d31-348b4c530bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:15.774708 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1275293-cc1d-4e23-8d31-348b4c530bca admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:15.774958 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1275293-cc1d-4e23-8d31-348b4c530bca admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:15.775239 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1275293-cc1d-4e23-8d31-348b4c530bca admin admin] PATH_INFO: `/v3/projects/8aa909d95fcf4a9286a5bfdb0c90c3f2/users/3aac08c8d5684bd8be6a66159228f4fd/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:15.791464 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1275293-cc1d-4e23-8d31-348b4c530bca admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aa909d95fcf4a9286a5bfdb0c90c3f2, user_id=3aac08c8d5684bd8be6a66159228f4fd, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:15.794151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1275293-cc1d-4e23-8d31-348b4c530bca admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:15.880291 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1245/2509] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:05:15 2022] PUT /identity/v3/projects/8aa909d95fcf4a9286a5bfdb0c90c3f2/users/3aac08c8d5684bd8be6a66159228f4fd/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:15.886334 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517f098-9b5e-489f-984b-b7bb4f092ad1 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:15.886909 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517f098-9b5e-489f-984b-b7bb4f092ad1 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:15.887309 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517f098-9b5e-489f-984b-b7bb4f092ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:15.921580 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-f517f098-9b5e-489f-984b-b7bb4f092ad1 None None] MFA Rules not processed for user `3aac08c8d5684bd8be6a66159228f4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:15.923997 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-f517f098-9b5e-489f-984b-b7bb4f092ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:15.998787 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1265/2510] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:05:16.003506 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1275293-cc1d-4e23-8d31-348b4c530bca admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:16.085690 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1275293-cc1d-4e23-8d31-348b4c530bca admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:16.091282 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02fc71-7be3-4f04-871d-d25bee0588e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:16.092216 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02fc71-7be3-4f04-871d-d25bee0588e2 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:16.092566 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02fc71-7be3-4f04-871d-d25bee0588e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:16.092912 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02fc71-7be3-4f04-871d-d25bee0588e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:16.094201 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02fc71-7be3-4f04-871d-d25bee0588e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:16.096381 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02fc71-7be3-4f04-871d-d25bee0588e2 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:16.189541 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1246/2511] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:05:16 2022] POST /identity/v3/projects => generated 387 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:05:16.205682 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517f098-9b5e-489f-984b-b7bb4f092ad1 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:16.228794 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517f098-9b5e-489f-984b-b7bb4f092ad1 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:16.309718 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65110cde-5dc6-41b3-be23-ac2551c99643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:16.310448 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65110cde-5dc6-41b3-be23-ac2551c99643 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:16.310767 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65110cde-5dc6-41b3-be23-ac2551c99643 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:16.311042 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65110cde-5dc6-41b3-be23-ac2551c99643 admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:16.311840 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65110cde-5dc6-41b3-be23-ac2551c99643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:16.314104 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65110cde-5dc6-41b3-be23-ac2551c99643 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:16.403792 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1266/2512] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:05:16 2022] POST /identity/v3/users => generated 300 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:05:16.404270 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02fc71-7be3-4f04-871d-d25bee0588e2 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:16.416301 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02fc71-7be3-4f04-871d-d25bee0588e2 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:16.421730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737417c2-a649-4667-bb51-60684adb14b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:16.422710 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737417c2-a649-4667-bb51-60684adb14b7 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:16.423213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737417c2-a649-4667-bb51-60684adb14b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:16.423498 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737417c2-a649-4667-bb51-60684adb14b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:16.424694 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737417c2-a649-4667-bb51-60684adb14b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:16.426452 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737417c2-a649-4667-bb51-60684adb14b7 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:16.441241 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1247/2513] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:05:16.445636 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65110cde-5dc6-41b3-be23-ac2551c99643 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:16.454708 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:16.459249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65110cde-5dc6-41b3-be23-ac2551c99643 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:16.466832 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ff8fb-7b50-49db-a4e0-276c73a43a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:16.466832 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ff8fb-7b50-49db-a4e0-276c73a43a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:16.466832 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ff8fb-7b50-49db-a4e0-276c73a43a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:16.466832 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ff8fb-7b50-49db-a4e0-276c73a43a2c admin admin] PATH_INFO: `/v3/projects/972fb2ed9eba46848696650a3b157827/users/6bbb0202bddd47188bda67badcaf1051/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:16.484220 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ff8fb-7b50-49db-a4e0-276c73a43a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=972fb2ed9eba46848696650a3b157827, user_id=6bbb0202bddd47188bda67badcaf1051, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:16.488849 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ff8fb-7b50-49db-a4e0-276c73a43a2c admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:16.592433 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1267/2514] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:05:16 2022] PUT /identity/v3/projects/972fb2ed9eba46848696650a3b157827/users/6bbb0202bddd47188bda67badcaf1051/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:16.597129 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737417c2-a649-4667-bb51-60684adb14b7 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:16.610701 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737417c2-a649-4667-bb51-60684adb14b7 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:16.663000 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:16.699691 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb38b34-ee2f-4bcf-b3dc-82e7c8568aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:16.701441 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb38b34-ee2f-4bcf-b3dc-82e7c8568aec admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:16.702233 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb38b34-ee2f-4bcf-b3dc-82e7c8568aec admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:16.702622 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb38b34-ee2f-4bcf-b3dc-82e7c8568aec admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:16.704519 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb38b34-ee2f-4bcf-b3dc-82e7c8568aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:16.706825 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb38b34-ee2f-4bcf-b3dc-82e7c8568aec admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:16.722176 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1248/2515] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:05:16.723804 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ff8fb-7b50-49db-a4e0-276c73a43a2c admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:16.740617 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ff8fb-7b50-49db-a4e0-276c73a43a2c admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:16.747108 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c49e8b-683e-4a29-8633-0cf06b846086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:16.748330 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c49e8b-683e-4a29-8633-0cf06b846086 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:16.748615 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c49e8b-683e-4a29-8633-0cf06b846086 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:16.748894 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c49e8b-683e-4a29-8633-0cf06b846086 admin admin] PATH_INFO: `/v3/projects/972fb2ed9eba46848696650a3b157827/users/6bbb0202bddd47188bda67badcaf1051/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:16.751780 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c49e8b-683e-4a29-8633-0cf06b846086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=972fb2ed9eba46848696650a3b157827, user_id=6bbb0202bddd47188bda67badcaf1051, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:16.754466 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c49e8b-683e-4a29-8633-0cf06b846086 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:16.775641 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1268/2516] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:05:16 2022] PUT /identity/v3/projects/972fb2ed9eba46848696650a3b157827/users/6bbb0202bddd47188bda67badcaf1051/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:16.782720 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cca6b-42ca-4ebe-a9db-ce8a441e4a1f None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:16.783165 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cca6b-42ca-4ebe-a9db-ce8a441e4a1f None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:16.783383 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cca6b-42ca-4ebe-a9db-ce8a441e4a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:16.815650 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-824cca6b-42ca-4ebe-a9db-ce8a441e4a1f None None] MFA Rules not processed for user `6bbb0202bddd47188bda67badcaf1051`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:16.817066 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-824cca6b-42ca-4ebe-a9db-ce8a441e4a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:16.902928 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1249/2517] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:05:16.915971 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c49e8b-683e-4a29-8633-0cf06b846086 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:16.918839 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-c3c49e8b-683e-4a29-8633-0cf06b846086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:16.987137 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c49e8b-683e-4a29-8633-0cf06b846086 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:16.992539 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf191a-c9de-4967-bb13-d8492d865e9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:16.993208 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf191a-c9de-4967-bb13-d8492d865e9a service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:16.993622 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf191a-c9de-4967-bb13-d8492d865e9a service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:16.993916 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf191a-c9de-4967-bb13-d8492d865e9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:17.004964 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf191a-c9de-4967-bb13-d8492d865e9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:17.006860 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf191a-c9de-4967-bb13-d8492d865e9a service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:17.018503 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1269/2518] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:05:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:05:17.047644 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cca6b-42ca-4ebe-a9db-ce8a441e4a1f None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:17.140341 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cca6b-42ca-4ebe-a9db-ce8a441e4a1f None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:17.148783 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123c6da-cba6-4c30-a818-70f62c386fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:17.150768 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123c6da-cba6-4c30-a818-70f62c386fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:17.151251 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123c6da-cba6-4c30-a818-70f62c386fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:17.151812 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123c6da-cba6-4c30-a818-70f62c386fd0 admin admin] PATH_INFO: `/v3/users/3aac08c8d5684bd8be6a66159228f4fd` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:17.154015 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f123c6da-cba6-4c30-a818-70f62c386fd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aac08c8d5684bd8be6a66159228f4fd)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:17.157500 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f123c6da-cba6-4c30-a818-70f62c386fd0 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:17.343326 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-f123c6da-cba6-4c30-a818-70f62c386fd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aac08c8d5684bd8be6a66159228f4fd'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:17.356234 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-f123c6da-cba6-4c30-a818-70f62c386fd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aac08c8d5684bd8be6a66159228f4fd'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:17.357451 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-f123c6da-cba6-4c30-a818-70f62c386fd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aac08c8d5684bd8be6a66159228f4fd'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:17.363762 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:17.372208 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-f123c6da-cba6-4c30-a818-70f62c386fd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aac08c8d5684bd8be6a66159228f4fd'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:17.440723 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-f123c6da-cba6-4c30-a818-70f62c386fd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aac08c8d5684bd8be6a66159228f4fd'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:17.450749 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1250/2519] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:05:17 2022] DELETE /identity/v3/users/3aac08c8d5684bd8be6a66159228f4fd => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:05:17.456041 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce25bcf-7619-4289-841b-72fcdaee5a4d None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:17.456637 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce25bcf-7619-4289-841b-72fcdaee5a4d None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:17.457363 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce25bcf-7619-4289-841b-72fcdaee5a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:17.483983 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-8ce25bcf-7619-4289-841b-72fcdaee5a4d None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:17.485681 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-8ce25bcf-7619-4289-841b-72fcdaee5a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:17.572132 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1270/2520] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:05:17.582236 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123c6da-cba6-4c30-a818-70f62c386fd0 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:17.583815 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-f123c6da-cba6-4c30-a818-70f62c386fd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:17.659053 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123c6da-cba6-4c30-a818-70f62c386fd0 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:17.663509 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f711ae3-f034-4aea-8134-7f97fc2bcc6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:17.665622 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f711ae3-f034-4aea-8134-7f97fc2bcc6c service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:17.665929 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f711ae3-f034-4aea-8134-7f97fc2bcc6c service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:17.666236 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f711ae3-f034-4aea-8134-7f97fc2bcc6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:17.680235 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f711ae3-f034-4aea-8134-7f97fc2bcc6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:17.685345 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f711ae3-f034-4aea-8134-7f97fc2bcc6c service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:17.710210 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1251/2521] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:05:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:05:18.402793 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce25bcf-7619-4289-841b-72fcdaee5a4d None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:18.404301 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-8ce25bcf-7619-4289-841b-72fcdaee5a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:18.425015 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce25bcf-7619-4289-841b-72fcdaee5a4d None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:18.430430 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26cf507-b0a3-4d70-b373-7e937d744e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:18.431298 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cf507-b0a3-4d70-b373-7e937d744e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:18.431582 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cf507-b0a3-4d70-b373-7e937d744e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:18.431904 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cf507-b0a3-4d70-b373-7e937d744e7e admin admin] PATH_INFO: `/v3/projects/8aa909d95fcf4a9286a5bfdb0c90c3f2` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:18.433220 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26cf507-b0a3-4d70-b373-7e937d744e7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aa909d95fcf4a9286a5bfdb0c90c3f2)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:18.435148 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26cf507-b0a3-4d70-b373-7e937d744e7e admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:18.567823 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-b26cf507-b0a3-4d70-b373-7e937d744e7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aa909d95fcf4a9286a5bfdb0c90c3f2', 'request_id': 'req-b26cf507-b0a3-4d70-b373-7e937d744e7e'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:18.574833 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-b26cf507-b0a3-4d70-b373-7e937d744e7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aa909d95fcf4a9286a5bfdb0c90c3f2', 'request_id': 'req-b26cf507-b0a3-4d70-b373-7e937d744e7e'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:18.646367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-b26cf507-b0a3-4d70-b373-7e937d744e7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aa909d95fcf4a9286a5bfdb0c90c3f2', 'request_id': 'req-b26cf507-b0a3-4d70-b373-7e937d744e7e'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:18.651697 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:18.660053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-b26cf507-b0a3-4d70-b373-7e937d744e7e admin admin] The token cache is being invalidate because project 8aa909d95fcf4a9286a5bfdb0c90c3f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:05:18.660348 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-b26cf507-b0a3-4d70-b373-7e937d744e7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:18.661058 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-b26cf507-b0a3-4d70-b373-7e937d744e7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:18.662912 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1271/2522] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:05:18 2022] DELETE /identity/v3/projects/8aa909d95fcf4a9286a5bfdb0c90c3f2 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:18.666870 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f711ae3-f034-4aea-8134-7f97fc2bcc6c service neutron] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:18.679077 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f711ae3-f034-4aea-8134-7f97fc2bcc6c service neutron] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:18.747618 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5721a5-0218-4006-8f4e-d74e3841d982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:18.748514 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5721a5-0218-4006-8f4e-d74e3841d982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:18.748832 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5721a5-0218-4006-8f4e-d74e3841d982 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:18.749110 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5721a5-0218-4006-8f4e-d74e3841d982 admin admin] PATH_INFO: `/v3/users/6bbb0202bddd47188bda67badcaf1051` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:18.751227 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5721a5-0218-4006-8f4e-d74e3841d982 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bbb0202bddd47188bda67badcaf1051)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:18.753197 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5721a5-0218-4006-8f4e-d74e3841d982 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:18.914751 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-bb5721a5-0218-4006-8f4e-d74e3841d982 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bbb0202bddd47188bda67badcaf1051'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:18.922682 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-bb5721a5-0218-4006-8f4e-d74e3841d982 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bbb0202bddd47188bda67badcaf1051'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:18.923425 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-bb5721a5-0218-4006-8f4e-d74e3841d982 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bbb0202bddd47188bda67badcaf1051'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:18.939963 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-bb5721a5-0218-4006-8f4e-d74e3841d982 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bbb0202bddd47188bda67badcaf1051'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:19.017484 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-bb5721a5-0218-4006-8f4e-d74e3841d982 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bbb0202bddd47188bda67badcaf1051'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:19.020002 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:19.025126 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1252/2523] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:05:18 2022] DELETE /identity/v3/users/6bbb0202bddd47188bda67badcaf1051 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:19.476076 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26cf507-b0a3-4d70-b373-7e937d744e7e admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:19.478053 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-b26cf507-b0a3-4d70-b373-7e937d744e7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:19.511233 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26cf507-b0a3-4d70-b373-7e937d744e7e admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:19.571678 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb81b8c-bca5-4dde-9e69-ed16ee37bc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:19.572688 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb81b8c-bca5-4dde-9e69-ed16ee37bc98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:19.572974 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb81b8c-bca5-4dde-9e69-ed16ee37bc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:19.573252 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb81b8c-bca5-4dde-9e69-ed16ee37bc98 admin admin] PATH_INFO: `/v3/projects/972fb2ed9eba46848696650a3b157827` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:19.574461 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb81b8c-bca5-4dde-9e69-ed16ee37bc98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=972fb2ed9eba46848696650a3b157827)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:19.576590 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb81b8c-bca5-4dde-9e69-ed16ee37bc98 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:19.695870 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-6eb81b8c-bca5-4dde-9e69-ed16ee37bc98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '972fb2ed9eba46848696650a3b157827', 'request_id': 'req-6eb81b8c-bca5-4dde-9e69-ed16ee37bc98'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:19.706469 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-6eb81b8c-bca5-4dde-9e69-ed16ee37bc98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '972fb2ed9eba46848696650a3b157827', 'request_id': 'req-6eb81b8c-bca5-4dde-9e69-ed16ee37bc98'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:19.772000 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-6eb81b8c-bca5-4dde-9e69-ed16ee37bc98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '972fb2ed9eba46848696650a3b157827', 'request_id': 'req-6eb81b8c-bca5-4dde-9e69-ed16ee37bc98'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:19.787060 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-6eb81b8c-bca5-4dde-9e69-ed16ee37bc98 admin admin] The token cache is being invalidate because project 972fb2ed9eba46848696650a3b157827 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:05:19.787351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-6eb81b8c-bca5-4dde-9e69-ed16ee37bc98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:19.788060 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-6eb81b8c-bca5-4dde-9e69-ed16ee37bc98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:19.793277 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1272/2524] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:05:19 2022] DELETE /identity/v3/projects/972fb2ed9eba46848696650a3b157827 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:19.794596 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7922e-2366-4641-8c16-b87a04dab2f8 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:19.795061 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7922e-2366-4641-8c16-b87a04dab2f8 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:19.795213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7922e-2366-4641-8c16-b87a04dab2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:19.816755 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-e9f7922e-2366-4641-8c16-b87a04dab2f8 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:19.817955 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-e9f7922e-2366-4641-8c16-b87a04dab2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:19.895134 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1253/2525] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:05:19.897251 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83ec16-5647-429a-ae4f-b43c05648918 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:19.898043 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83ec16-5647-429a-ae4f-b43c05648918 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:19.898434 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83ec16-5647-429a-ae4f-b43c05648918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:19.919670 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-be83ec16-5647-429a-ae4f-b43c05648918 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:19.921141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-be83ec16-5647-429a-ae4f-b43c05648918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:19.935157 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1273/2526] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:05:19.936474 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7922e-2366-4641-8c16-b87a04dab2f8 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:19.947209 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7922e-2366-4641-8c16-b87a04dab2f8 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:19.954847 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af7a03-6e89-49a8-bfc8-f197b5b5c417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:19.955781 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af7a03-6e89-49a8-bfc8-f197b5b5c417 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:19.958281 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af7a03-6e89-49a8-bfc8-f197b5b5c417 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:19.958564 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af7a03-6e89-49a8-bfc8-f197b5b5c417 admin admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:19.959307 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af7a03-6e89-49a8-bfc8-f197b5b5c417 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:05:19.959778 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af7a03-6e89-49a8-bfc8-f197b5b5c417 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:19.961445 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af7a03-6e89-49a8-bfc8-f197b5b5c417 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:19.974968 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1254/2527] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 16:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:05:19.978882 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83ec16-5647-429a-ae4f-b43c05648918 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:19.989241 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83ec16-5647-429a-ae4f-b43c05648918 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:19.993944 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595201a2-2096-43f1-aba1-6787cf8b2492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:19.996230 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595201a2-2096-43f1-aba1-6787cf8b2492 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:19.996230 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595201a2-2096-43f1-aba1-6787cf8b2492 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:19.996230 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595201a2-2096-43f1-aba1-6787cf8b2492 admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:19.996230 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595201a2-2096-43f1-aba1-6787cf8b2492 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:19.998083 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595201a2-2096-43f1-aba1-6787cf8b2492 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:20.086374 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1274/2528] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:05:19 2022] POST /identity/v3/projects => generated 401 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:05:20.090522 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af7a03-6e89-49a8-bfc8-f197b5b5c417 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:20.102214 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af7a03-6e89-49a8-bfc8-f197b5b5c417 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:20.175344 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2771acf-e54e-417d-bb57-12fc926fee56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:20.176214 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2771acf-e54e-417d-bb57-12fc926fee56 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:20.176644 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2771acf-e54e-417d-bb57-12fc926fee56 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:20.176884 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2771acf-e54e-417d-bb57-12fc926fee56 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:20.177523 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2771acf-e54e-417d-bb57-12fc926fee56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:20.179655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2771acf-e54e-417d-bb57-12fc926fee56 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:20.266119 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1255/2529] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:05:20 2022] POST /identity/v3/users => generated 301 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:05:20.270534 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595201a2-2096-43f1-aba1-6787cf8b2492 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:20.284301 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595201a2-2096-43f1-aba1-6787cf8b2492 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:20.291010 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9521c-e3fa-4b43-9397-d4cbfaf3e055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:20.291010 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9521c-e3fa-4b43-9397-d4cbfaf3e055 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:20.291010 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9521c-e3fa-4b43-9397-d4cbfaf3e055 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:20.291010 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9521c-e3fa-4b43-9397-d4cbfaf3e055 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:20.291940 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9521c-e3fa-4b43-9397-d4cbfaf3e055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:20.297481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9521c-e3fa-4b43-9397-d4cbfaf3e055 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:20.310524 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1275/2530] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:05:20.314995 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2771acf-e54e-417d-bb57-12fc926fee56 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:20.326655 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2771acf-e54e-417d-bb57-12fc926fee56 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:20.332004 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4515c-fd8a-46d8-9f77-6a025475c940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:20.332670 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4515c-fd8a-46d8-9f77-6a025475c940 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:20.332960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4515c-fd8a-46d8-9f77-6a025475c940 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:20.333246 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4515c-fd8a-46d8-9f77-6a025475c940 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:20.333996 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4515c-fd8a-46d8-9f77-6a025475c940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:20.335722 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4515c-fd8a-46d8-9f77-6a025475c940 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:20.351769 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1256/2531] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:05:20.355652 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9521c-e3fa-4b43-9397-d4cbfaf3e055 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:20.368432 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9521c-e3fa-4b43-9397-d4cbfaf3e055 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:20.373955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd5364-aa61-4f3e-bae4-632c52b019d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:20.375410 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd5364-aa61-4f3e-bae4-632c52b019d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:20.375700 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd5364-aa61-4f3e-bae4-632c52b019d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:20.375987 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd5364-aa61-4f3e-bae4-632c52b019d1 admin admin] PATH_INFO: `/v3/projects/68ecd22d999b4995941a1629077b6408/users/6f3d2d23b45e43f7b1acf2818d541b20/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:20.395198 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd5364-aa61-4f3e-bae4-632c52b019d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68ecd22d999b4995941a1629077b6408, user_id=6f3d2d23b45e43f7b1acf2818d541b20, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:20.397907 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd5364-aa61-4f3e-bae4-632c52b019d1 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:20.459064 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1276/2532] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:05:20 2022] PUT /identity/v3/projects/68ecd22d999b4995941a1629077b6408/users/6f3d2d23b45e43f7b1acf2818d541b20/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:20.471263 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c841bf6-9efa-40f1-86dc-057b876ee8f9 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:20.471959 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c841bf6-9efa-40f1-86dc-057b876ee8f9 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:20.472469 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c841bf6-9efa-40f1-86dc-057b876ee8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:20.509926 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-9c841bf6-9efa-40f1-86dc-057b876ee8f9 None None] MFA Rules not processed for user `6f3d2d23b45e43f7b1acf2818d541b20`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:20.511895 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-9c841bf6-9efa-40f1-86dc-057b876ee8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:20.600685 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:20.616758 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd5364-aa61-4f3e-bae4-632c52b019d1 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:20.617294 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1257/2533] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:05:20.645414 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:20.697613 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd5364-aa61-4f3e-bae4-632c52b019d1 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:20.707116 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eec379-eae8-40b7-8991-9e90590d04c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:20.707116 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eec379-eae8-40b7-8991-9e90590d04c3 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:20.707116 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eec379-eae8-40b7-8991-9e90590d04c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:20.707116 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eec379-eae8-40b7-8991-9e90590d04c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:20.707738 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eec379-eae8-40b7-8991-9e90590d04c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:20.708237 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eec379-eae8-40b7-8991-9e90590d04c3 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:20.784293 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1277/2534] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:05:20 2022] POST /identity/v3/projects => generated 401 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:05:20.785240 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c841bf6-9efa-40f1-86dc-057b876ee8f9 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:20.802488 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c841bf6-9efa-40f1-86dc-057b876ee8f9 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:20.883368 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755b27c-e797-4c6e-b8b1-0eea10cc5625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:20.884580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755b27c-e797-4c6e-b8b1-0eea10cc5625 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:20.887329 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755b27c-e797-4c6e-b8b1-0eea10cc5625 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:20.887329 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755b27c-e797-4c6e-b8b1-0eea10cc5625 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:20.887329 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755b27c-e797-4c6e-b8b1-0eea10cc5625 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:20.889157 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755b27c-e797-4c6e-b8b1-0eea10cc5625 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:20.985647 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1258/2535] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:05:20 2022] POST /identity/v3/users => generated 307 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:05:20.989948 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eec379-eae8-40b7-8991-9e90590d04c3 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:21.001193 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eec379-eae8-40b7-8991-9e90590d04c3 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:21.006213 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501b250-cb2d-4de4-8b39-0809b2a07332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:21.006908 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501b250-cb2d-4de4-8b39-0809b2a07332 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:21.007197 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501b250-cb2d-4de4-8b39-0809b2a07332 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:21.007482 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501b250-cb2d-4de4-8b39-0809b2a07332 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:21.008271 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501b250-cb2d-4de4-8b39-0809b2a07332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:21.009943 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501b250-cb2d-4de4-8b39-0809b2a07332 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:21.022998 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1278/2536] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:05:21.027424 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755b27c-e797-4c6e-b8b1-0eea10cc5625 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:21.039028 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755b27c-e797-4c6e-b8b1-0eea10cc5625 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:21.044178 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a0c31-a82a-4de0-9e5a-d03543420556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:21.045130 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a0c31-a82a-4de0-9e5a-d03543420556 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:21.045416 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a0c31-a82a-4de0-9e5a-d03543420556 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:21.045696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a0c31-a82a-4de0-9e5a-d03543420556 admin admin] PATH_INFO: `/v3/projects/7639397c3673443593aeecf5dc0709dc/users/9eae8e60e6aa490e9c8084fa3fae6650/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:21.063706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a0c31-a82a-4de0-9e5a-d03543420556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7639397c3673443593aeecf5dc0709dc, user_id=9eae8e60e6aa490e9c8084fa3fae6650, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:21.066402 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a0c31-a82a-4de0-9e5a-d03543420556 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:21.434764 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1259/2537] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:05:21 2022] PUT /identity/v3/projects/7639397c3673443593aeecf5dc0709dc/users/9eae8e60e6aa490e9c8084fa3fae6650/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:05:21.439300 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501b250-cb2d-4de4-8b39-0809b2a07332 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:21.449066 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501b250-cb2d-4de4-8b39-0809b2a07332 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:21.509483 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95681266-f882-4610-bc7a-d502f0588aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:21.510078 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95681266-f882-4610-bc7a-d502f0588aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:21.510367 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95681266-f882-4610-bc7a-d502f0588aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:21.510650 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95681266-f882-4610-bc7a-d502f0588aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:21.511379 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95681266-f882-4610-bc7a-d502f0588aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:21.513090 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95681266-f882-4610-bc7a-d502f0588aa2 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:21.523413 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1279/2538] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:05:21.527513 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a0c31-a82a-4de0-9e5a-d03543420556 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:21.539679 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a0c31-a82a-4de0-9e5a-d03543420556 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:21.544630 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e32d21-b8dc-4173-b3cb-14ce3da13fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:21.545856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e32d21-b8dc-4173-b3cb-14ce3da13fb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:21.546254 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e32d21-b8dc-4173-b3cb-14ce3da13fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:21.547055 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e32d21-b8dc-4173-b3cb-14ce3da13fb1 admin admin] PATH_INFO: `/v3/projects/7639397c3673443593aeecf5dc0709dc/users/9eae8e60e6aa490e9c8084fa3fae6650/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:21.550208 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e32d21-b8dc-4173-b3cb-14ce3da13fb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7639397c3673443593aeecf5dc0709dc, user_id=9eae8e60e6aa490e9c8084fa3fae6650, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:21.552986 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e32d21-b8dc-4173-b3cb-14ce3da13fb1 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:21.574711 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1260/2539] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:05:21 2022] PUT /identity/v3/projects/7639397c3673443593aeecf5dc0709dc/users/9eae8e60e6aa490e9c8084fa3fae6650/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:21.587747 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b689894-8847-4902-919e-0bd3111b77ec None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:21.587954 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b689894-8847-4902-919e-0bd3111b77ec None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:21.588340 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b689894-8847-4902-919e-0bd3111b77ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:21.622390 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-0b689894-8847-4902-919e-0bd3111b77ec None None] MFA Rules not processed for user `9eae8e60e6aa490e9c8084fa3fae6650`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:21.623697 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-0b689894-8847-4902-919e-0bd3111b77ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:21.719976 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1280/2540] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:21 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:05:21.725422 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e32d21-b8dc-4173-b3cb-14ce3da13fb1 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:21.728599 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-39e32d21-b8dc-4173-b3cb-14ce3da13fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:21.803689 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e32d21-b8dc-4173-b3cb-14ce3da13fb1 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:21.808008 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bde51-6e31-431e-8572-d7ba0dc1c319 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:21.808916 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bde51-6e31-431e-8572-d7ba0dc1c319 service cinder] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:21.809377 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bde51-6e31-431e-8572-d7ba0dc1c319 service cinder] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:21.809809 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bde51-6e31-431e-8572-d7ba0dc1c319 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:21.824265 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559bde51-6e31-431e-8572-d7ba0dc1c319 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:21.825970 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559bde51-6e31-431e-8572-d7ba0dc1c319 service cinder] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:21.837689 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1261/2541] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:05:21 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:05:22.054361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b689894-8847-4902-919e-0bd3111b77ec None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:22.069450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b689894-8847-4902-919e-0bd3111b77ec None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:22.074642 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c5406-8fd9-43cd-b536-1fdabc241789 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:22.075740 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c5406-8fd9-43cd-b536-1fdabc241789 service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:22.076201 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c5406-8fd9-43cd-b536-1fdabc241789 service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:22.076604 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c5406-8fd9-43cd-b536-1fdabc241789 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:22.096246 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:22.157536 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c5406-8fd9-43cd-b536-1fdabc241789 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:22.159253 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c5406-8fd9-43cd-b536-1fdabc241789 service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:22.175985 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1281/2542] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:05:22 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:05:28.366758 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bde51-6e31-431e-8572-d7ba0dc1c319 service cinder] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:28.430773 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:28.445843 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bde51-6e31-431e-8572-d7ba0dc1c319 service cinder] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:28.450916 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a843d-8e33-4174-9081-151725216dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:28.451903 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a843d-8e33-4174-9081-151725216dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:28.452156 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a843d-8e33-4174-9081-151725216dee admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:28.452445 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a843d-8e33-4174-9081-151725216dee admin admin] PATH_INFO: `/v3/users/6f3d2d23b45e43f7b1acf2818d541b20` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:28.453661 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a843d-8e33-4174-9081-151725216dee admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f3d2d23b45e43f7b1acf2818d541b20)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:28.458137 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a843d-8e33-4174-9081-151725216dee admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:28.699808 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-201a843d-8e33-4174-9081-151725216dee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f3d2d23b45e43f7b1acf2818d541b20'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:28.708699 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-201a843d-8e33-4174-9081-151725216dee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f3d2d23b45e43f7b1acf2818d541b20'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:28.709593 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-201a843d-8e33-4174-9081-151725216dee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f3d2d23b45e43f7b1acf2818d541b20'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:28.722539 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-201a843d-8e33-4174-9081-151725216dee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f3d2d23b45e43f7b1acf2818d541b20'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:28.840533 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-201a843d-8e33-4174-9081-151725216dee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f3d2d23b45e43f7b1acf2818d541b20'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:28.854703 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1262/2543] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:05:28 2022] DELETE /identity/v3/users/6f3d2d23b45e43f7b1acf2818d541b20 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:28.856930 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44c923-8ecd-4f51-9916-5fb8b4a29dfc None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:28.857778 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44c923-8ecd-4f51-9916-5fb8b4a29dfc None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:28.858074 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44c923-8ecd-4f51-9916-5fb8b4a29dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:28.881069 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-fb44c923-8ecd-4f51-9916-5fb8b4a29dfc None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:28.882316 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-fb44c923-8ecd-4f51-9916-5fb8b4a29dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:28.981994 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1282/2544] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:05:28.995030 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a843d-8e33-4174-9081-151725216dee admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:28.996624 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-201a843d-8e33-4174-9081-151725216dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:29.113860 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a843d-8e33-4174-9081-151725216dee admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:29.117884 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de105c9d-15be-46aa-b42c-486f22cf86b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:29.118935 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de105c9d-15be-46aa-b42c-486f22cf86b3 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:29.119227 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de105c9d-15be-46aa-b42c-486f22cf86b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:29.119626 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de105c9d-15be-46aa-b42c-486f22cf86b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:29.133235 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de105c9d-15be-46aa-b42c-486f22cf86b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:29.137317 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de105c9d-15be-46aa-b42c-486f22cf86b3 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:29.154946 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1263/2545] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:05:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:05:29.659472 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44c923-8ecd-4f51-9916-5fb8b4a29dfc None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:29.662931 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-fb44c923-8ecd-4f51-9916-5fb8b4a29dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:29.707781 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44c923-8ecd-4f51-9916-5fb8b4a29dfc None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:29.718416 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d4931-4ef8-4c4d-a87b-5ce1aba49f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:29.719771 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d4931-4ef8-4c4d-a87b-5ce1aba49f4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:29.719771 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d4931-4ef8-4c4d-a87b-5ce1aba49f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:29.720026 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d4931-4ef8-4c4d-a87b-5ce1aba49f4e admin admin] PATH_INFO: `/v3/projects/68ecd22d999b4995941a1629077b6408` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:29.726071 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d4931-4ef8-4c4d-a87b-5ce1aba49f4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=68ecd22d999b4995941a1629077b6408)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:29.728188 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d4931-4ef8-4c4d-a87b-5ce1aba49f4e admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:29.867117 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-ba7d4931-4ef8-4c4d-a87b-5ce1aba49f4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68ecd22d999b4995941a1629077b6408', 'request_id': 'req-ba7d4931-4ef8-4c4d-a87b-5ce1aba49f4e'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:29.874087 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-ba7d4931-4ef8-4c4d-a87b-5ce1aba49f4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68ecd22d999b4995941a1629077b6408', 'request_id': 'req-ba7d4931-4ef8-4c4d-a87b-5ce1aba49f4e'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:29.954982 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-ba7d4931-4ef8-4c4d-a87b-5ce1aba49f4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68ecd22d999b4995941a1629077b6408', 'request_id': 'req-ba7d4931-4ef8-4c4d-a87b-5ce1aba49f4e'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:29.970254 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-ba7d4931-4ef8-4c4d-a87b-5ce1aba49f4e admin admin] The token cache is being invalidate because project 68ecd22d999b4995941a1629077b6408 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:05:29.970254 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-ba7d4931-4ef8-4c4d-a87b-5ce1aba49f4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:29.970254 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-ba7d4931-4ef8-4c4d-a87b-5ce1aba49f4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:29.973480 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1283/2546] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:05:29 2022] DELETE /identity/v3/projects/68ecd22d999b4995941a1629077b6408 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:29.978301 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de105c9d-15be-46aa-b42c-486f22cf86b3 service neutron] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:29.991028 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de105c9d-15be-46aa-b42c-486f22cf86b3 service neutron] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:30.065410 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485988ec-8f1e-4c28-8136-43fd989e7aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:30.066444 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485988ec-8f1e-4c28-8136-43fd989e7aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:30.066726 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485988ec-8f1e-4c28-8136-43fd989e7aff admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:30.067003 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485988ec-8f1e-4c28-8136-43fd989e7aff admin admin] PATH_INFO: `/v3/users/9eae8e60e6aa490e9c8084fa3fae6650` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:30.068233 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485988ec-8f1e-4c28-8136-43fd989e7aff admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eae8e60e6aa490e9c8084fa3fae6650)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:30.070169 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485988ec-8f1e-4c28-8136-43fd989e7aff admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:30.089057 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:30.283306 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-485988ec-8f1e-4c28-8136-43fd989e7aff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eae8e60e6aa490e9c8084fa3fae6650'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:30.294289 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-485988ec-8f1e-4c28-8136-43fd989e7aff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eae8e60e6aa490e9c8084fa3fae6650'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:30.295121 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-485988ec-8f1e-4c28-8136-43fd989e7aff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eae8e60e6aa490e9c8084fa3fae6650'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:30.319040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-485988ec-8f1e-4c28-8136-43fd989e7aff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eae8e60e6aa490e9c8084fa3fae6650'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:30.396279 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-485988ec-8f1e-4c28-8136-43fd989e7aff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eae8e60e6aa490e9c8084fa3fae6650'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:30.407305 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1264/2547] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:05:29 2022] DELETE /identity/v3/users/9eae8e60e6aa490e9c8084fa3fae6650 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:30.892206 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d4931-4ef8-4c4d-a87b-5ce1aba49f4e admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:30.892693 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-ba7d4931-4ef8-4c4d-a87b-5ce1aba49f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:30.925987 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d4931-4ef8-4c4d-a87b-5ce1aba49f4e admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:30.993163 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:31.020694 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1059eec-4318-46e8-8dbf-cce27210304b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:31.021616 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1059eec-4318-46e8-8dbf-cce27210304b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:31.021911 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1059eec-4318-46e8-8dbf-cce27210304b admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:31.022192 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1059eec-4318-46e8-8dbf-cce27210304b admin admin] PATH_INFO: `/v3/projects/7639397c3673443593aeecf5dc0709dc` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:31.023443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1059eec-4318-46e8-8dbf-cce27210304b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7639397c3673443593aeecf5dc0709dc)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:31.025501 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1059eec-4318-46e8-8dbf-cce27210304b admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:31.145407 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-b1059eec-4318-46e8-8dbf-cce27210304b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7639397c3673443593aeecf5dc0709dc', 'request_id': 'req-b1059eec-4318-46e8-8dbf-cce27210304b'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:31.152482 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-b1059eec-4318-46e8-8dbf-cce27210304b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7639397c3673443593aeecf5dc0709dc', 'request_id': 'req-b1059eec-4318-46e8-8dbf-cce27210304b'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:31.428549 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-b1059eec-4318-46e8-8dbf-cce27210304b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7639397c3673443593aeecf5dc0709dc', 'request_id': 'req-b1059eec-4318-46e8-8dbf-cce27210304b'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:31.443558 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-b1059eec-4318-46e8-8dbf-cce27210304b admin admin] The token cache is being invalidate because project 7639397c3673443593aeecf5dc0709dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:05:31.443978 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-b1059eec-4318-46e8-8dbf-cce27210304b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:31.444795 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-b1059eec-4318-46e8-8dbf-cce27210304b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:31.446791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1284/2548] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:05:30 2022] DELETE /identity/v3/projects/7639397c3673443593aeecf5dc0709dc => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:31.451416 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df530d74-bdbe-4ff0-9a2d-e4b94909e53b None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:31.451973 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df530d74-bdbe-4ff0-9a2d-e4b94909e53b None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:31.452096 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df530d74-bdbe-4ff0-9a2d-e4b94909e53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:31.475173 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-df530d74-bdbe-4ff0-9a2d-e4b94909e53b None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:31.478217 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-df530d74-bdbe-4ff0-9a2d-e4b94909e53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:31.573484 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1812187-cf86-48db-a66d-7dfb36bae585 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:31.574056 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1812187-cf86-48db-a66d-7dfb36bae585 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:31.574519 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1812187-cf86-48db-a66d-7dfb36bae585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:31.576057 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1265/2549] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:05:31.632023 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-f1812187-cf86-48db-a66d-7dfb36bae585 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:31.632023 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-f1812187-cf86-48db-a66d-7dfb36bae585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:31.636552 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1285/2550] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:05:31.642280 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df530d74-bdbe-4ff0-9a2d-e4b94909e53b None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:31.654079 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df530d74-bdbe-4ff0-9a2d-e4b94909e53b None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:31.660767 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd2ddb-37b9-40be-a010-cd13ab3b0c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:31.661638 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd2ddb-37b9-40be-a010-cd13ab3b0c2a admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:31.661820 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd2ddb-37b9-40be-a010-cd13ab3b0c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:31.662099 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd2ddb-37b9-40be-a010-cd13ab3b0c2a admin admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:31.662842 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd2ddb-37b9-40be-a010-cd13ab3b0c2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:05:31.663315 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd2ddb-37b9-40be-a010-cd13ab3b0c2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:31.665371 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd2ddb-37b9-40be-a010-cd13ab3b0c2a admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:31.685223 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1812187-cf86-48db-a66d-7dfb36bae585 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:31.691180 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1266/2551] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 16:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:05:31.699161 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1812187-cf86-48db-a66d-7dfb36bae585 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:31.706604 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12302bfb-d7ff-4075-9751-10dbdfaf0c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:31.707295 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12302bfb-d7ff-4075-9751-10dbdfaf0c7d admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:31.707765 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12302bfb-d7ff-4075-9751-10dbdfaf0c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:31.708057 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12302bfb-d7ff-4075-9751-10dbdfaf0c7d admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:31.708875 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12302bfb-d7ff-4075-9751-10dbdfaf0c7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:31.710890 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12302bfb-d7ff-4075-9751-10dbdfaf0c7d admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:31.842485 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1286/2552] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:05:31 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:05:31.847766 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd2ddb-37b9-40be-a010-cd13ab3b0c2a admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:31.863214 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd2ddb-37b9-40be-a010-cd13ab3b0c2a admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:31.988494 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b804e7-4245-4db4-8c2e-3141a9276a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:31.990011 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b804e7-4245-4db4-8c2e-3141a9276a50 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:31.990759 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b804e7-4245-4db4-8c2e-3141a9276a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:31.991141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b804e7-4245-4db4-8c2e-3141a9276a50 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:31.994702 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b804e7-4245-4db4-8c2e-3141a9276a50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:32.000824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b804e7-4245-4db4-8c2e-3141a9276a50 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:32.140829 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1267/2553] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:05:31 2022] POST /identity/v3/users => generated 287 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:05:32.142160 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12302bfb-d7ff-4075-9751-10dbdfaf0c7d admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:32.153407 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12302bfb-d7ff-4075-9751-10dbdfaf0c7d admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:32.159394 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f656c6-0ad3-4b09-a61b-2b6c0fe67253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:32.160273 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f656c6-0ad3-4b09-a61b-2b6c0fe67253 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:32.163131 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f656c6-0ad3-4b09-a61b-2b6c0fe67253 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:32.163131 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f656c6-0ad3-4b09-a61b-2b6c0fe67253 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:32.163131 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f656c6-0ad3-4b09-a61b-2b6c0fe67253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:32.163512 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f656c6-0ad3-4b09-a61b-2b6c0fe67253 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:32.179342 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1287/2554] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:05:32.183353 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b804e7-4245-4db4-8c2e-3141a9276a50 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:32.194779 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b804e7-4245-4db4-8c2e-3141a9276a50 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:32.199905 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc083a67-1950-442e-933b-4c4c257e9dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:32.200702 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc083a67-1950-442e-933b-4c4c257e9dfc admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:32.200989 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc083a67-1950-442e-933b-4c4c257e9dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:32.201266 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc083a67-1950-442e-933b-4c4c257e9dfc admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:32.201991 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc083a67-1950-442e-933b-4c4c257e9dfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:32.204437 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc083a67-1950-442e-933b-4c4c257e9dfc admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:32.206827 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:32.225543 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1268/2555] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:05:32.227271 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f656c6-0ad3-4b09-a61b-2b6c0fe67253 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:32.237979 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f656c6-0ad3-4b09-a61b-2b6c0fe67253 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:32.242697 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb373bf-39de-4d96-a920-6d4e6e35c03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:32.243583 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb373bf-39de-4d96-a920-6d4e6e35c03c admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:32.244836 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb373bf-39de-4d96-a920-6d4e6e35c03c admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:32.245134 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb373bf-39de-4d96-a920-6d4e6e35c03c admin admin] PATH_INFO: `/v3/projects/525a1cce02334a6783c813b047f08486/users/73084acd3ba543faa79cac77b04234c7/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:32.261592 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb373bf-39de-4d96-a920-6d4e6e35c03c admin admin] RBAC: Authorizing `identity:create_grant(project_id=525a1cce02334a6783c813b047f08486, user_id=73084acd3ba543faa79cac77b04234c7, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:32.264347 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb373bf-39de-4d96-a920-6d4e6e35c03c admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:32.354608 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1288/2556] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:05:32 2022] PUT /identity/v3/projects/525a1cce02334a6783c813b047f08486/users/73084acd3ba543faa79cac77b04234c7/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:05:32.365949 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2925d07-7fcf-4b4c-b140-e0af01f44f69 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:32.366262 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2925d07-7fcf-4b4c-b140-e0af01f44f69 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:32.366553 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2925d07-7fcf-4b4c-b140-e0af01f44f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:32.399282 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-f2925d07-7fcf-4b4c-b140-e0af01f44f69 None None] MFA Rules not processed for user `73084acd3ba543faa79cac77b04234c7`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:32.400591 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-f2925d07-7fcf-4b4c-b140-e0af01f44f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:32.472019 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1269/2557] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:05:32.476684 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb373bf-39de-4d96-a920-6d4e6e35c03c admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:32.544526 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb373bf-39de-4d96-a920-6d4e6e35c03c admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:32.549754 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6c532-bbc2-47c6-82b5-eddd84ec9085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:32.550411 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6c532-bbc2-47c6-82b5-eddd84ec9085 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:32.554730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6c532-bbc2-47c6-82b5-eddd84ec9085 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:32.554730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6c532-bbc2-47c6-82b5-eddd84ec9085 admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:32.554730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6c532-bbc2-47c6-82b5-eddd84ec9085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:32.554730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6c532-bbc2-47c6-82b5-eddd84ec9085 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:32.564179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:32.659033 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1289/2558] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:05:32 2022] POST /identity/v3/projects => generated 375 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:05:32.663239 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2925d07-7fcf-4b4c-b140-e0af01f44f69 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:32.674650 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2925d07-7fcf-4b4c-b140-e0af01f44f69 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:32.743120 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade23db-ef82-472b-91cf-4133489417d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:32.750335 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade23db-ef82-472b-91cf-4133489417d5 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:32.750335 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade23db-ef82-472b-91cf-4133489417d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:32.750335 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade23db-ef82-472b-91cf-4133489417d5 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:32.750335 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade23db-ef82-472b-91cf-4133489417d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:32.750335 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade23db-ef82-472b-91cf-4133489417d5 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:32.857632 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1270/2559] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:05:32 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:05:32.861917 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6c532-bbc2-47c6-82b5-eddd84ec9085 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:32.872470 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6c532-bbc2-47c6-82b5-eddd84ec9085 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:32.877841 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9178e-f73e-48d1-ab39-d2d816949549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:32.878506 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9178e-f73e-48d1-ab39-d2d816949549 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:32.878792 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9178e-f73e-48d1-ab39-d2d816949549 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:32.879072 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9178e-f73e-48d1-ab39-d2d816949549 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:32.879834 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f9178e-f73e-48d1-ab39-d2d816949549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:32.881562 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f9178e-f73e-48d1-ab39-d2d816949549 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:32.893199 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1290/2560] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:05:32.897467 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade23db-ef82-472b-91cf-4133489417d5 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:32.907696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade23db-ef82-472b-91cf-4133489417d5 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:32.912392 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce6921-e482-4cce-bbe6-fa34f9575571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:32.913266 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce6921-e482-4cce-bbe6-fa34f9575571 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:32.913544 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce6921-e482-4cce-bbe6-fa34f9575571 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:32.913819 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce6921-e482-4cce-bbe6-fa34f9575571 admin admin] PATH_INFO: `/v3/projects/6a015f7684054bada999a68be497a778/users/0ac58ef7b7e349b796a7df5897ce2c69/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:32.929796 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce6921-e482-4cce-bbe6-fa34f9575571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a015f7684054bada999a68be497a778, user_id=0ac58ef7b7e349b796a7df5897ce2c69, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:32.932474 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce6921-e482-4cce-bbe6-fa34f9575571 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:33.012428 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1271/2561] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:05:32 2022] PUT /identity/v3/projects/6a015f7684054bada999a68be497a778/users/0ac58ef7b7e349b796a7df5897ce2c69/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:33.016529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9178e-f73e-48d1-ab39-d2d816949549 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:33.026759 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9178e-f73e-48d1-ab39-d2d816949549 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:33.085441 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9719f8-409a-4065-8bba-60764701446f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:33.086113 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9719f8-409a-4065-8bba-60764701446f admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:33.086400 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9719f8-409a-4065-8bba-60764701446f admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:33.086679 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9719f8-409a-4065-8bba-60764701446f admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:33.087412 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9719f8-409a-4065-8bba-60764701446f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:33.089051 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9719f8-409a-4065-8bba-60764701446f admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:33.102791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1291/2562] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:05:33.103979 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce6921-e482-4cce-bbe6-fa34f9575571 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:33.114956 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce6921-e482-4cce-bbe6-fa34f9575571 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:33.119657 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d952cb0-cfda-4c2c-9fa2-9ca2467887fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:33.120528 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d952cb0-cfda-4c2c-9fa2-9ca2467887fe admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:33.120805 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d952cb0-cfda-4c2c-9fa2-9ca2467887fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:33.121078 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d952cb0-cfda-4c2c-9fa2-9ca2467887fe admin admin] PATH_INFO: `/v3/projects/6a015f7684054bada999a68be497a778/users/0ac58ef7b7e349b796a7df5897ce2c69/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:33.123010 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d952cb0-cfda-4c2c-9fa2-9ca2467887fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a015f7684054bada999a68be497a778, user_id=0ac58ef7b7e349b796a7df5897ce2c69, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:33.125906 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d952cb0-cfda-4c2c-9fa2-9ca2467887fe admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:33.135976 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1272/2563] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:05:33 2022] PUT /identity/v3/projects/6a015f7684054bada999a68be497a778/users/0ac58ef7b7e349b796a7df5897ce2c69/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:33.146128 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb551a-4b64-4bf9-9ea8-6605227d68b0 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:33.146592 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb551a-4b64-4bf9-9ea8-6605227d68b0 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:33.146702 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb551a-4b64-4bf9-9ea8-6605227d68b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:33.173495 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-68eb551a-4b64-4bf9-9ea8-6605227d68b0 None None] MFA Rules not processed for user `0ac58ef7b7e349b796a7df5897ce2c69`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:33.174949 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-68eb551a-4b64-4bf9-9ea8-6605227d68b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:33.243387 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1292/2564] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:05:33.254217 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d952cb0-cfda-4c2c-9fa2-9ca2467887fe admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:33.255937 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-6d952cb0-cfda-4c2c-9fa2-9ca2467887fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:33.302415 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:33.319302 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d952cb0-cfda-4c2c-9fa2-9ca2467887fe admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:33.323121 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa88a41-4f4c-4af5-9b81-4df7a799c723 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:33.323859 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa88a41-4f4c-4af5-9b81-4df7a799c723 service cinder] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:33.324133 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa88a41-4f4c-4af5-9b81-4df7a799c723 service cinder] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:33.324620 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa88a41-4f4c-4af5-9b81-4df7a799c723 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:33.382598 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa88a41-4f4c-4af5-9b81-4df7a799c723 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:33.384089 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa88a41-4f4c-4af5-9b81-4df7a799c723 service cinder] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:33.393184 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1273/2565] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:05:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:05:33.744248 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348029c-fae9-4ced-9bcf-a53caa14ba2f None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:33.744543 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348029c-fae9-4ced-9bcf-a53caa14ba2f None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:33.744826 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348029c-fae9-4ced-9bcf-a53caa14ba2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:33.762351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-3348029c-fae9-4ced-9bcf-a53caa14ba2f None None] MFA Rules not processed for user `048fc48dd55a43f7b342533a9484c3ad`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:33.763563 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-3348029c-fae9-4ced-9bcf-a53caa14ba2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:33.818648 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1293/2566] 10.222.0.39 () {58 vars in 967 bytes} [Mon May 23 16:05:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:05:33.831352 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa88a41-4f4c-4af5-9b81-4df7a799c723 service cinder] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:33.833162 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-0fa88a41-4f4c-4af5-9b81-4df7a799c723 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:33.878306 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348029c-fae9-4ced-9bcf-a53caa14ba2f None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:33.879876 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-3348029c-fae9-4ced-9bcf-a53caa14ba2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:33.885794 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:33.908656 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa88a41-4f4c-4af5-9b81-4df7a799c723 service cinder] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:33.913914 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a60ee-7218-489a-8815-b861b9cb290c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b275a110936a44ce8d54793af1a34808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:33.914549 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a60ee-7218-489a-8815-b861b9cb290c service swift] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:33.914831 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a60ee-7218-489a-8815-b861b9cb290c service swift] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:33.915108 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a60ee-7218-489a-8815-b861b9cb290c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:33.924924 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a60ee-7218-489a-8815-b861b9cb290c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:33.926564 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a60ee-7218-489a-8815-b861b9cb290c service swift] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:33.934950 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1274/2567] 10.222.0.39 () {60 vars in 1384 bytes} [Mon May 23 16:05:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 16:05:33.942496 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348029c-fae9-4ced-9bcf-a53caa14ba2f None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:33.946194 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a09456-52aa-4d0c-99d3-140ec388604a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:33.946850 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a09456-52aa-4d0c-99d3-140ec388604a service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:33.947358 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a09456-52aa-4d0c-99d3-140ec388604a service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:33.947467 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a09456-52aa-4d0c-99d3-140ec388604a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:33.952319 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-c4a09456-52aa-4d0c-99d3-140ec388604a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:34.032051 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a09456-52aa-4d0c-99d3-140ec388604a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:34.033536 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a09456-52aa-4d0c-99d3-140ec388604a service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:34.044768 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1294/2568] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:05:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:05:34.177983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a60ee-7218-489a-8815-b861b9cb290c service swift] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:34.185476 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a60ee-7218-489a-8815-b861b9cb290c service swift] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:34.189212 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687139c-7e8f-46b8-84cc-074828fa0f93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:34.189845 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687139c-7e8f-46b8-84cc-074828fa0f93 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:34.190129 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687139c-7e8f-46b8-84cc-074828fa0f93 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:34.190403 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687139c-7e8f-46b8-84cc-074828fa0f93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:34.192292 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-d687139c-7e8f-46b8-84cc-074828fa0f93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:34.207029 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687139c-7e8f-46b8-84cc-074828fa0f93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:34.208530 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687139c-7e8f-46b8-84cc-074828fa0f93 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:34.220570 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1275/2569] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:05:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:05:36.441842 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a09456-52aa-4d0c-99d3-140ec388604a service neutron] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:36.556039 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a09456-52aa-4d0c-99d3-140ec388604a service neutron] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:36.563320 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87474342-ca39-4b1f-a735-ee24db0dd2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:36.564843 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87474342-ca39-4b1f-a735-ee24db0dd2f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:36.565236 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87474342-ca39-4b1f-a735-ee24db0dd2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:36.565670 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87474342-ca39-4b1f-a735-ee24db0dd2f7 admin admin] PATH_INFO: `/v3/users/73084acd3ba543faa79cac77b04234c7` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:36.567837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87474342-ca39-4b1f-a735-ee24db0dd2f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73084acd3ba543faa79cac77b04234c7)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:36.570544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87474342-ca39-4b1f-a735-ee24db0dd2f7 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:36.802081 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-87474342-ca39-4b1f-a735-ee24db0dd2f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73084acd3ba543faa79cac77b04234c7'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:36.802941 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-87474342-ca39-4b1f-a735-ee24db0dd2f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73084acd3ba543faa79cac77b04234c7'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:36.803554 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-87474342-ca39-4b1f-a735-ee24db0dd2f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73084acd3ba543faa79cac77b04234c7'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:36.805574 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:36.874604 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-87474342-ca39-4b1f-a735-ee24db0dd2f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73084acd3ba543faa79cac77b04234c7'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:36.883258 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-87474342-ca39-4b1f-a735-ee24db0dd2f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73084acd3ba543faa79cac77b04234c7'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:36.905536 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1295/2570] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:05:36 2022] DELETE /identity/v3/users/73084acd3ba543faa79cac77b04234c7 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:36.908568 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb99239-e8d5-4730-9231-0e24be1799a3 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:36.909065 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb99239-e8d5-4730-9231-0e24be1799a3 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:36.909162 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb99239-e8d5-4730-9231-0e24be1799a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:36.925394 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87474342-ca39-4b1f-a735-ee24db0dd2f7 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:36.927123 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-87474342-ca39-4b1f-a735-ee24db0dd2f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:36.938014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-1fb99239-e8d5-4730-9231-0e24be1799a3 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:36.939228 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-1fb99239-e8d5-4730-9231-0e24be1799a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:37.011844 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1276/2571] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:05:37.012217 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87474342-ca39-4b1f-a735-ee24db0dd2f7 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:37.018558 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada1fcf-c8d3-4a16-a458-240167ed8a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:37.019648 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada1fcf-c8d3-4a16-a458-240167ed8a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:37.019899 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada1fcf-c8d3-4a16-a458-240167ed8a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:37.021414 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada1fcf-c8d3-4a16-a458-240167ed8a3b admin admin] PATH_INFO: `/v3/users/627d686138c74e3a92fc82cd5554cb83` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:37.021958 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada1fcf-c8d3-4a16-a458-240167ed8a3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=627d686138c74e3a92fc82cd5554cb83)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:37.022147 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb99239-e8d5-4730-9231-0e24be1799a3 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:37.023985 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada1fcf-c8d3-4a16-a458-240167ed8a3b admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:37.024107 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-1fb99239-e8d5-4730-9231-0e24be1799a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:37.040192 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:37.092648 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb99239-e8d5-4730-9231-0e24be1799a3 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:37.097339 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904257e5-891c-4e03-ad8c-d3bcd1257a98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:37.097991 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904257e5-891c-4e03-ad8c-d3bcd1257a98 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:37.098527 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904257e5-891c-4e03-ad8c-d3bcd1257a98 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:37.098678 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904257e5-891c-4e03-ad8c-d3bcd1257a98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:37.110049 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904257e5-891c-4e03-ad8c-d3bcd1257a98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:37.112268 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904257e5-891c-4e03-ad8c-d3bcd1257a98 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:37.122435 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1277/2572] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:05:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:05:37.260490 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-eada1fcf-c8d3-4a16-a458-240167ed8a3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '627d686138c74e3a92fc82cd5554cb83'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:37.261338 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-eada1fcf-c8d3-4a16-a458-240167ed8a3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '627d686138c74e3a92fc82cd5554cb83'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:37.261945 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-eada1fcf-c8d3-4a16-a458-240167ed8a3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '627d686138c74e3a92fc82cd5554cb83'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:37.367129 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-eada1fcf-c8d3-4a16-a458-240167ed8a3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '627d686138c74e3a92fc82cd5554cb83'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:37.372845 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-eada1fcf-c8d3-4a16-a458-240167ed8a3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '627d686138c74e3a92fc82cd5554cb83'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:37.398254 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1296/2573] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:05:36 2022] DELETE /identity/v3/users/627d686138c74e3a92fc82cd5554cb83 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:37.728860 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904257e5-891c-4e03-ad8c-d3bcd1257a98 service neutron] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:37.733505 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada1fcf-c8d3-4a16-a458-240167ed8a3b admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:37.735016 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-904257e5-891c-4e03-ad8c-d3bcd1257a98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:37.737620 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-eada1fcf-c8d3-4a16-a458-240167ed8a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:37.769125 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904257e5-891c-4e03-ad8c-d3bcd1257a98 service neutron] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:37.826894 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:37.845801 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a4ff7-a6bf-48dd-ba90-68380407359e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:37.846747 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a4ff7-a6bf-48dd-ba90-68380407359e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:37.847024 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a4ff7-a6bf-48dd-ba90-68380407359e admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:37.847658 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a4ff7-a6bf-48dd-ba90-68380407359e admin admin] PATH_INFO: `/v3/projects/525a1cce02334a6783c813b047f08486` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:37.847856 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada1fcf-c8d3-4a16-a458-240167ed8a3b admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:37.855282 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a4ff7-a6bf-48dd-ba90-68380407359e admin admin] RBAC: Authorizing `identity:delete_project(project_id=525a1cce02334a6783c813b047f08486)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:37.855684 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded0f32-c10b-43f8-a51d-ba6265d485f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:37.855814 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a4ff7-a6bf-48dd-ba90-68380407359e admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:37.855907 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded0f32-c10b-43f8-a51d-ba6265d485f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:37.855907 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded0f32-c10b-43f8-a51d-ba6265d485f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:37.855907 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded0f32-c10b-43f8-a51d-ba6265d485f3 admin admin] PATH_INFO: `/v3/projects/41ba6972f2284cdd8d4d05c824b7bee4` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:37.858161 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ded0f32-c10b-43f8-a51d-ba6265d485f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41ba6972f2284cdd8d4d05c824b7bee4)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:37.861420 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ded0f32-c10b-43f8-a51d-ba6265d485f3 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:38.007275 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7ded0f32-c10b-43f8-a51d-ba6265d485f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41ba6972f2284cdd8d4d05c824b7bee4', 'request_id': 'req-7ded0f32-c10b-43f8-a51d-ba6265d485f3'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:38.008186 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-f15a4ff7-a6bf-48dd-ba90-68380407359e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '525a1cce02334a6783c813b047f08486', 'request_id': 'req-f15a4ff7-a6bf-48dd-ba90-68380407359e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:38.013482 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7ded0f32-c10b-43f8-a51d-ba6265d485f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41ba6972f2284cdd8d4d05c824b7bee4', 'request_id': 'req-7ded0f32-c10b-43f8-a51d-ba6265d485f3'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:38.014665 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-f15a4ff7-a6bf-48dd-ba90-68380407359e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '525a1cce02334a6783c813b047f08486', 'request_id': 'req-f15a4ff7-a6bf-48dd-ba90-68380407359e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:38.114827 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7ded0f32-c10b-43f8-a51d-ba6265d485f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41ba6972f2284cdd8d4d05c824b7bee4', 'request_id': 'req-7ded0f32-c10b-43f8-a51d-ba6265d485f3'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:38.125932 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7ded0f32-c10b-43f8-a51d-ba6265d485f3 admin admin] The token cache is being invalidate because project 41ba6972f2284cdd8d4d05c824b7bee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:05:38.126254 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7ded0f32-c10b-43f8-a51d-ba6265d485f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:38.126890 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7ded0f32-c10b-43f8-a51d-ba6265d485f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:38.128480 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1297/2574] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:05:37 2022] DELETE /identity/v3/projects/41ba6972f2284cdd8d4d05c824b7bee4 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:05:38.133069 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42531294-3531-4e34-9035-486cfc9a1dd6 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:38.133426 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42531294-3531-4e34-9035-486cfc9a1dd6 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:38.133778 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42531294-3531-4e34-9035-486cfc9a1dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:38.153359 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-42531294-3531-4e34-9035-486cfc9a1dd6 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:38.154659 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-42531294-3531-4e34-9035-486cfc9a1dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:38.177633 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-f15a4ff7-a6bf-48dd-ba90-68380407359e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '525a1cce02334a6783c813b047f08486', 'request_id': 'req-f15a4ff7-a6bf-48dd-ba90-68380407359e'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:38.195283 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-f15a4ff7-a6bf-48dd-ba90-68380407359e admin admin] The token cache is being invalidate because project 525a1cce02334a6783c813b047f08486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:05:38.195584 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-f15a4ff7-a6bf-48dd-ba90-68380407359e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:38.196282 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-f15a4ff7-a6bf-48dd-ba90-68380407359e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:38.201160 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1278/2575] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:05:37 2022] DELETE /identity/v3/projects/525a1cce02334a6783c813b047f08486 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:38.202151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a4ff7-a6bf-48dd-ba90-68380407359e admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:38.205393 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-f15a4ff7-a6bf-48dd-ba90-68380407359e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:38.228474 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1298/2576] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:05:38.238264 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5912cc8-d527-4e99-88cb-89e343233cb2 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:38.238563 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5912cc8-d527-4e99-88cb-89e343233cb2 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:38.238848 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5912cc8-d527-4e99-88cb-89e343233cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:38.259549 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-e5912cc8-d527-4e99-88cb-89e343233cb2 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:38.260812 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-e5912cc8-d527-4e99-88cb-89e343233cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:38.262496 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:38.272769 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1299/2577] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:05:38.273786 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5912cc8-d527-4e99-88cb-89e343233cb2 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:38.283896 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5912cc8-d527-4e99-88cb-89e343233cb2 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:38.285932 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a4ff7-a6bf-48dd-ba90-68380407359e admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:38.289386 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1113ec-09d6-42f1-9a31-013e3baf664c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:38.290125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1113ec-09d6-42f1-9a31-013e3baf664c admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:38.290495 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1113ec-09d6-42f1-9a31-013e3baf664c admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:38.290839 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1113ec-09d6-42f1-9a31-013e3baf664c admin admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:38.291676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1113ec-09d6-42f1-9a31-013e3baf664c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:05:38.291992 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1113ec-09d6-42f1-9a31-013e3baf664c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:38.292417 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a0c53-3f53-4e74-920f-2b66fc1a6f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:38.293297 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a0c53-3f53-4e74-920f-2b66fc1a6f6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:38.293581 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a0c53-3f53-4e74-920f-2b66fc1a6f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:38.293711 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1113ec-09d6-42f1-9a31-013e3baf664c admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:38.293859 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a0c53-3f53-4e74-920f-2b66fc1a6f6e admin admin] PATH_INFO: `/v3/users/0ac58ef7b7e349b796a7df5897ce2c69` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:38.295348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a0c53-3f53-4e74-920f-2b66fc1a6f6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ac58ef7b7e349b796a7df5897ce2c69)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:38.299431 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a0c53-3f53-4e74-920f-2b66fc1a6f6e admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:38.311136 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1300/2578] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 16:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:05:38.317059 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1113ec-09d6-42f1-9a31-013e3baf664c admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:38.328238 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1113ec-09d6-42f1-9a31-013e3baf664c admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:38.333151 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d427d7-264f-4667-b930-5d774f1b2d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:38.333808 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d427d7-264f-4667-b930-5d774f1b2d05 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:38.334092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d427d7-264f-4667-b930-5d774f1b2d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:38.334370 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d427d7-264f-4667-b930-5d774f1b2d05 admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:38.335063 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d427d7-264f-4667-b930-5d774f1b2d05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:38.337088 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d427d7-264f-4667-b930-5d774f1b2d05 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:38.410911 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1301/2579] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:05:38 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:05:38.412328 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d427d7-264f-4667-b930-5d774f1b2d05 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:38.449283 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:38.465680 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-c25a0c53-3f53-4e74-920f-2b66fc1a6f6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ac58ef7b7e349b796a7df5897ce2c69'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:38.474615 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-c25a0c53-3f53-4e74-920f-2b66fc1a6f6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ac58ef7b7e349b796a7df5897ce2c69'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:38.475334 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-c25a0c53-3f53-4e74-920f-2b66fc1a6f6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ac58ef7b7e349b796a7df5897ce2c69'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:38.479225 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d427d7-264f-4667-b930-5d774f1b2d05 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:38.484113 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff5bd0-08d4-4e4c-a3cc-a3224e3c80b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:38.484876 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff5bd0-08d4-4e4c-a3cc-a3224e3c80b6 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:38.485815 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff5bd0-08d4-4e4c-a3cc-a3224e3c80b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:38.486135 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff5bd0-08d4-4e4c-a3cc-a3224e3c80b6 admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:38.486861 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff5bd0-08d4-4e4c-a3cc-a3224e3c80b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:38.488549 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-c25a0c53-3f53-4e74-920f-2b66fc1a6f6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ac58ef7b7e349b796a7df5897ce2c69'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:38.488806 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff5bd0-08d4-4e4c-a3cc-a3224e3c80b6 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:38.549876 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-c25a0c53-3f53-4e74-920f-2b66fc1a6f6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ac58ef7b7e349b796a7df5897ce2c69'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:38.560880 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1279/2580] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:05:38 2022] DELETE /identity/v3/users/0ac58ef7b7e349b796a7df5897ce2c69 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:38.582105 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1302/2581] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:05:38 2022] POST /identity/v3/users => generated 287 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:05:38.586048 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a0c53-3f53-4e74-920f-2b66fc1a6f6e admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:38.587548 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-c25a0c53-3f53-4e74-920f-2b66fc1a6f6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:38.666765 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a0c53-3f53-4e74-920f-2b66fc1a6f6e admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:38.671554 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ea456-b6b5-4fe1-a98e-6f78218ba331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:38.672570 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ea456-b6b5-4fe1-a98e-6f78218ba331 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:38.673125 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ea456-b6b5-4fe1-a98e-6f78218ba331 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:38.673409 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ea456-b6b5-4fe1-a98e-6f78218ba331 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:38.674906 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ea456-b6b5-4fe1-a98e-6f78218ba331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:38.676775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ea456-b6b5-4fe1-a98e-6f78218ba331 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:38.687015 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1280/2582] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:05:38.691577 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff5bd0-08d4-4e4c-a3cc-a3224e3c80b6 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:38.718242 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff5bd0-08d4-4e4c-a3cc-a3224e3c80b6 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:38.718242 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c107aa-1bfa-42b1-98bb-a892355fdbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:38.718242 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c107aa-1bfa-42b1-98bb-a892355fdbbc admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:38.718242 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c107aa-1bfa-42b1-98bb-a892355fdbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:38.718718 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c107aa-1bfa-42b1-98bb-a892355fdbbc admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:38.718718 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c107aa-1bfa-42b1-98bb-a892355fdbbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:38.718718 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c107aa-1bfa-42b1-98bb-a892355fdbbc admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:38.720173 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1303/2583] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:05:38.724374 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ea456-b6b5-4fe1-a98e-6f78218ba331 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:38.734286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ea456-b6b5-4fe1-a98e-6f78218ba331 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:38.740176 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e7e7f-9a3b-4527-ba73-12d908eb5fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:38.741051 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e7e7f-9a3b-4527-ba73-12d908eb5fc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:38.741335 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e7e7f-9a3b-4527-ba73-12d908eb5fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:38.742781 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e7e7f-9a3b-4527-ba73-12d908eb5fc5 admin admin] PATH_INFO: `/v3/projects/923d32fd0b424969baaa828b8e8ab67e/users/52a5278ab4f74b2a934158f5246ad170/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:38.757879 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e7e7f-9a3b-4527-ba73-12d908eb5fc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=923d32fd0b424969baaa828b8e8ab67e, user_id=52a5278ab4f74b2a934158f5246ad170, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:38.760860 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e7e7f-9a3b-4527-ba73-12d908eb5fc5 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:38.829061 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1281/2584] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:05:38 2022] PUT /identity/v3/projects/923d32fd0b424969baaa828b8e8ab67e/users/52a5278ab4f74b2a934158f5246ad170/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:05:38.839129 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ff754-a433-4d95-9c8d-1624086ec3b5 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:38.839804 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ff754-a433-4d95-9c8d-1624086ec3b5 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:38.839804 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ff754-a433-4d95-9c8d-1624086ec3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:38.877238 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-541ff754-a433-4d95-9c8d-1624086ec3b5 None None] MFA Rules not processed for user `52a5278ab4f74b2a934158f5246ad170`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:38.878523 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-541ff754-a433-4d95-9c8d-1624086ec3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:38.964406 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1304/2585] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:05:38.975385 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e7e7f-9a3b-4527-ba73-12d908eb5fc5 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:38.977322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-109e7e7f-9a3b-4527-ba73-12d908eb5fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:39.022066 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:39.040643 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e7e7f-9a3b-4527-ba73-12d908eb5fc5 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:39.044365 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f9945-9d09-4894-a8ab-4481c4f66516 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:39.045372 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f9945-9d09-4894-a8ab-4481c4f66516 service cinder] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:39.045529 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f9945-9d09-4894-a8ab-4481c4f66516 service cinder] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:39.045852 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f9945-9d09-4894-a8ab-4481c4f66516 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:39.058979 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f9945-9d09-4894-a8ab-4481c4f66516 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:39.060440 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f9945-9d09-4894-a8ab-4481c4f66516 service cinder] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:39.071126 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1282/2586] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:05:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:05:39.076315 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ff754-a433-4d95-9c8d-1624086ec3b5 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:39.081094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-541ff754-a433-4d95-9c8d-1624086ec3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:39.151924 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ff754-a433-4d95-9c8d-1624086ec3b5 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:39.157707 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ac8b1-ab0b-406c-bbb9-c366a9e75aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:39.158569 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ac8b1-ab0b-406c-bbb9-c366a9e75aa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:39.158850 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ac8b1-ab0b-406c-bbb9-c366a9e75aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:39.159149 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ac8b1-ab0b-406c-bbb9-c366a9e75aa6 admin admin] PATH_INFO: `/v3/projects/6a015f7684054bada999a68be497a778` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:39.160382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ac8b1-ab0b-406c-bbb9-c366a9e75aa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a015f7684054bada999a68be497a778)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:39.162332 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ac8b1-ab0b-406c-bbb9-c366a9e75aa6 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:39.284174 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:39.287726 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-1a5ac8b1-ab0b-406c-bbb9-c366a9e75aa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a015f7684054bada999a68be497a778', 'request_id': 'req-1a5ac8b1-ab0b-406c-bbb9-c366a9e75aa6'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:39.294128 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-1a5ac8b1-ab0b-406c-bbb9-c366a9e75aa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a015f7684054bada999a68be497a778', 'request_id': 'req-1a5ac8b1-ab0b-406c-bbb9-c366a9e75aa6'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:39.394930 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-1a5ac8b1-ab0b-406c-bbb9-c366a9e75aa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a015f7684054bada999a68be497a778', 'request_id': 'req-1a5ac8b1-ab0b-406c-bbb9-c366a9e75aa6'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:39.405995 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-1a5ac8b1-ab0b-406c-bbb9-c366a9e75aa6 admin admin] The token cache is being invalidate because project 6a015f7684054bada999a68be497a778 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:05:39.406279 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-1a5ac8b1-ab0b-406c-bbb9-c366a9e75aa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:39.407436 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-1a5ac8b1-ab0b-406c-bbb9-c366a9e75aa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:39.409355 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1305/2587] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:05:39 2022] DELETE /identity/v3/projects/6a015f7684054bada999a68be497a778 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:39.414259 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa997f-83af-40b8-b7e2-7e71c29947d6 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:39.414549 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa997f-83af-40b8-b7e2-7e71c29947d6 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:39.414848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa997f-83af-40b8-b7e2-7e71c29947d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:39.433295 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-2cfa997f-83af-40b8-b7e2-7e71c29947d6 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:39.434496 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-2cfa997f-83af-40b8-b7e2-7e71c29947d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:39.499943 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1283/2588] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:05:39.501993 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62462ee-0920-408b-99ab-938cbf30cbb8 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:39.502289 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62462ee-0920-408b-99ab-938cbf30cbb8 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:39.502569 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62462ee-0920-408b-99ab-938cbf30cbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:39.521670 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-c62462ee-0920-408b-99ab-938cbf30cbb8 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:39.522892 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-c62462ee-0920-408b-99ab-938cbf30cbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:39.531028 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1306/2589] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:05:39.536062 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa997f-83af-40b8-b7e2-7e71c29947d6 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:39.545792 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa997f-83af-40b8-b7e2-7e71c29947d6 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:39.550780 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a791cb-1248-4dc3-a5b5-0e15b977c930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:39.551427 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a791cb-1248-4dc3-a5b5-0e15b977c930 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:39.552336 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a791cb-1248-4dc3-a5b5-0e15b977c930 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:39.552336 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a791cb-1248-4dc3-a5b5-0e15b977c930 admin admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:39.552808 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a791cb-1248-4dc3-a5b5-0e15b977c930 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:05:39.553118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a791cb-1248-4dc3-a5b5-0e15b977c930 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:39.554721 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a791cb-1248-4dc3-a5b5-0e15b977c930 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:39.566479 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1284/2590] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 16:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:05:39.570918 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62462ee-0920-408b-99ab-938cbf30cbb8 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:39.581129 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62462ee-0920-408b-99ab-938cbf30cbb8 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:39.586017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2929267-2fae-42ed-a1bb-b31759b137e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:39.586664 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2929267-2fae-42ed-a1bb-b31759b137e7 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:39.586948 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2929267-2fae-42ed-a1bb-b31759b137e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:39.587223 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2929267-2fae-42ed-a1bb-b31759b137e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:39.587954 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2929267-2fae-42ed-a1bb-b31759b137e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:39.589914 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2929267-2fae-42ed-a1bb-b31759b137e7 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:39.744878 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1307/2591] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:05:39 2022] POST /identity/v3/projects => generated 375 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:05:39.748852 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a791cb-1248-4dc3-a5b5-0e15b977c930 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:39.759749 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a791cb-1248-4dc3-a5b5-0e15b977c930 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:39.824403 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81acbee0-4831-49dc-9915-2f8c4f49765f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:39.825078 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acbee0-4831-49dc-9915-2f8c4f49765f admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:39.825363 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acbee0-4831-49dc-9915-2f8c4f49765f admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:39.825642 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acbee0-4831-49dc-9915-2f8c4f49765f admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:39.826333 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81acbee0-4831-49dc-9915-2f8c4f49765f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:39.828332 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81acbee0-4831-49dc-9915-2f8c4f49765f admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:39.903504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1285/2592] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:05:39 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:05:39.908472 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2929267-2fae-42ed-a1bb-b31759b137e7 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:39.918995 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2929267-2fae-42ed-a1bb-b31759b137e7 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:39.925093 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab5c9e-0aa5-4f53-b3fa-f818813244d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:39.925778 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab5c9e-0aa5-4f53-b3fa-f818813244d6 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:39.926063 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab5c9e-0aa5-4f53-b3fa-f818813244d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:39.926340 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab5c9e-0aa5-4f53-b3fa-f818813244d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:39.927076 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab5c9e-0aa5-4f53-b3fa-f818813244d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:39.928697 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab5c9e-0aa5-4f53-b3fa-f818813244d6 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:39.942708 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1308/2593] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:05:39.944722 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81acbee0-4831-49dc-9915-2f8c4f49765f admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:39.957365 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81acbee0-4831-49dc-9915-2f8c4f49765f admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:39.963648 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d697a39-09fd-4d2a-9940-aef36770f627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:39.963648 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d697a39-09fd-4d2a-9940-aef36770f627 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:39.963648 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d697a39-09fd-4d2a-9940-aef36770f627 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:39.966786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d697a39-09fd-4d2a-9940-aef36770f627 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:39.966786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d697a39-09fd-4d2a-9940-aef36770f627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:39.966786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d697a39-09fd-4d2a-9940-aef36770f627 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:39.981027 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1286/2594] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:05:39.984175 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab5c9e-0aa5-4f53-b3fa-f818813244d6 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:39.999927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab5c9e-0aa5-4f53-b3fa-f818813244d6 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:40.007354 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d11a35-f77a-4b92-b14c-105bfcb52456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:40.008298 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d11a35-f77a-4b92-b14c-105bfcb52456 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:40.008583 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d11a35-f77a-4b92-b14c-105bfcb52456 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:40.008863 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d11a35-f77a-4b92-b14c-105bfcb52456 admin admin] PATH_INFO: `/v3/projects/f5b87d8817ac442587568ea265a4a8a8/users/e126a2d540ba41fab9e00830a1bbc87d/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:40.030365 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d11a35-f77a-4b92-b14c-105bfcb52456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5b87d8817ac442587568ea265a4a8a8, user_id=e126a2d540ba41fab9e00830a1bbc87d, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:40.032997 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d11a35-f77a-4b92-b14c-105bfcb52456 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:40.166013 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1309/2595] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:05:39 2022] PUT /identity/v3/projects/f5b87d8817ac442587568ea265a4a8a8/users/e126a2d540ba41fab9e00830a1bbc87d/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:40.178117 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007b8ea-ed6a-49f9-b922-f0de41e2ddf0 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:40.178580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007b8ea-ed6a-49f9-b922-f0de41e2ddf0 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:40.178712 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007b8ea-ed6a-49f9-b922-f0de41e2ddf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:40.207804 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-6007b8ea-ed6a-49f9-b922-f0de41e2ddf0 None None] MFA Rules not processed for user `e126a2d540ba41fab9e00830a1bbc87d`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:40.214310 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-6007b8ea-ed6a-49f9-b922-f0de41e2ddf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:40.257616 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:40.293618 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1287/2596] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:05:40.305962 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d11a35-f77a-4b92-b14c-105bfcb52456 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:40.308810 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-b2d11a35-f77a-4b92-b14c-105bfcb52456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:40.366547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d11a35-f77a-4b92-b14c-105bfcb52456 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:40.370247 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d572eda-0057-4d66-bdbf-ebf47c451591 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:40.370887 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d572eda-0057-4d66-bdbf-ebf47c451591 service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:40.371167 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d572eda-0057-4d66-bdbf-ebf47c451591 service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:40.371461 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d572eda-0057-4d66-bdbf-ebf47c451591 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:40.379819 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d572eda-0057-4d66-bdbf-ebf47c451591 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:40.383230 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d572eda-0057-4d66-bdbf-ebf47c451591 service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:40.390371 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1310/2597] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:05:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:05:42.098276 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a71a6-40d7-4c1e-93b5-403acf16059d None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:42.098757 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a71a6-40d7-4c1e-93b5-403acf16059d None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:42.098875 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a71a6-40d7-4c1e-93b5-403acf16059d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:42.122119 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-b97a71a6-40d7-4c1e-93b5-403acf16059d None None] MFA Rules not processed for user `e126a2d540ba41fab9e00830a1bbc87d`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:42.123415 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-b97a71a6-40d7-4c1e-93b5-403acf16059d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:42.131007 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1288/2598] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:05:42.790079 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d572eda-0057-4d66-bdbf-ebf47c451591 service cinder] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:42.791407 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-2d572eda-0057-4d66-bdbf-ebf47c451591 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:42.858949 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d572eda-0057-4d66-bdbf-ebf47c451591 service cinder] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:42.863459 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9435f-f955-4277-9dd1-9863452a1684 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:42.864269 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9435f-f955-4277-9dd1-9863452a1684 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:42.864632 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9435f-f955-4277-9dd1-9863452a1684 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:42.864984 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9435f-f955-4277-9dd1-9863452a1684 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:42.866899 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-64b9435f-f955-4277-9dd1-9863452a1684 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:42.898062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:42.935550 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9435f-f955-4277-9dd1-9863452a1684 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:42.937120 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9435f-f955-4277-9dd1-9863452a1684 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:42.948540 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1311/2599] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:05:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:05:47.504870 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a71a6-40d7-4c1e-93b5-403acf16059d None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:47.508032 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-b97a71a6-40d7-4c1e-93b5-403acf16059d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:47.538257 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a71a6-40d7-4c1e-93b5-403acf16059d None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:47.547100 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d245d8-3427-470c-a3ff-2a4bc43865e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:47.548804 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d245d8-3427-470c-a3ff-2a4bc43865e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:47.549278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d245d8-3427-470c-a3ff-2a4bc43865e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:47.549916 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d245d8-3427-470c-a3ff-2a4bc43865e0 admin admin] PATH_INFO: `/v3/users/ce2a9dc6fbae42dfbfa4cb8b326c3de5` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:47.577408 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d245d8-3427-470c-a3ff-2a4bc43865e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce2a9dc6fbae42dfbfa4cb8b326c3de5)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:47.583421 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d245d8-3427-470c-a3ff-2a4bc43865e0 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:47.752573 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-05d245d8-3427-470c-a3ff-2a4bc43865e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce2a9dc6fbae42dfbfa4cb8b326c3de5'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:47.767417 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-05d245d8-3427-470c-a3ff-2a4bc43865e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce2a9dc6fbae42dfbfa4cb8b326c3de5'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:47.768216 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-05d245d8-3427-470c-a3ff-2a4bc43865e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce2a9dc6fbae42dfbfa4cb8b326c3de5'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:47.782113 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-05d245d8-3427-470c-a3ff-2a4bc43865e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce2a9dc6fbae42dfbfa4cb8b326c3de5'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:47.862401 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-05d245d8-3427-470c-a3ff-2a4bc43865e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce2a9dc6fbae42dfbfa4cb8b326c3de5'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:47.868880 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1289/2600] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:05:47 2022] DELETE /identity/v3/users/ce2a9dc6fbae42dfbfa4cb8b326c3de5 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:48.049659 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab981acd-66da-48b0-bec7-384018a41edb None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:48.050831 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab981acd-66da-48b0-bec7-384018a41edb None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:48.051381 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab981acd-66da-48b0-bec7-384018a41edb None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:48.053209 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1312/2601] 10.222.0.39 () {54 vars in 921 bytes} [Mon May 23 16:05:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:05:48.065911 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792951f-250a-4ad9-9cdd-8a066296f4f0 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:48.066457 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792951f-250a-4ad9-9cdd-8a066296f4f0 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:48.067266 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792951f-250a-4ad9-9cdd-8a066296f4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:48.138303 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-9792951f-250a-4ad9-9cdd-8a066296f4f0 None None] MFA Rules not processed for user `f831a06a9cf344a2aa068c20a987b6da`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:48.141747 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-9792951f-250a-4ad9-9cdd-8a066296f4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:48.226642 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1290/2602] 10.222.0.39 () {58 vars in 1018 bytes} [Mon May 23 16:05:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:05:48.238915 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab981acd-66da-48b0-bec7-384018a41edb None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:48.240890 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-ab981acd-66da-48b0-bec7-384018a41edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:48.278060 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab981acd-66da-48b0-bec7-384018a41edb None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:48.280979 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792951f-250a-4ad9-9cdd-8a066296f4f0 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:48.286181 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-9792951f-250a-4ad9-9cdd-8a066296f4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:48.286724 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442460b-8077-4d0f-81af-9d4608e7e137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:48.286724 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442460b-8077-4d0f-81af-9d4608e7e137 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:48.286724 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442460b-8077-4d0f-81af-9d4608e7e137 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:48.286724 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442460b-8077-4d0f-81af-9d4608e7e137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:48.297897 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442460b-8077-4d0f-81af-9d4608e7e137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:48.299786 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442460b-8077-4d0f-81af-9d4608e7e137 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:48.320520 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1313/2603] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:05:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:05:48.326385 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:48.398683 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792951f-250a-4ad9-9cdd-8a066296f4f0 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:48.410696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad9258-97e9-448f-b484-df3b48ac663f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:48.411824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad9258-97e9-448f-b484-df3b48ac663f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:48.412111 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad9258-97e9-448f-b484-df3b48ac663f admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:48.412560 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad9258-97e9-448f-b484-df3b48ac663f admin admin] PATH_INFO: `/v3/projects/4c8e2e9cc6684a40a8e5e669ca7b07d2` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:48.438429 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad9258-97e9-448f-b484-df3b48ac663f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c8e2e9cc6684a40a8e5e669ca7b07d2)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:48.449167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad9258-97e9-448f-b484-df3b48ac663f admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:48.457925 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a710c-7e86-4670-9765-a074969e1887 None None] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:48.458240 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a710c-7e86-4670-9765-a074969e1887 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:48.458522 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a710c-7e86-4670-9765-a074969e1887 None None] PATH_INFO: `/` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:48.461536 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1314/2604] 10.222.0.39 () {54 vars in 921 bytes} [Mon May 23 16:05:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 16:05:48.470586 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19506b6f-c381-4490-b26e-b7def1c68228 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:48.470870 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19506b6f-c381-4490-b26e-b7def1c68228 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:48.471946 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19506b6f-c381-4490-b26e-b7def1c68228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:48.499673 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-19506b6f-c381-4490-b26e-b7def1c68228 None None] MFA Rules not processed for user `76f7895b7b5748e7b4461f7fde1d558a`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:48.504324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-19506b6f-c381-4490-b26e-b7def1c68228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:48.601498 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-15ad9258-97e9-448f-b484-df3b48ac663f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c8e2e9cc6684a40a8e5e669ca7b07d2', 'request_id': 'req-15ad9258-97e9-448f-b484-df3b48ac663f'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:48.615923 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-15ad9258-97e9-448f-b484-df3b48ac663f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c8e2e9cc6684a40a8e5e669ca7b07d2', 'request_id': 'req-15ad9258-97e9-448f-b484-df3b48ac663f'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:48.644093 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1315/2605] 10.222.0.39 () {58 vars in 1018 bytes} [Mon May 23 16:05:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:05:48.662557 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19506b6f-c381-4490-b26e-b7def1c68228 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:48.677671 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19506b6f-c381-4490-b26e-b7def1c68228 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:48.723670 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-15ad9258-97e9-448f-b484-df3b48ac663f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c8e2e9cc6684a40a8e5e669ca7b07d2', 'request_id': 'req-15ad9258-97e9-448f-b484-df3b48ac663f'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:48.738385 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-15ad9258-97e9-448f-b484-df3b48ac663f admin admin] The token cache is being invalidate because project 4c8e2e9cc6684a40a8e5e669ca7b07d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:05:48.738750 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-15ad9258-97e9-448f-b484-df3b48ac663f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:48.740404 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-15ad9258-97e9-448f-b484-df3b48ac663f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:48.744620 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1291/2606] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:05:48 2022] DELETE /identity/v3/projects/4c8e2e9cc6684a40a8e5e669ca7b07d2 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:05:48.749605 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b435f-1438-4661-9a30-e181c8e6ef9f None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:48.752650 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b435f-1438-4661-9a30-e181c8e6ef9f None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:48.752650 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b435f-1438-4661-9a30-e181c8e6ef9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:48.768936 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f915d-ca69-45c0-a5b7-41337583dec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:48.769976 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f915d-ca69-45c0-a5b7-41337583dec3 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:48.770329 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f915d-ca69-45c0-a5b7-41337583dec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:48.770675 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f915d-ca69-45c0-a5b7-41337583dec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:48.773621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-4d2f915d-ca69-45c0-a5b7-41337583dec3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:48.777330 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-be9b435f-1438-4661-9a30-e181c8e6ef9f None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:48.780435 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-be9b435f-1438-4661-9a30-e181c8e6ef9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:48.851350 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:48.869296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1292/2607] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:05:48.873840 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f915d-ca69-45c0-a5b7-41337583dec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:48.875901 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f915d-ca69-45c0-a5b7-41337583dec3 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:48.877043 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedfa86-b27f-4d4f-9b69-1fa02e9d05e6 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:48.877503 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedfa86-b27f-4d4f-9b69-1fa02e9d05e6 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:48.877782 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedfa86-b27f-4d4f-9b69-1fa02e9d05e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:48.889637 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1316/2608] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:05:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:05:48.904707 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-0bedfa86-b27f-4d4f-9b69-1fa02e9d05e6 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:48.905947 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-0bedfa86-b27f-4d4f-9b69-1fa02e9d05e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:48.940018 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1293/2609] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:05:48.941501 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f915d-ca69-45c0-a5b7-41337583dec3 service neutron] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:48.952777 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f915d-ca69-45c0-a5b7-41337583dec3 service neutron] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:48.958917 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb7ad2-1f10-4d08-ac2a-cf06fda0ac63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:48.959618 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb7ad2-1f10-4d08-ac2a-cf06fda0ac63 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:48.960061 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb7ad2-1f10-4d08-ac2a-cf06fda0ac63 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:48.960490 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb7ad2-1f10-4d08-ac2a-cf06fda0ac63 admin admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:48.961268 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb7ad2-1f10-4d08-ac2a-cf06fda0ac63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:05:48.961551 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb7ad2-1f10-4d08-ac2a-cf06fda0ac63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:48.963253 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb7ad2-1f10-4d08-ac2a-cf06fda0ac63 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:48.987938 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1317/2610] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 16:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:05:48.991858 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bedfa86-b27f-4d4f-9b69-1fa02e9d05e6 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:49.010763 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bedfa86-b27f-4d4f-9b69-1fa02e9d05e6 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:49.011269 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edd976-e2b1-4398-969c-1afa9a84247f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:49.012218 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edd976-e2b1-4398-969c-1afa9a84247f admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:49.012574 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edd976-e2b1-4398-969c-1afa9a84247f admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:49.012919 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edd976-e2b1-4398-969c-1afa9a84247f admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:49.013741 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33edd976-e2b1-4398-969c-1afa9a84247f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:49.016908 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33edd976-e2b1-4398-969c-1afa9a84247f admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:49.117504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1294/2611] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:05:48 2022] POST /identity/v3/projects => generated 367 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:05:49.121610 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb7ad2-1f10-4d08-ac2a-cf06fda0ac63 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:49.136385 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb7ad2-1f10-4d08-ac2a-cf06fda0ac63 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:49.255919 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d305e-bdee-4d17-a6aa-24e73034c577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:49.256758 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d305e-bdee-4d17-a6aa-24e73034c577 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:49.257123 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d305e-bdee-4d17-a6aa-24e73034c577 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:49.257478 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d305e-bdee-4d17-a6aa-24e73034c577 admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:49.258708 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d305e-bdee-4d17-a6aa-24e73034c577 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:49.262250 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d305e-bdee-4d17-a6aa-24e73034c577 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:49.463760 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1318/2612] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:05:49 2022] POST /identity/v3/users => generated 284 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:05:49.467693 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edd976-e2b1-4398-969c-1afa9a84247f admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:49.481158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edd976-e2b1-4398-969c-1afa9a84247f admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:49.495589 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f61b81-181e-42d9-bd02-4c9ca318a9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:49.497791 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f61b81-181e-42d9-bd02-4c9ca318a9bd admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:49.498185 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f61b81-181e-42d9-bd02-4c9ca318a9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:49.498565 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f61b81-181e-42d9-bd02-4c9ca318a9bd admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:49.499612 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f61b81-181e-42d9-bd02-4c9ca318a9bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:49.502488 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f61b81-181e-42d9-bd02-4c9ca318a9bd admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:49.525704 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1295/2613] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:05:49.526465 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d305e-bdee-4d17-a6aa-24e73034c577 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:49.538197 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d305e-bdee-4d17-a6aa-24e73034c577 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:49.549235 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0029bf3-35d8-4750-94dd-be8a878e60f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:49.549937 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0029bf3-35d8-4750-94dd-be8a878e60f9 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:49.550282 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0029bf3-35d8-4750-94dd-be8a878e60f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:49.550565 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0029bf3-35d8-4750-94dd-be8a878e60f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:49.551353 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0029bf3-35d8-4750-94dd-be8a878e60f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:49.557810 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0029bf3-35d8-4750-94dd-be8a878e60f9 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:49.583693 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1319/2614] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:05:49.585031 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f61b81-181e-42d9-bd02-4c9ca318a9bd admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:49.598036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f61b81-181e-42d9-bd02-4c9ca318a9bd admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:49.604162 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d5aaf-df30-489e-80b1-30b1923727ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:49.611719 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d5aaf-df30-489e-80b1-30b1923727ab admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:49.611719 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d5aaf-df30-489e-80b1-30b1923727ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:49.611719 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d5aaf-df30-489e-80b1-30b1923727ab admin admin] PATH_INFO: `/v3/projects/3e975900e60f40338b6ae4f5dd63ee94/users/c994c0638bdc403bb4c2bf28b6c69d95/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:49.611719 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:49.629245 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d5aaf-df30-489e-80b1-30b1923727ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e975900e60f40338b6ae4f5dd63ee94, user_id=c994c0638bdc403bb4c2bf28b6c69d95, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:49.632999 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d5aaf-df30-489e-80b1-30b1923727ab admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:49.777179 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1296/2615] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:05:49 2022] PUT /identity/v3/projects/3e975900e60f40338b6ae4f5dd63ee94/users/c994c0638bdc403bb4c2bf28b6c69d95/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:49.787700 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a44edd-60cd-4ede-ae5f-84d666b3e13b None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:49.788088 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a44edd-60cd-4ede-ae5f-84d666b3e13b None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:49.788436 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a44edd-60cd-4ede-ae5f-84d666b3e13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:49.838934 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-51a44edd-60cd-4ede-ae5f-84d666b3e13b None None] MFA Rules not processed for user `c994c0638bdc403bb4c2bf28b6c69d95`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:49.840285 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-51a44edd-60cd-4ede-ae5f-84d666b3e13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:49.920194 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1320/2616] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:05:49.925848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d5aaf-df30-489e-80b1-30b1923727ab admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:49.999125 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d5aaf-df30-489e-80b1-30b1923727ab admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:50.004731 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ee648-fa44-44fd-aafa-8ffd593f8c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:50.005397 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ee648-fa44-44fd-aafa-8ffd593f8c40 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:50.005834 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ee648-fa44-44fd-aafa-8ffd593f8c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:50.006119 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ee648-fa44-44fd-aafa-8ffd593f8c40 admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:50.009180 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ee648-fa44-44fd-aafa-8ffd593f8c40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:50.009180 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ee648-fa44-44fd-aafa-8ffd593f8c40 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:50.132185 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1297/2617] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:05:49 2022] POST /identity/v3/projects => generated 369 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:05:50.136564 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a44edd-60cd-4ede-ae5f-84d666b3e13b None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:50.147887 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a44edd-60cd-4ede-ae5f-84d666b3e13b None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:50.185417 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:50.226484 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f881319-553f-417b-bcb4-7374700a5979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:50.227408 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f881319-553f-417b-bcb4-7374700a5979 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:50.227736 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f881319-553f-417b-bcb4-7374700a5979 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:50.228022 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f881319-553f-417b-bcb4-7374700a5979 admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:50.228725 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f881319-553f-417b-bcb4-7374700a5979 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:50.237467 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f881319-553f-417b-bcb4-7374700a5979 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:50.349453 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1321/2618] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:05:50 2022] POST /identity/v3/users => generated 291 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:05:50.353496 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ee648-fa44-44fd-aafa-8ffd593f8c40 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:50.364391 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ee648-fa44-44fd-aafa-8ffd593f8c40 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:50.368831 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb005f-67b2-4dd4-ac79-5bf39a4abb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:50.369479 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb005f-67b2-4dd4-ac79-5bf39a4abb1c admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:50.369761 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb005f-67b2-4dd4-ac79-5bf39a4abb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:50.370036 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb005f-67b2-4dd4-ac79-5bf39a4abb1c admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:50.370753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb005f-67b2-4dd4-ac79-5bf39a4abb1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:50.372454 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb005f-67b2-4dd4-ac79-5bf39a4abb1c admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:50.383083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1298/2619] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:05:50.389626 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f881319-553f-417b-bcb4-7374700a5979 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:50.400291 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f881319-553f-417b-bcb4-7374700a5979 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:50.404970 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43379cd0-1353-4ed3-81a6-2c377697878a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:50.405848 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43379cd0-1353-4ed3-81a6-2c377697878a admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:50.406127 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43379cd0-1353-4ed3-81a6-2c377697878a admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:50.406399 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43379cd0-1353-4ed3-81a6-2c377697878a admin admin] PATH_INFO: `/v3/projects/9c2fa56328cd4096b676cc8a1a366f15/users/f6b7432e022c493b9c1c919b8ed536f5/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:50.425281 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43379cd0-1353-4ed3-81a6-2c377697878a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c2fa56328cd4096b676cc8a1a366f15, user_id=f6b7432e022c493b9c1c919b8ed536f5, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:50.428188 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43379cd0-1353-4ed3-81a6-2c377697878a admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:50.521370 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1322/2620] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:05:50 2022] PUT /identity/v3/projects/9c2fa56328cd4096b676cc8a1a366f15/users/f6b7432e022c493b9c1c919b8ed536f5/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:05:50.525337 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb005f-67b2-4dd4-ac79-5bf39a4abb1c admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:50.536412 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb005f-67b2-4dd4-ac79-5bf39a4abb1c admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:50.596693 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7178da1-2c36-4462-9ca3-32ecdf4016b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:50.597365 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7178da1-2c36-4462-9ca3-32ecdf4016b5 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:50.597648 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7178da1-2c36-4462-9ca3-32ecdf4016b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:50.597923 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7178da1-2c36-4462-9ca3-32ecdf4016b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:50.598656 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7178da1-2c36-4462-9ca3-32ecdf4016b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:50.600377 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7178da1-2c36-4462-9ca3-32ecdf4016b5 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:50.611672 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1299/2621] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:05:50.615942 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43379cd0-1353-4ed3-81a6-2c377697878a admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:50.626357 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43379cd0-1353-4ed3-81a6-2c377697878a admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:50.631021 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5969c8-a355-4e1e-ae70-686406a38c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:50.631873 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5969c8-a355-4e1e-ae70-686406a38c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:50.632159 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5969c8-a355-4e1e-ae70-686406a38c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:50.632438 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5969c8-a355-4e1e-ae70-686406a38c10 admin admin] PATH_INFO: `/v3/projects/9c2fa56328cd4096b676cc8a1a366f15/users/f6b7432e022c493b9c1c919b8ed536f5/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:50.634411 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5969c8-a355-4e1e-ae70-686406a38c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c2fa56328cd4096b676cc8a1a366f15, user_id=f6b7432e022c493b9c1c919b8ed536f5, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:50.637086 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5969c8-a355-4e1e-ae70-686406a38c10 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:50.647626 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1323/2622] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:05:50 2022] PUT /identity/v3/projects/9c2fa56328cd4096b676cc8a1a366f15/users/f6b7432e022c493b9c1c919b8ed536f5/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:50.659888 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b947762-7608-47d0-88f3-68df1f6939f5 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:50.660235 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b947762-7608-47d0-88f3-68df1f6939f5 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:50.660583 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b947762-7608-47d0-88f3-68df1f6939f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:50.688919 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-7b947762-7608-47d0-88f3-68df1f6939f5 None None] MFA Rules not processed for user `f6b7432e022c493b9c1c919b8ed536f5`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:50.690106 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-7b947762-7608-47d0-88f3-68df1f6939f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:50.732607 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:50.758732 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1300/2623] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:50 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:05:50.770241 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5969c8-a355-4e1e-ae70-686406a38c10 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:50.772727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-6d5969c8-a355-4e1e-ae70-686406a38c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:50.829724 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5969c8-a355-4e1e-ae70-686406a38c10 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:50.833447 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51332e-d57a-4f89-b37c-8d0353751d0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:50.834088 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51332e-d57a-4f89-b37c-8d0353751d0e service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:50.834373 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51332e-d57a-4f89-b37c-8d0353751d0e service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:50.834649 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51332e-d57a-4f89-b37c-8d0353751d0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:50.843694 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a51332e-d57a-4f89-b37c-8d0353751d0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:50.846040 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a51332e-d57a-4f89-b37c-8d0353751d0e service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:50.855448 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1324/2624] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:05:50 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:05:53.436027 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b947762-7608-47d0-88f3-68df1f6939f5 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:53.438108 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-7b947762-7608-47d0-88f3-68df1f6939f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:53.510968 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b947762-7608-47d0-88f3-68df1f6939f5 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:53.514495 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e54da-6eb8-493a-9b2d-fa31eab9cba9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:53.515137 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e54da-6eb8-493a-9b2d-fa31eab9cba9 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:53.515411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e54da-6eb8-493a-9b2d-fa31eab9cba9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:53.515802 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e54da-6eb8-493a-9b2d-fa31eab9cba9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:53.517564 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-596e54da-6eb8-493a-9b2d-fa31eab9cba9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:53.527294 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e54da-6eb8-493a-9b2d-fa31eab9cba9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:53.528765 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e54da-6eb8-493a-9b2d-fa31eab9cba9 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:53.538277 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1301/2625] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:05:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:05:53.568201 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51332e-d57a-4f89-b37c-8d0353751d0e service cinder] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:53.570566 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-3a51332e-d57a-4f89-b37c-8d0353751d0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:53.662530 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51332e-d57a-4f89-b37c-8d0353751d0e service cinder] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:53.668504 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9dd5c-254f-4b0f-8d2b-00b37d0248a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:53.669487 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9dd5c-254f-4b0f-8d2b-00b37d0248a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:53.669881 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9dd5c-254f-4b0f-8d2b-00b37d0248a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:53.670256 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9dd5c-254f-4b0f-8d2b-00b37d0248a1 admin admin] PATH_INFO: `/v3/users/52a5278ab4f74b2a934158f5246ad170` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:53.671686 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb9dd5c-254f-4b0f-8d2b-00b37d0248a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52a5278ab4f74b2a934158f5246ad170)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:53.675008 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb9dd5c-254f-4b0f-8d2b-00b37d0248a1 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:53.891830 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:53.917682 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e54da-6eb8-493a-9b2d-fa31eab9cba9 service neutron] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:53.928665 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-5fb9dd5c-254f-4b0f-8d2b-00b37d0248a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52a5278ab4f74b2a934158f5246ad170'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:53.929980 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-5fb9dd5c-254f-4b0f-8d2b-00b37d0248a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52a5278ab4f74b2a934158f5246ad170'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:53.930986 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-5fb9dd5c-254f-4b0f-8d2b-00b37d0248a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52a5278ab4f74b2a934158f5246ad170'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:53.932616 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e54da-6eb8-493a-9b2d-fa31eab9cba9 service neutron] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:53.938900 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b5870-e3b8-4535-8dfe-05732521630a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:53.939892 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b5870-e3b8-4535-8dfe-05732521630a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:53.940229 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b5870-e3b8-4535-8dfe-05732521630a admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:53.940583 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b5870-e3b8-4535-8dfe-05732521630a admin admin] PATH_INFO: `/v3/users/c994c0638bdc403bb4c2bf28b6c69d95` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:53.942208 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b5870-e3b8-4535-8dfe-05732521630a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c994c0638bdc403bb4c2bf28b6c69d95)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:53.944415 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b5870-e3b8-4535-8dfe-05732521630a admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:54.381056 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-5fb9dd5c-254f-4b0f-8d2b-00b37d0248a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52a5278ab4f74b2a934158f5246ad170'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:54.388723 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-5fb9dd5c-254f-4b0f-8d2b-00b37d0248a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52a5278ab4f74b2a934158f5246ad170'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:54.405924 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1325/2626] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:05:53 2022] DELETE /identity/v3/users/52a5278ab4f74b2a934158f5246ad170 => generated 0 bytes in 838 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:54.410959 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eeca4b-6d4c-4950-8f36-7a407807fb34 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:54.411256 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eeca4b-6d4c-4950-8f36-7a407807fb34 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:54.411538 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eeca4b-6d4c-4950-8f36-7a407807fb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:54.429903 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-93eeca4b-6d4c-4950-8f36-7a407807fb34 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:54.431099 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-93eeca4b-6d4c-4950-8f36-7a407807fb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:54.507314 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-1d4b5870-e3b8-4535-8dfe-05732521630a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c994c0638bdc403bb4c2bf28b6c69d95'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:54.515029 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1326/2627] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:05:54.522340 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eeca4b-6d4c-4950-8f36-7a407807fb34 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:54.523901 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-1d4b5870-e3b8-4535-8dfe-05732521630a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c994c0638bdc403bb4c2bf28b6c69d95'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:54.524031 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-93eeca4b-6d4c-4950-8f36-7a407807fb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:54.524339 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-1d4b5870-e3b8-4535-8dfe-05732521630a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c994c0638bdc403bb4c2bf28b6c69d95'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:54.542114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-1d4b5870-e3b8-4535-8dfe-05732521630a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c994c0638bdc403bb4c2bf28b6c69d95'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:54.598475 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eeca4b-6d4c-4950-8f36-7a407807fb34 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:54.603149 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d36cde-5dab-4707-aa1d-618cb3e88d26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:54.603868 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d36cde-5dab-4707-aa1d-618cb3e88d26 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:54.604153 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d36cde-5dab-4707-aa1d-618cb3e88d26 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:54.604432 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d36cde-5dab-4707-aa1d-618cb3e88d26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:54.611139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-1d4b5870-e3b8-4535-8dfe-05732521630a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c994c0638bdc403bb4c2bf28b6c69d95'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:54.616118 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d36cde-5dab-4707-aa1d-618cb3e88d26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:54.622239 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d36cde-5dab-4707-aa1d-618cb3e88d26 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:54.622385 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1302/2628] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:05:53 2022] DELETE /identity/v3/users/c994c0638bdc403bb4c2bf28b6c69d95 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:54.624118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed9485-c34b-48c9-803c-5c97a58e7347 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:54.624406 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed9485-c34b-48c9-803c-5c97a58e7347 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:54.624680 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed9485-c34b-48c9-803c-5c97a58e7347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:54.629271 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1327/2629] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:05:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:05:54.645181 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-9bed9485-c34b-48c9-803c-5c97a58e7347 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:54.645181 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-9bed9485-c34b-48c9-803c-5c97a58e7347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:54.699271 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:54.714211 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1303/2630] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:05:54.725153 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d36cde-5dab-4707-aa1d-618cb3e88d26 service neutron] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:54.726659 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-64d36cde-5dab-4707-aa1d-618cb3e88d26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:54.738937 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d36cde-5dab-4707-aa1d-618cb3e88d26 service neutron] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:54.792050 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bef0c4-e290-4c96-bf07-bd51b6df08d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:54.792805 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bef0c4-e290-4c96-bf07-bd51b6df08d8 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:54.793092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bef0c4-e290-4c96-bf07-bd51b6df08d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:54.793369 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bef0c4-e290-4c96-bf07-bd51b6df08d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:54.809791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bef0c4-e290-4c96-bf07-bd51b6df08d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:54.809791 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bef0c4-e290-4c96-bf07-bd51b6df08d8 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:54.818091 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1328/2631] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:05:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:05:54.942548 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:55.122546 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed9485-c34b-48c9-803c-5c97a58e7347 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:55.124045 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-9bed9485-c34b-48c9-803c-5c97a58e7347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:55.136857 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed9485-c34b-48c9-803c-5c97a58e7347 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:55.144211 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498f12b-ea50-4966-93ab-51763c047abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:55.145083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498f12b-ea50-4966-93ab-51763c047abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:55.145369 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498f12b-ea50-4966-93ab-51763c047abd admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:55.145755 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498f12b-ea50-4966-93ab-51763c047abd admin admin] PATH_INFO: `/v3/projects/923d32fd0b424969baaa828b8e8ab67e` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:55.146882 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9498f12b-ea50-4966-93ab-51763c047abd admin admin] RBAC: Authorizing `identity:delete_project(project_id=923d32fd0b424969baaa828b8e8ab67e)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:55.148838 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9498f12b-ea50-4966-93ab-51763c047abd admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:55.252135 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bef0c4-e290-4c96-bf07-bd51b6df08d8 service neutron] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:55.253307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-f4bef0c4-e290-4c96-bf07-bd51b6df08d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:55.269380 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bef0c4-e290-4c96-bf07-bd51b6df08d8 service neutron] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:55.276813 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91178ce5-768a-486d-95ac-3447becd74f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:55.278931 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91178ce5-768a-486d-95ac-3447becd74f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:55.278931 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91178ce5-768a-486d-95ac-3447becd74f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:55.278931 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91178ce5-768a-486d-95ac-3447becd74f3 admin admin] PATH_INFO: `/v3/projects/3e975900e60f40338b6ae4f5dd63ee94` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:55.279562 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91178ce5-768a-486d-95ac-3447becd74f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e975900e60f40338b6ae4f5dd63ee94)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:55.281679 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91178ce5-768a-486d-95ac-3447becd74f3 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:55.290995 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-9498f12b-ea50-4966-93ab-51763c047abd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '923d32fd0b424969baaa828b8e8ab67e', 'request_id': 'req-9498f12b-ea50-4966-93ab-51763c047abd'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:55.301403 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-9498f12b-ea50-4966-93ab-51763c047abd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '923d32fd0b424969baaa828b8e8ab67e', 'request_id': 'req-9498f12b-ea50-4966-93ab-51763c047abd'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:55.375016 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-9498f12b-ea50-4966-93ab-51763c047abd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '923d32fd0b424969baaa828b8e8ab67e', 'request_id': 'req-9498f12b-ea50-4966-93ab-51763c047abd'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:55.388696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-9498f12b-ea50-4966-93ab-51763c047abd admin admin] The token cache is being invalidate because project 923d32fd0b424969baaa828b8e8ab67e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:05:55.388982 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-9498f12b-ea50-4966-93ab-51763c047abd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:55.389612 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-9498f12b-ea50-4966-93ab-51763c047abd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:55.391158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1304/2632] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:05:55 2022] DELETE /identity/v3/projects/923d32fd0b424969baaa828b8e8ab67e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:55.393356 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-91178ce5-768a-486d-95ac-3447becd74f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e975900e60f40338b6ae4f5dd63ee94', 'request_id': 'req-91178ce5-768a-486d-95ac-3447becd74f3'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:55.400426 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-91178ce5-768a-486d-95ac-3447becd74f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e975900e60f40338b6ae4f5dd63ee94', 'request_id': 'req-91178ce5-768a-486d-95ac-3447becd74f3'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:55.472486 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-91178ce5-768a-486d-95ac-3447becd74f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e975900e60f40338b6ae4f5dd63ee94', 'request_id': 'req-91178ce5-768a-486d-95ac-3447becd74f3'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:55.484282 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-91178ce5-768a-486d-95ac-3447becd74f3 admin admin] The token cache is being invalidate because project 3e975900e60f40338b6ae4f5dd63ee94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:05:55.485179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-91178ce5-768a-486d-95ac-3447becd74f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:55.485940 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-91178ce5-768a-486d-95ac-3447becd74f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:55.487581 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1329/2633] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:05:55 2022] DELETE /identity/v3/projects/3e975900e60f40338b6ae4f5dd63ee94 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:55.491864 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498f12b-ea50-4966-93ab-51763c047abd admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:55.493432 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-9498f12b-ea50-4966-93ab-51763c047abd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:55.566307 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498f12b-ea50-4966-93ab-51763c047abd admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:55.630551 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf5745-be2c-4551-afda-5061b98ea4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:55.631444 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf5745-be2c-4551-afda-5061b98ea4a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:55.631768 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf5745-be2c-4551-afda-5061b98ea4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:55.632043 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf5745-be2c-4551-afda-5061b98ea4a8 admin admin] PATH_INFO: `/v3/users/f6b7432e022c493b9c1c919b8ed536f5` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:55.633297 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf5745-be2c-4551-afda-5061b98ea4a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6b7432e022c493b9c1c919b8ed536f5)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:55.635303 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf5745-be2c-4551-afda-5061b98ea4a8 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:55.709152 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:55.819927 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-5eaf5745-be2c-4551-afda-5061b98ea4a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6b7432e022c493b9c1c919b8ed536f5'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:55.827087 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-5eaf5745-be2c-4551-afda-5061b98ea4a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6b7432e022c493b9c1c919b8ed536f5'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:55.827804 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-5eaf5745-be2c-4551-afda-5061b98ea4a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6b7432e022c493b9c1c919b8ed536f5'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:55.840186 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-5eaf5745-be2c-4551-afda-5061b98ea4a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6b7432e022c493b9c1c919b8ed536f5'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:55.890540 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-5eaf5745-be2c-4551-afda-5061b98ea4a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6b7432e022c493b9c1c919b8ed536f5'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:55.897386 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1305/2634] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:05:55 2022] DELETE /identity/v3/users/f6b7432e022c493b9c1c919b8ed536f5 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:56.274762 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91178ce5-768a-486d-95ac-3447becd74f3 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:56.277085 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-91178ce5-768a-486d-95ac-3447becd74f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:56.293541 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91178ce5-768a-486d-95ac-3447becd74f3 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:56.355412 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b7d03-4677-40af-beb0-8436641e7257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:56.356324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b7d03-4677-40af-beb0-8436641e7257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:56.356608 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b7d03-4677-40af-beb0-8436641e7257 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:56.356885 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b7d03-4677-40af-beb0-8436641e7257 admin admin] PATH_INFO: `/v3/projects/9c2fa56328cd4096b676cc8a1a366f15` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:56.358061 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b7d03-4677-40af-beb0-8436641e7257 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c2fa56328cd4096b676cc8a1a366f15)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:56.360867 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b7d03-4677-40af-beb0-8436641e7257 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:56.463477 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-ec4b7d03-4677-40af-beb0-8436641e7257 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c2fa56328cd4096b676cc8a1a366f15', 'request_id': 'req-ec4b7d03-4677-40af-beb0-8436641e7257'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:56.472280 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-ec4b7d03-4677-40af-beb0-8436641e7257 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c2fa56328cd4096b676cc8a1a366f15', 'request_id': 'req-ec4b7d03-4677-40af-beb0-8436641e7257'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:56.592276 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-ec4b7d03-4677-40af-beb0-8436641e7257 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c2fa56328cd4096b676cc8a1a366f15', 'request_id': 'req-ec4b7d03-4677-40af-beb0-8436641e7257'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:56.604433 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-ec4b7d03-4677-40af-beb0-8436641e7257 admin admin] The token cache is being invalidate because project 9c2fa56328cd4096b676cc8a1a366f15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:05:56.604717 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-ec4b7d03-4677-40af-beb0-8436641e7257 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:56.605366 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-ec4b7d03-4677-40af-beb0-8436641e7257 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:05:56.606918 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1330/2635] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:05:56 2022] DELETE /identity/v3/projects/9c2fa56328cd4096b676cc8a1a366f15 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:56.612444 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc855e2d-a9d2-40a7-85ab-c637b2ba3bc3 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:56.612952 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc855e2d-a9d2-40a7-85ab-c637b2ba3bc3 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:56.613082 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc855e2d-a9d2-40a7-85ab-c637b2ba3bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:56.630960 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-dc855e2d-a9d2-40a7-85ab-c637b2ba3bc3 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:56.632199 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-dc855e2d-a9d2-40a7-85ab-c637b2ba3bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:56.692890 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1306/2636] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:05:56.700760 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb13d20-c080-4af8-9b78-6ff0915252cc None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:56.705855 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb13d20-c080-4af8-9b78-6ff0915252cc None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:56.705855 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb13d20-c080-4af8-9b78-6ff0915252cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:56.720996 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-ceb13d20-c080-4af8-9b78-6ff0915252cc None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:56.722205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-ceb13d20-c080-4af8-9b78-6ff0915252cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:56.730500 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1331/2637] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:05:56.734913 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc855e2d-a9d2-40a7-85ab-c637b2ba3bc3 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:56.745510 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc855e2d-a9d2-40a7-85ab-c637b2ba3bc3 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:56.750198 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c587785-ea94-4339-91e6-7b53c6f32449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:56.750857 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c587785-ea94-4339-91e6-7b53c6f32449 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:56.751118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c587785-ea94-4339-91e6-7b53c6f32449 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:56.751394 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c587785-ea94-4339-91e6-7b53c6f32449 admin admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:56.752160 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c587785-ea94-4339-91e6-7b53c6f32449 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:05:56.752475 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c587785-ea94-4339-91e6-7b53c6f32449 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:56.754079 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c587785-ea94-4339-91e6-7b53c6f32449 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:56.766637 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1307/2638] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 16:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:05:56.770997 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb13d20-c080-4af8-9b78-6ff0915252cc None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:56.775513 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:56.780767 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb13d20-c080-4af8-9b78-6ff0915252cc None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:56.786125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903985ab-eeaf-46af-b530-7efb8656b307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:56.786776 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903985ab-eeaf-46af-b530-7efb8656b307 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:56.787056 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903985ab-eeaf-46af-b530-7efb8656b307 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:56.787332 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903985ab-eeaf-46af-b530-7efb8656b307 admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:56.788060 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903985ab-eeaf-46af-b530-7efb8656b307 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:56.789944 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903985ab-eeaf-46af-b530-7efb8656b307 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:56.953039 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1332/2639] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:05:56 2022] POST /identity/v3/projects => generated 379 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:05:56.957809 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c587785-ea94-4339-91e6-7b53c6f32449 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:56.967986 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c587785-ea94-4339-91e6-7b53c6f32449 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:57.025572 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45668dfd-2754-42ed-ad17-1b2b8e008610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:57.026239 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45668dfd-2754-42ed-ad17-1b2b8e008610 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:57.026602 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45668dfd-2754-42ed-ad17-1b2b8e008610 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:57.026889 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45668dfd-2754-42ed-ad17-1b2b8e008610 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:57.027567 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45668dfd-2754-42ed-ad17-1b2b8e008610 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:57.029566 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45668dfd-2754-42ed-ad17-1b2b8e008610 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:57.114473 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1308/2640] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:05:56 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:05:57.118481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903985ab-eeaf-46af-b530-7efb8656b307 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:57.129820 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903985ab-eeaf-46af-b530-7efb8656b307 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:57.134718 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3293ae-90a9-4ba8-bb6b-367c9128b640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:57.135387 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3293ae-90a9-4ba8-bb6b-367c9128b640 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:57.135699 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3293ae-90a9-4ba8-bb6b-367c9128b640 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:57.135988 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3293ae-90a9-4ba8-bb6b-367c9128b640 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:57.136720 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3293ae-90a9-4ba8-bb6b-367c9128b640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:57.138317 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3293ae-90a9-4ba8-bb6b-367c9128b640 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:57.149270 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1333/2641] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:05:57.156015 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45668dfd-2754-42ed-ad17-1b2b8e008610 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:57.167285 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45668dfd-2754-42ed-ad17-1b2b8e008610 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:57.172821 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04919f88-bb3c-4bcc-b362-ca46e64696f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:57.173751 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04919f88-bb3c-4bcc-b362-ca46e64696f0 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:57.174032 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04919f88-bb3c-4bcc-b362-ca46e64696f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:57.174307 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04919f88-bb3c-4bcc-b362-ca46e64696f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:57.175048 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04919f88-bb3c-4bcc-b362-ca46e64696f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:57.176775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04919f88-bb3c-4bcc-b362-ca46e64696f0 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:57.187126 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1309/2642] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:05:57.191696 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3293ae-90a9-4ba8-bb6b-367c9128b640 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:57.201913 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3293ae-90a9-4ba8-bb6b-367c9128b640 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:57.206660 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80513ce-d1dd-473f-9d87-5bd0c3d92c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:57.209763 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80513ce-d1dd-473f-9d87-5bd0c3d92c53 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:57.209763 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80513ce-d1dd-473f-9d87-5bd0c3d92c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:57.209763 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80513ce-d1dd-473f-9d87-5bd0c3d92c53 admin admin] PATH_INFO: `/v3/projects/d9d8de5526f14500b2b6ec39598f76e3/users/fbfd970183484d8d8a4276894f2b2993/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:57.223178 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80513ce-d1dd-473f-9d87-5bd0c3d92c53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9d8de5526f14500b2b6ec39598f76e3, user_id=fbfd970183484d8d8a4276894f2b2993, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:57.225862 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80513ce-d1dd-473f-9d87-5bd0c3d92c53 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:57.279641 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1334/2643] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:05:57 2022] PUT /identity/v3/projects/d9d8de5526f14500b2b6ec39598f76e3/users/fbfd970183484d8d8a4276894f2b2993/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:57.290634 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1a16c-5ea1-4f57-8e5a-cb3dbc21c7e4 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:57.290920 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1a16c-5ea1-4f57-8e5a-cb3dbc21c7e4 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:57.291199 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1a16c-5ea1-4f57-8e5a-cb3dbc21c7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:57.310993 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:57.321004 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-2cd1a16c-5ea1-4f57-8e5a-cb3dbc21c7e4 None None] MFA Rules not processed for user `fbfd970183484d8d8a4276894f2b2993`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:57.322220 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-2cd1a16c-5ea1-4f57-8e5a-cb3dbc21c7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:57.388056 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1310/2644] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:05:57.392908 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80513ce-d1dd-473f-9d87-5bd0c3d92c53 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:57.457276 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80513ce-d1dd-473f-9d87-5bd0c3d92c53 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:57.462089 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670cc37-3d05-4c67-a64a-7fc3238a0b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:57.462754 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670cc37-3d05-4c67-a64a-7fc3238a0b51 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:57.463044 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670cc37-3d05-4c67-a64a-7fc3238a0b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:57.463329 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670cc37-3d05-4c67-a64a-7fc3238a0b51 admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:57.464064 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670cc37-3d05-4c67-a64a-7fc3238a0b51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:57.465978 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670cc37-3d05-4c67-a64a-7fc3238a0b51 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:57.587824 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1335/2645] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:05:57 2022] POST /identity/v3/projects => generated 379 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:05:57.588964 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1a16c-5ea1-4f57-8e5a-cb3dbc21c7e4 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:57.600860 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1a16c-5ea1-4f57-8e5a-cb3dbc21c7e4 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:57.659312 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cdf87d-f94c-44e4-8f73-cbbab93c9171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:57.660428 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdf87d-f94c-44e4-8f73-cbbab93c9171 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:57.660851 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdf87d-f94c-44e4-8f73-cbbab93c9171 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:57.661323 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdf87d-f94c-44e4-8f73-cbbab93c9171 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:57.662104 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cdf87d-f94c-44e4-8f73-cbbab93c9171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:57.664694 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cdf87d-f94c-44e4-8f73-cbbab93c9171 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:57.771386 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1311/2646] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:05:57 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:05:57.775321 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670cc37-3d05-4c67-a64a-7fc3238a0b51 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:57.787020 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670cc37-3d05-4c67-a64a-7fc3238a0b51 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:57.791744 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d49b9-bbe3-42c2-a671-231cca937417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:57.792404 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d49b9-bbe3-42c2-a671-231cca937417 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:57.792690 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d49b9-bbe3-42c2-a671-231cca937417 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:57.792971 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d49b9-bbe3-42c2-a671-231cca937417 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:57.793703 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d49b9-bbe3-42c2-a671-231cca937417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:57.795303 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d49b9-bbe3-42c2-a671-231cca937417 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:57.806374 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1336/2647] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:05:57.810188 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cdf87d-f94c-44e4-8f73-cbbab93c9171 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:57.820938 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cdf87d-f94c-44e4-8f73-cbbab93c9171 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:57.825403 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0800d0-d209-4fc2-a7c4-8f15617cdaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:57.826044 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0800d0-d209-4fc2-a7c4-8f15617cdaeb admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:57.826324 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0800d0-d209-4fc2-a7c4-8f15617cdaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:57.826598 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0800d0-d209-4fc2-a7c4-8f15617cdaeb admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:57.827315 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0800d0-d209-4fc2-a7c4-8f15617cdaeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:57.829698 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0800d0-d209-4fc2-a7c4-8f15617cdaeb admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:57.839382 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1312/2648] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:05:57.843329 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d49b9-bbe3-42c2-a671-231cca937417 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:57.853285 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d49b9-bbe3-42c2-a671-231cca937417 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:57.857914 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfbcdd-43a4-4e02-b318-b91c72d4f39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:57.858805 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfbcdd-43a4-4e02-b318-b91c72d4f39a admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:57.859064 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfbcdd-43a4-4e02-b318-b91c72d4f39a admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:57.859338 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfbcdd-43a4-4e02-b318-b91c72d4f39a admin admin] PATH_INFO: `/v3/projects/160fb628ee804e1691e41516ed11cdc7/users/15045a0a4dc9424a96c0da5db245a7f1/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:57.874070 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abfbcdd-43a4-4e02-b318-b91c72d4f39a admin admin] RBAC: Authorizing `identity:create_grant(project_id=160fb628ee804e1691e41516ed11cdc7, user_id=15045a0a4dc9424a96c0da5db245a7f1, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:57.877303 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abfbcdd-43a4-4e02-b318-b91c72d4f39a admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:58.009458 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1337/2649] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:05:57 2022] PUT /identity/v3/projects/160fb628ee804e1691e41516ed11cdc7/users/15045a0a4dc9424a96c0da5db245a7f1/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:05:58.020709 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6e4d4-4197-4d10-9ac6-3ba72f8ba2fe None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:58.035490 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6e4d4-4197-4d10-9ac6-3ba72f8ba2fe None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:58.035490 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6e4d4-4197-4d10-9ac6-3ba72f8ba2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:58.051634 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-28f6e4d4-4197-4d10-9ac6-3ba72f8ba2fe None None] MFA Rules not processed for user `15045a0a4dc9424a96c0da5db245a7f1`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:58.052901 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-28f6e4d4-4197-4d10-9ac6-3ba72f8ba2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:58.122730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1313/2650] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:05:58.127341 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfbcdd-43a4-4e02-b318-b91c72d4f39a admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:58.187167 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:58.192814 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfbcdd-43a4-4e02-b318-b91c72d4f39a admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:58.197523 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d077a2f-72c0-42d0-8a72-36644b4e7ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:58.204109 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d077a2f-72c0-42d0-8a72-36644b4e7ccf admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:58.204109 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d077a2f-72c0-42d0-8a72-36644b4e7ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:58.204109 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d077a2f-72c0-42d0-8a72-36644b4e7ccf admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:58.204109 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d077a2f-72c0-42d0-8a72-36644b4e7ccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:58.204109 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d077a2f-72c0-42d0-8a72-36644b4e7ccf admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:58.275006 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1338/2651] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:05:58 2022] POST /identity/v3/projects => generated 379 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:05:58.279060 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6e4d4-4197-4d10-9ac6-3ba72f8ba2fe None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:58.290481 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6e4d4-4197-4d10-9ac6-3ba72f8ba2fe None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:58.293959 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:58.347885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82073848-f6d0-44e9-a086-808d1a77c99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:58.348610 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82073848-f6d0-44e9-a086-808d1a77c99e admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:58.348894 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82073848-f6d0-44e9-a086-808d1a77c99e admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:58.349169 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82073848-f6d0-44e9-a086-808d1a77c99e admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:58.349849 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82073848-f6d0-44e9-a086-808d1a77c99e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:58.351907 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82073848-f6d0-44e9-a086-808d1a77c99e admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:58.422599 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1314/2652] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:05:58 2022] POST /identity/v3/users => generated 296 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:05:58.426399 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d077a2f-72c0-42d0-8a72-36644b4e7ccf admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:58.436946 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d077a2f-72c0-42d0-8a72-36644b4e7ccf admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:58.441955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98051c46-83bf-4329-857e-14df37586a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:58.442621 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98051c46-83bf-4329-857e-14df37586a7c admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:58.442977 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98051c46-83bf-4329-857e-14df37586a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:58.443478 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98051c46-83bf-4329-857e-14df37586a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:58.444169 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98051c46-83bf-4329-857e-14df37586a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:58.445788 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98051c46-83bf-4329-857e-14df37586a7c admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:58.458269 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1339/2653] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:05:58.466042 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82073848-f6d0-44e9-a086-808d1a77c99e admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:58.474202 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82073848-f6d0-44e9-a086-808d1a77c99e admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:58.478819 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d28c9e-8774-4c8a-bee9-a82312e1e437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:58.479713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d28c9e-8774-4c8a-bee9-a82312e1e437 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:58.480000 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d28c9e-8774-4c8a-bee9-a82312e1e437 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:58.480275 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d28c9e-8774-4c8a-bee9-a82312e1e437 admin admin] PATH_INFO: `/v3/projects/94611e16e5af415cacdb15b899accbef/users/f411c5b84e3042b2a955da1c14a20600/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:58.494935 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d28c9e-8774-4c8a-bee9-a82312e1e437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94611e16e5af415cacdb15b899accbef, user_id=f411c5b84e3042b2a955da1c14a20600, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:58.497617 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d28c9e-8774-4c8a-bee9-a82312e1e437 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:58.588615 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1315/2654] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:05:58 2022] PUT /identity/v3/projects/94611e16e5af415cacdb15b899accbef/users/f411c5b84e3042b2a955da1c14a20600/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:05:58.592516 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98051c46-83bf-4329-857e-14df37586a7c admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:58.602868 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98051c46-83bf-4329-857e-14df37586a7c admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:58.665005 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a65c2-66df-4c01-b5a4-cadf98ada02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:58.665956 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a65c2-66df-4c01-b5a4-cadf98ada02d admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:58.666476 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a65c2-66df-4c01-b5a4-cadf98ada02d admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:58.666963 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a65c2-66df-4c01-b5a4-cadf98ada02d admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:58.667816 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a65c2-66df-4c01-b5a4-cadf98ada02d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:58.669642 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a65c2-66df-4c01-b5a4-cadf98ada02d admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:58.683439 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1340/2655] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:05:58.684637 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d28c9e-8774-4c8a-bee9-a82312e1e437 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:58.699367 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d28c9e-8774-4c8a-bee9-a82312e1e437 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:58.704752 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30f70e-87b2-4fe0-99b2-1628c813fb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:58.706909 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30f70e-87b2-4fe0-99b2-1628c813fb44 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:58.706909 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30f70e-87b2-4fe0-99b2-1628c813fb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:58.706909 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30f70e-87b2-4fe0-99b2-1628c813fb44 admin admin] PATH_INFO: `/v3/projects/94611e16e5af415cacdb15b899accbef/users/f411c5b84e3042b2a955da1c14a20600/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:58.708821 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30f70e-87b2-4fe0-99b2-1628c813fb44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94611e16e5af415cacdb15b899accbef, user_id=f411c5b84e3042b2a955da1c14a20600, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:58.711799 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30f70e-87b2-4fe0-99b2-1628c813fb44 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:58.723069 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1316/2656] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:05:58 2022] PUT /identity/v3/projects/94611e16e5af415cacdb15b899accbef/users/f411c5b84e3042b2a955da1c14a20600/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:05:58.733600 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20a9ad-91ad-4666-86e1-2678394c9fff None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:58.733896 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20a9ad-91ad-4666-86e1-2678394c9fff None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:58.734184 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20a9ad-91ad-4666-86e1-2678394c9fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:58.772219 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-ce20a9ad-91ad-4666-86e1-2678394c9fff None None] MFA Rules not processed for user `f411c5b84e3042b2a955da1c14a20600`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:05:58.773432 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-ce20a9ad-91ad-4666-86e1-2678394c9fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:58.846828 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1341/2657] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:05:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:05:58.859922 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30f70e-87b2-4fe0-99b2-1628c813fb44 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:58.869650 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-df30f70e-87b2-4fe0-99b2-1628c813fb44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:58.932090 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30f70e-87b2-4fe0-99b2-1628c813fb44 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:58.935871 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32d4dc-4eab-4ae2-a9a9-e85771460693 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:58.936508 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32d4dc-4eab-4ae2-a9a9-e85771460693 service cinder] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:58.936788 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32d4dc-4eab-4ae2-a9a9-e85771460693 service cinder] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:58.937063 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32d4dc-4eab-4ae2-a9a9-e85771460693 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:58.946922 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32d4dc-4eab-4ae2-a9a9-e85771460693 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:58.948384 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32d4dc-4eab-4ae2-a9a9-e85771460693 service cinder] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:58.957819 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1317/2658] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:05:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:05:59.089813 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20a9ad-91ad-4666-86e1-2678394c9fff None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:05:59.091236 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-ce20a9ad-91ad-4666-86e1-2678394c9fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:05:59.103958 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20a9ad-91ad-4666-86e1-2678394c9fff None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:05:59.110383 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d891d8-14a0-431d-8fa5-809e5ad1dffa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:05:59.110383 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d891d8-14a0-431d-8fa5-809e5ad1dffa service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:05:59.110383 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d891d8-14a0-431d-8fa5-809e5ad1dffa service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:05:59.110383 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d891d8-14a0-431d-8fa5-809e5ad1dffa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:05:59.156999 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:05:59.166368 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d891d8-14a0-431d-8fa5-809e5ad1dffa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:05:59.167840 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d891d8-14a0-431d-8fa5-809e5ad1dffa service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:05:59.177419 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1342/2659] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:05:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:06:03.367794 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32d4dc-4eab-4ae2-a9a9-e85771460693 service cinder] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:03.431848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32d4dc-4eab-4ae2-a9a9-e85771460693 service cinder] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:03.436326 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13371705-8b3f-435b-b0d4-6bd020761582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:03.437188 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13371705-8b3f-435b-b0d4-6bd020761582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:03.437466 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13371705-8b3f-435b-b0d4-6bd020761582 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:03.438266 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13371705-8b3f-435b-b0d4-6bd020761582 admin admin] PATH_INFO: `/v3/users/fbfd970183484d8d8a4276894f2b2993` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:03.439455 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13371705-8b3f-435b-b0d4-6bd020761582 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbfd970183484d8d8a4276894f2b2993)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:03.441411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13371705-8b3f-435b-b0d4-6bd020761582 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:03.444003 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:06:03.691808 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-13371705-8b3f-435b-b0d4-6bd020761582 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbfd970183484d8d8a4276894f2b2993'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:03.698671 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-13371705-8b3f-435b-b0d4-6bd020761582 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbfd970183484d8d8a4276894f2b2993'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:03.699348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-13371705-8b3f-435b-b0d4-6bd020761582 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbfd970183484d8d8a4276894f2b2993'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:03.712381 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-13371705-8b3f-435b-b0d4-6bd020761582 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbfd970183484d8d8a4276894f2b2993'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:03.797915 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-13371705-8b3f-435b-b0d4-6bd020761582 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbfd970183484d8d8a4276894f2b2993'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:03.804308 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1318/2660] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:06:03 2022] DELETE /identity/v3/users/fbfd970183484d8d8a4276894f2b2993 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:06:03.808816 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8d9a0-64d2-4541-a8b0-6f572f43ee84 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:03.809341 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8d9a0-64d2-4541-a8b0-6f572f43ee84 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:03.809441 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8d9a0-64d2-4541-a8b0-6f572f43ee84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:03.826725 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-6bd8d9a0-64d2-4541-a8b0-6f572f43ee84 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:06:03.827948 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-6bd8d9a0-64d2-4541-a8b0-6f572f43ee84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:03.889880 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1343/2661] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:06:03.899413 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13371705-8b3f-435b-b0d4-6bd020761582 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:03.900937 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-13371705-8b3f-435b-b0d4-6bd020761582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:03.960452 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13371705-8b3f-435b-b0d4-6bd020761582 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:03.964143 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931021b-90b1-445d-a1f2-4d6085297174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:03.964781 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931021b-90b1-445d-a1f2-4d6085297174 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:03.965066 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931021b-90b1-445d-a1f2-4d6085297174 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:03.965343 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931021b-90b1-445d-a1f2-4d6085297174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:03.974609 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931021b-90b1-445d-a1f2-4d6085297174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:03.976152 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931021b-90b1-445d-a1f2-4d6085297174 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:03.987037 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1319/2662] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:06:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:06:04.367014 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8d9a0-64d2-4541-a8b0-6f572f43ee84 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:04.368462 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-6bd8d9a0-64d2-4541-a8b0-6f572f43ee84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:04.382289 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8d9a0-64d2-4541-a8b0-6f572f43ee84 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:04.386938 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acdb55-6bd0-4e2d-9197-06305fbe3b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:04.388580 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acdb55-6bd0-4e2d-9197-06305fbe3b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:04.388871 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acdb55-6bd0-4e2d-9197-06305fbe3b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:04.389155 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acdb55-6bd0-4e2d-9197-06305fbe3b40 admin admin] PATH_INFO: `/v3/projects/d9d8de5526f14500b2b6ec39598f76e3` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:04.390351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3acdb55-6bd0-4e2d-9197-06305fbe3b40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9d8de5526f14500b2b6ec39598f76e3)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:04.392419 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3acdb55-6bd0-4e2d-9197-06305fbe3b40 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:04.524620 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-c3acdb55-6bd0-4e2d-9197-06305fbe3b40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9d8de5526f14500b2b6ec39598f76e3', 'request_id': 'req-c3acdb55-6bd0-4e2d-9197-06305fbe3b40'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:04.530999 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-c3acdb55-6bd0-4e2d-9197-06305fbe3b40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9d8de5526f14500b2b6ec39598f76e3', 'request_id': 'req-c3acdb55-6bd0-4e2d-9197-06305fbe3b40'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:04.689789 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-c3acdb55-6bd0-4e2d-9197-06305fbe3b40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9d8de5526f14500b2b6ec39598f76e3', 'request_id': 'req-c3acdb55-6bd0-4e2d-9197-06305fbe3b40'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:04.701323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-c3acdb55-6bd0-4e2d-9197-06305fbe3b40 admin admin] The token cache is being invalidate because project d9d8de5526f14500b2b6ec39598f76e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:06:04.701615 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-c3acdb55-6bd0-4e2d-9197-06305fbe3b40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:04.702247 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-c3acdb55-6bd0-4e2d-9197-06305fbe3b40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:04.703899 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1344/2663] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:06:04 2022] DELETE /identity/v3/projects/d9d8de5526f14500b2b6ec39598f76e3 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:06:04.708031 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931021b-90b1-445d-a1f2-4d6085297174 service neutron] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:04.717825 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931021b-90b1-445d-a1f2-4d6085297174 service neutron] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:04.773334 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32047505-9a9b-4167-8b77-2fb34fc29fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:04.774195 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32047505-9a9b-4167-8b77-2fb34fc29fee admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:04.774476 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32047505-9a9b-4167-8b77-2fb34fc29fee admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:04.774747 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32047505-9a9b-4167-8b77-2fb34fc29fee admin admin] PATH_INFO: `/v3/users/15045a0a4dc9424a96c0da5db245a7f1` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:04.775934 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32047505-9a9b-4167-8b77-2fb34fc29fee admin admin] RBAC: Authorizing `identity:delete_user(user_id=15045a0a4dc9424a96c0da5db245a7f1)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:04.777841 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32047505-9a9b-4167-8b77-2fb34fc29fee admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:04.844385 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381511c1-f041-4504-aabc-8792785ce7b5 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:04.844879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381511c1-f041-4504-aabc-8792785ce7b5 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:04.844989 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381511c1-f041-4504-aabc-8792785ce7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:04.863317 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-381511c1-f041-4504-aabc-8792785ce7b5 None None] MFA Rules not processed for user `048fc48dd55a43f7b342533a9484c3ad`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:06:04.864540 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-381511c1-f041-4504-aabc-8792785ce7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:04.901677 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:06:04.923095 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1345/2664] 10.222.0.39 () {58 vars in 1009 bytes} [Mon May 23 16:06:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:06:04.935064 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381511c1-f041-4504-aabc-8792785ce7b5 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:04.936399 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-381511c1-f041-4504-aabc-8792785ce7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:04.956885 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:06:05.007656 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381511c1-f041-4504-aabc-8792785ce7b5 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:05.011084 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-32047505-9a9b-4167-8b77-2fb34fc29fee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15045a0a4dc9424a96c0da5db245a7f1'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:05.014015 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1cb9c-c75a-4053-a832-24d6a9f5b262 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b275a110936a44ce8d54793af1a34808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:05.019753 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1cb9c-c75a-4053-a832-24d6a9f5b262 service swift] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:05.019753 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1cb9c-c75a-4053-a832-24d6a9f5b262 service swift] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:05.019753 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1cb9c-c75a-4053-a832-24d6a9f5b262 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:05.020051 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-32047505-9a9b-4167-8b77-2fb34fc29fee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15045a0a4dc9424a96c0da5db245a7f1'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:05.020051 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-32047505-9a9b-4167-8b77-2fb34fc29fee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15045a0a4dc9424a96c0da5db245a7f1'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:05.023714 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1cb9c-c75a-4053-a832-24d6a9f5b262 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:05.025303 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1cb9c-c75a-4053-a832-24d6a9f5b262 service swift] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:05.030691 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-32047505-9a9b-4167-8b77-2fb34fc29fee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15045a0a4dc9424a96c0da5db245a7f1'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:05.034215 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1346/2665] 10.222.0.39 () {60 vars in 1384 bytes} [Mon May 23 16:06:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 23 16:06:05.124687 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-32047505-9a9b-4167-8b77-2fb34fc29fee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15045a0a4dc9424a96c0da5db245a7f1'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:05.131258 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1320/2666] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:06:04 2022] DELETE /identity/v3/users/15045a0a4dc9424a96c0da5db245a7f1 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:06:05.606015 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1cb9c-c75a-4053-a832-24d6a9f5b262 service swift] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:05.613940 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-53f1cb9c-c75a-4053-a832-24d6a9f5b262 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:05.623653 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1cb9c-c75a-4053-a832-24d6a9f5b262 service swift] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:05.700253 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f45f4-f195-4cca-bcab-f90aef5af31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:05.700253 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f45f4-f195-4cca-bcab-f90aef5af31d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:05.700253 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f45f4-f195-4cca-bcab-f90aef5af31d admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:05.708077 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f45f4-f195-4cca-bcab-f90aef5af31d admin admin] PATH_INFO: `/v3/projects/160fb628ee804e1691e41516ed11cdc7` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:05.708077 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f45f4-f195-4cca-bcab-f90aef5af31d admin admin] RBAC: Authorizing `identity:delete_project(project_id=160fb628ee804e1691e41516ed11cdc7)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:05.708077 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f45f4-f195-4cca-bcab-f90aef5af31d admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:05.789118 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-f83f45f4-f195-4cca-bcab-f90aef5af31d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '160fb628ee804e1691e41516ed11cdc7', 'request_id': 'req-f83f45f4-f195-4cca-bcab-f90aef5af31d'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:05.795544 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-f83f45f4-f195-4cca-bcab-f90aef5af31d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '160fb628ee804e1691e41516ed11cdc7', 'request_id': 'req-f83f45f4-f195-4cca-bcab-f90aef5af31d'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:05.862064 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-f83f45f4-f195-4cca-bcab-f90aef5af31d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '160fb628ee804e1691e41516ed11cdc7', 'request_id': 'req-f83f45f4-f195-4cca-bcab-f90aef5af31d'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:05.873618 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-f83f45f4-f195-4cca-bcab-f90aef5af31d admin admin] The token cache is being invalidate because project 160fb628ee804e1691e41516ed11cdc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:06:05.873910 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-f83f45f4-f195-4cca-bcab-f90aef5af31d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:05.874553 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-f83f45f4-f195-4cca-bcab-f90aef5af31d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:05.876830 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1347/2667] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:06:05 2022] DELETE /identity/v3/projects/160fb628ee804e1691e41516ed11cdc7 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:06:05.880807 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32047505-9a9b-4167-8b77-2fb34fc29fee admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:05.882254 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-32047505-9a9b-4167-8b77-2fb34fc29fee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:05.895463 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32047505-9a9b-4167-8b77-2fb34fc29fee admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:05.954956 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad0833-9a1c-4c28-b070-dff30965fbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:05.955925 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad0833-9a1c-4c28-b070-dff30965fbd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:05.956206 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad0833-9a1c-4c28-b070-dff30965fbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:05.956478 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad0833-9a1c-4c28-b070-dff30965fbd1 admin admin] PATH_INFO: `/v3/users/f411c5b84e3042b2a955da1c14a20600` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:05.957732 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad0833-9a1c-4c28-b070-dff30965fbd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f411c5b84e3042b2a955da1c14a20600)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:05.959730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad0833-9a1c-4c28-b070-dff30965fbd1 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:06.023750 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3066eb-ee6c-4adc-80b2-c66879cefa89 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:06.024040 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3066eb-ee6c-4adc-80b2-c66879cefa89 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:06.024401 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3066eb-ee6c-4adc-80b2-c66879cefa89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:06.042972 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-6a3066eb-ee6c-4adc-80b2-c66879cefa89 None None] MFA Rules not processed for user `048fc48dd55a43f7b342533a9484c3ad`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:06:06.044200 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-6a3066eb-ee6c-4adc-80b2-c66879cefa89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:06.078908 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:06:06.102051 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1348/2668] 10.222.0.39 () {58 vars in 967 bytes} [Mon May 23 16:06:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:06:06.115078 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3066eb-ee6c-4adc-80b2-c66879cefa89 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:06.116209 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-6a3066eb-ee6c-4adc-80b2-c66879cefa89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:06.121510 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-31ad0833-9a1c-4c28-b070-dff30965fbd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f411c5b84e3042b2a955da1c14a20600'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:06.129160 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-31ad0833-9a1c-4c28-b070-dff30965fbd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f411c5b84e3042b2a955da1c14a20600'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:06.129833 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-31ad0833-9a1c-4c28-b070-dff30965fbd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f411c5b84e3042b2a955da1c14a20600'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:06.143369 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-31ad0833-9a1c-4c28-b070-dff30965fbd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f411c5b84e3042b2a955da1c14a20600'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:06.189897 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3066eb-ee6c-4adc-80b2-c66879cefa89 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:06.195490 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d624448-c448-4619-85ff-02db4b4d3bac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b275a110936a44ce8d54793af1a34808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:06.196186 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d624448-c448-4619-85ff-02db4b4d3bac service swift] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:06.196482 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d624448-c448-4619-85ff-02db4b4d3bac service swift] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:06.196756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d624448-c448-4619-85ff-02db4b4d3bac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:06.206759 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d624448-c448-4619-85ff-02db4b4d3bac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:06.208450 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d624448-c448-4619-85ff-02db4b4d3bac service swift] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:06.216778 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1349/2669] 10.222.0.39 () {60 vars in 1384 bytes} [Mon May 23 16:06:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 16:06:06.233365 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-31ad0833-9a1c-4c28-b070-dff30965fbd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f411c5b84e3042b2a955da1c14a20600'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:06.242035 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1321/2670] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:06:05 2022] DELETE /identity/v3/users/f411c5b84e3042b2a955da1c14a20600 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:06:06.715375 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d624448-c448-4619-85ff-02db4b4d3bac service swift] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:06.716964 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-4d624448-c448-4619-85ff-02db4b4d3bac service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:06.733697 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d624448-c448-4619-85ff-02db4b4d3bac service swift] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:06.806869 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bb396-7357-47ca-a78e-68078f679216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:06.807788 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bb396-7357-47ca-a78e-68078f679216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:06.808073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bb396-7357-47ca-a78e-68078f679216 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:06.808351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bb396-7357-47ca-a78e-68078f679216 admin admin] PATH_INFO: `/v3/projects/94611e16e5af415cacdb15b899accbef` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:06.809615 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5bb396-7357-47ca-a78e-68078f679216 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94611e16e5af415cacdb15b899accbef)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:06.811537 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5bb396-7357-47ca-a78e-68078f679216 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:06.917476 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319b451-d891-4880-b50f-735014b85ced None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:06.917971 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319b451-d891-4880-b50f-735014b85ced None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:06.918066 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319b451-d891-4880-b50f-735014b85ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:06.936280 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-7319b451-d891-4880-b50f-735014b85ced None None] MFA Rules not processed for user `048fc48dd55a43f7b342533a9484c3ad`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:06:06.938418 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-7319b451-d891-4880-b50f-735014b85ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:06.944354 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-fb5bb396-7357-47ca-a78e-68078f679216 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94611e16e5af415cacdb15b899accbef', 'request_id': 'req-fb5bb396-7357-47ca-a78e-68078f679216'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:06.950659 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-fb5bb396-7357-47ca-a78e-68078f679216 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94611e16e5af415cacdb15b899accbef', 'request_id': 'req-fb5bb396-7357-47ca-a78e-68078f679216'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:06.956493 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:06:06.994102 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1322/2671] 10.222.0.39 () {58 vars in 1009 bytes} [Mon May 23 16:06:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:06:07.006132 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319b451-d891-4880-b50f-735014b85ced None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:07.007557 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-7319b451-d891-4880-b50f-735014b85ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:07.014587 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-fb5bb396-7357-47ca-a78e-68078f679216 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94611e16e5af415cacdb15b899accbef', 'request_id': 'req-fb5bb396-7357-47ca-a78e-68078f679216'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:07.026437 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-fb5bb396-7357-47ca-a78e-68078f679216 admin admin] The token cache is being invalidate because project 94611e16e5af415cacdb15b899accbef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:06:07.026726 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-fb5bb396-7357-47ca-a78e-68078f679216 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:07.027348 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-fb5bb396-7357-47ca-a78e-68078f679216 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:07.029902 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1350/2672] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:06:06 2022] DELETE /identity/v3/projects/94611e16e5af415cacdb15b899accbef => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:06:07.035510 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6371fb-3933-45d2-a92b-1e9aea04c823 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:07.035851 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6371fb-3933-45d2-a92b-1e9aea04c823 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:07.036177 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6371fb-3933-45d2-a92b-1e9aea04c823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:07.042370 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:06:07.055133 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-3f6371fb-3933-45d2-a92b-1e9aea04c823 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:06:07.058646 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-3f6371fb-3933-45d2-a92b-1e9aea04c823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:07.080779 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319b451-d891-4880-b50f-735014b85ced None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:07.086071 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744a22c-6dcf-4c4a-8300-c710caaeae66 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b275a110936a44ce8d54793af1a34808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:07.086716 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744a22c-6dcf-4c4a-8300-c710caaeae66 service swift] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:07.087386 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744a22c-6dcf-4c4a-8300-c710caaeae66 service swift] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:07.087386 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744a22c-6dcf-4c4a-8300-c710caaeae66 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:07.089070 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-f744a22c-6dcf-4c4a-8300-c710caaeae66 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:07.100922 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f744a22c-6dcf-4c4a-8300-c710caaeae66 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:07.102514 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f744a22c-6dcf-4c4a-8300-c710caaeae66 service swift] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:07.111224 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1323/2673] 10.222.0.39 () {60 vars in 1384 bytes} [Mon May 23 16:06:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 23 16:06:07.123021 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1351/2674] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:06:07.126403 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01421254-05a6-4bbd-bc67-1e19f4ec208f None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:07.126728 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01421254-05a6-4bbd-bc67-1e19f4ec208f None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:07.127007 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01421254-05a6-4bbd-bc67-1e19f4ec208f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:07.146027 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-01421254-05a6-4bbd-bc67-1e19f4ec208f None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:06:07.147228 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-01421254-05a6-4bbd-bc67-1e19f4ec208f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:07.155043 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1324/2675] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:06:07.159871 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6371fb-3933-45d2-a92b-1e9aea04c823 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:07.169608 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6371fb-3933-45d2-a92b-1e9aea04c823 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:07.174563 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805e587-9295-4915-88a4-1806d52c3130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:07.175276 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805e587-9295-4915-88a4-1806d52c3130 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:07.175559 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805e587-9295-4915-88a4-1806d52c3130 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:07.175870 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805e587-9295-4915-88a4-1806d52c3130 admin admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:07.176589 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805e587-9295-4915-88a4-1806d52c3130 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:06:07.177001 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805e587-9295-4915-88a4-1806d52c3130 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:07.178593 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805e587-9295-4915-88a4-1806d52c3130 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:07.191353 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1352/2676] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 16:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:06:07.195936 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01421254-05a6-4bbd-bc67-1e19f4ec208f None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:07.206173 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01421254-05a6-4bbd-bc67-1e19f4ec208f None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:07.210977 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a13ffc-a32b-4a40-912b-e14a4cea359d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:07.211652 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a13ffc-a32b-4a40-912b-e14a4cea359d admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:07.211942 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a13ffc-a32b-4a40-912b-e14a4cea359d admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:07.212220 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a13ffc-a32b-4a40-912b-e14a4cea359d admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:07.212905 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a13ffc-a32b-4a40-912b-e14a4cea359d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:07.214952 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a13ffc-a32b-4a40-912b-e14a4cea359d admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:07.297928 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1325/2677] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:06:07 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:06:07.302168 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805e587-9295-4915-88a4-1806d52c3130 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:07.312077 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805e587-9295-4915-88a4-1806d52c3130 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:07.371452 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da16967-d9e8-4cca-9f92-0a555bf6b3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:07.372149 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da16967-d9e8-4cca-9f92-0a555bf6b3ed admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:07.372433 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da16967-d9e8-4cca-9f92-0a555bf6b3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:07.372717 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da16967-d9e8-4cca-9f92-0a555bf6b3ed admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:07.373413 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da16967-d9e8-4cca-9f92-0a555bf6b3ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:07.375879 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da16967-d9e8-4cca-9f92-0a555bf6b3ed admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:07.480180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1353/2678] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:06:07 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:06:07.484399 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a13ffc-a32b-4a40-912b-e14a4cea359d admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:07.495166 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a13ffc-a32b-4a40-912b-e14a4cea359d admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:07.500614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c66dd6-bed5-4ff6-88ad-a3666c1f662c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:07.501091 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c66dd6-bed5-4ff6-88ad-a3666c1f662c admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:07.501314 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c66dd6-bed5-4ff6-88ad-a3666c1f662c admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:07.501592 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c66dd6-bed5-4ff6-88ad-a3666c1f662c admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:07.502320 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c66dd6-bed5-4ff6-88ad-a3666c1f662c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:07.504063 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c66dd6-bed5-4ff6-88ad-a3666c1f662c admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:07.519869 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1326/2679] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:06:07.522601 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da16967-d9e8-4cca-9f92-0a555bf6b3ed admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:07.533117 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da16967-d9e8-4cca-9f92-0a555bf6b3ed admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:07.541738 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a68f2-73bb-4296-a10a-0a713f7bd426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:07.542407 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a68f2-73bb-4296-a10a-0a713f7bd426 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:07.542694 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a68f2-73bb-4296-a10a-0a713f7bd426 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:07.542985 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a68f2-73bb-4296-a10a-0a713f7bd426 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:07.543763 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a68f2-73bb-4296-a10a-0a713f7bd426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:07.545546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a68f2-73bb-4296-a10a-0a713f7bd426 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:07.556980 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1354/2680] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:06:07.561122 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c66dd6-bed5-4ff6-88ad-a3666c1f662c admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:07.572021 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c66dd6-bed5-4ff6-88ad-a3666c1f662c admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:07.576808 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57fae38-3c84-4631-b8b5-ebdab6f2b45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:07.577958 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fae38-3c84-4631-b8b5-ebdab6f2b45a admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:07.579753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fae38-3c84-4631-b8b5-ebdab6f2b45a admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:07.580083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fae38-3c84-4631-b8b5-ebdab6f2b45a admin admin] PATH_INFO: `/v3/projects/307d4a7290044cd7a9e5ea10653e1649/users/320f80213e104643a40ecf09819939ce/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:07.597426 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57fae38-3c84-4631-b8b5-ebdab6f2b45a admin admin] RBAC: Authorizing `identity:create_grant(project_id=307d4a7290044cd7a9e5ea10653e1649, user_id=320f80213e104643a40ecf09819939ce, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:07.600197 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57fae38-3c84-4631-b8b5-ebdab6f2b45a admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:07.666167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1327/2681] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:06:07 2022] PUT /identity/v3/projects/307d4a7290044cd7a9e5ea10653e1649/users/320f80213e104643a40ecf09819939ce/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:06:07.679701 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28894f75-100b-41d3-97ec-3bd6f7b50747 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:07.680002 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28894f75-100b-41d3-97ec-3bd6f7b50747 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:07.680284 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28894f75-100b-41d3-97ec-3bd6f7b50747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:07.705215 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68024d49-aebb-471b-9493-cbff127946bf None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:07.705831 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68024d49-aebb-471b-9493-cbff127946bf None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:07.706115 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68024d49-aebb-471b-9493-cbff127946bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:07.708843 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-28894f75-100b-41d3-97ec-3bd6f7b50747 None None] MFA Rules not processed for user `320f80213e104643a40ecf09819939ce`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:06:07.710244 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-28894f75-100b-41d3-97ec-3bd6f7b50747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:07.725250 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-68024d49-aebb-471b-9493-cbff127946bf None None] MFA Rules not processed for user `048fc48dd55a43f7b342533a9484c3ad`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:06:07.726469 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-68024d49-aebb-471b-9493-cbff127946bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:07.773255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:06:07.775205 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:06:07.778809 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1355/2682] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:06:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:06:07.784180 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1328/2683] 10.222.0.39 () {58 vars in 967 bytes} [Mon May 23 16:06:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:06:07.793335 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28894f75-100b-41d3-97ec-3bd6f7b50747 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:07.794719 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-28894f75-100b-41d3-97ec-3bd6f7b50747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:07.797979 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68024d49-aebb-471b-9493-cbff127946bf None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:07.799570 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-68024d49-aebb-471b-9493-cbff127946bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:07.852625 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28894f75-100b-41d3-97ec-3bd6f7b50747 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:07.856199 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ab421-706f-46c3-b01e-a3360f3b5dc0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd003ff6cc73946da9203c69a167bbfff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:07.856841 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ab421-706f-46c3-b01e-a3360f3b5dc0 service glance] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:07.857122 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ab421-706f-46c3-b01e-a3360f3b5dc0 service glance] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:07.857395 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ab421-706f-46c3-b01e-a3360f3b5dc0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:07.866785 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ab421-706f-46c3-b01e-a3360f3b5dc0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:07.868260 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ab421-706f-46c3-b01e-a3360f3b5dc0 service glance] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:07.869730 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68024d49-aebb-471b-9493-cbff127946bf None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:07.878585 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1356/2684] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:06:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:06:07.881383 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af4d6d-14dd-43e9-9aa2-29c3f8bc9c06 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b275a110936a44ce8d54793af1a34808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:07.882039 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af4d6d-14dd-43e9-9aa2-29c3f8bc9c06 service swift] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:07.882347 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af4d6d-14dd-43e9-9aa2-29c3f8bc9c06 service swift] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:07.882625 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af4d6d-14dd-43e9-9aa2-29c3f8bc9c06 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:07.891731 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af4d6d-14dd-43e9-9aa2-29c3f8bc9c06 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:07.893332 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af4d6d-14dd-43e9-9aa2-29c3f8bc9c06 service swift] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:07.902269 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1329/2685] 10.222.0.39 () {60 vars in 1384 bytes} [Mon May 23 16:06:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 16:06:10.573724 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ab421-706f-46c3-b01e-a3360f3b5dc0 service glance] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:10.575138 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-3a1ab421-706f-46c3-b01e-a3360f3b5dc0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:10.644716 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ab421-706f-46c3-b01e-a3360f3b5dc0 service glance] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:10.649538 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e515f-39fb-492a-93ff-70dfe0d9c9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:10.650416 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e515f-39fb-492a-93ff-70dfe0d9c9c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:10.650704 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e515f-39fb-492a-93ff-70dfe0d9c9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:10.650988 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e515f-39fb-492a-93ff-70dfe0d9c9c7 admin admin] PATH_INFO: `/v3/users/e126a2d540ba41fab9e00830a1bbc87d` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:10.652226 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e515f-39fb-492a-93ff-70dfe0d9c9c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e126a2d540ba41fab9e00830a1bbc87d)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:10.654201 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e515f-39fb-492a-93ff-70dfe0d9c9c7 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:10.808012 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-e19e515f-39fb-492a-93ff-70dfe0d9c9c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e126a2d540ba41fab9e00830a1bbc87d'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:10.808644 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-e19e515f-39fb-492a-93ff-70dfe0d9c9c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e126a2d540ba41fab9e00830a1bbc87d'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:10.809281 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-e19e515f-39fb-492a-93ff-70dfe0d9c9c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e126a2d540ba41fab9e00830a1bbc87d'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:10.862200 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-e19e515f-39fb-492a-93ff-70dfe0d9c9c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e126a2d540ba41fab9e00830a1bbc87d'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:10.870680 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-e19e515f-39fb-492a-93ff-70dfe0d9c9c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e126a2d540ba41fab9e00830a1bbc87d'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:10.888542 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1357/2686] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:06:10 2022] DELETE /identity/v3/users/e126a2d540ba41fab9e00830a1bbc87d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:06:10.894505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e53b8f-c528-4451-9edf-65776c02a1f6 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:10.895026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e53b8f-c528-4451-9edf-65776c02a1f6 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:10.895124 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e53b8f-c528-4451-9edf-65776c02a1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:10.913753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-22e53b8f-c528-4451-9edf-65776c02a1f6 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:06:10.915085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-22e53b8f-c528-4451-9edf-65776c02a1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:10.977902 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1330/2687] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:06:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:06:10.987854 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e515f-39fb-492a-93ff-70dfe0d9c9c7 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:10.989417 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-e19e515f-39fb-492a-93ff-70dfe0d9c9c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:11.013483 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:06:11.050682 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e515f-39fb-492a-93ff-70dfe0d9c9c7 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:11.054410 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44baeb7-3a01-48f2-a7d6-aa09a5ac71bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:11.055070 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44baeb7-3a01-48f2-a7d6-aa09a5ac71bb service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:11.055359 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44baeb7-3a01-48f2-a7d6-aa09a5ac71bb service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:11.055668 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44baeb7-3a01-48f2-a7d6-aa09a5ac71bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:11.066145 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44baeb7-3a01-48f2-a7d6-aa09a5ac71bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:11.067535 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44baeb7-3a01-48f2-a7d6-aa09a5ac71bb service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:11.078020 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1358/2688] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:06:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:06:11.374880 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e53b8f-c528-4451-9edf-65776c02a1f6 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:11.374880 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-22e53b8f-c528-4451-9edf-65776c02a1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:11.381067 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e53b8f-c528-4451-9edf-65776c02a1f6 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:11.386416 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2b452-35bf-406e-98d0-e40e299f82f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:11.387295 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2b452-35bf-406e-98d0-e40e299f82f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:11.387582 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2b452-35bf-406e-98d0-e40e299f82f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:11.387903 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2b452-35bf-406e-98d0-e40e299f82f9 admin admin] PATH_INFO: `/v3/projects/f5b87d8817ac442587568ea265a4a8a8` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:11.390788 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2b452-35bf-406e-98d0-e40e299f82f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5b87d8817ac442587568ea265a4a8a8)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:11.398032 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2b452-35bf-406e-98d0-e40e299f82f9 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:11.520739 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-61c2b452-35bf-406e-98d0-e40e299f82f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5b87d8817ac442587568ea265a4a8a8', 'request_id': 'req-61c2b452-35bf-406e-98d0-e40e299f82f9'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:11.526202 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-61c2b452-35bf-406e-98d0-e40e299f82f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5b87d8817ac442587568ea265a4a8a8', 'request_id': 'req-61c2b452-35bf-406e-98d0-e40e299f82f9'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:11.587939 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-61c2b452-35bf-406e-98d0-e40e299f82f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5b87d8817ac442587568ea265a4a8a8', 'request_id': 'req-61c2b452-35bf-406e-98d0-e40e299f82f9'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:11.599816 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-61c2b452-35bf-406e-98d0-e40e299f82f9 admin admin] The token cache is being invalidate because project f5b87d8817ac442587568ea265a4a8a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:06:11.600217 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-61c2b452-35bf-406e-98d0-e40e299f82f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:11.600764 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-61c2b452-35bf-406e-98d0-e40e299f82f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:11.602401 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1331/2689] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:06:11 2022] DELETE /identity/v3/projects/f5b87d8817ac442587568ea265a4a8a8 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:06:21.105992 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=17 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:06:21.596781 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:06:22.199501 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44baeb7-3a01-48f2-a7d6-aa09a5ac71bb service neutron] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:22.201006 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-f44baeb7-3a01-48f2-a7d6-aa09a5ac71bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:22.212669 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44baeb7-3a01-48f2-a7d6-aa09a5ac71bb service neutron] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:22.265250 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b621c0-eaca-4e32-b20b-4415f146cd8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:22.266545 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b621c0-eaca-4e32-b20b-4415f146cd8d service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:22.266841 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b621c0-eaca-4e32-b20b-4415f146cd8d service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:22.267124 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b621c0-eaca-4e32-b20b-4415f146cd8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:22.269189 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-b1b621c0-eaca-4e32-b20b-4415f146cd8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:22.340310 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b621c0-eaca-4e32-b20b-4415f146cd8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:22.341756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b621c0-eaca-4e32-b20b-4415f146cd8d service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:22.352956 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1359/2690] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:06:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:06:25.826984 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2b452-35bf-406e-98d0-e40e299f82f9 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:25.828532 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-61c2b452-35bf-406e-98d0-e40e299f82f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:25.843191 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2b452-35bf-406e-98d0-e40e299f82f9 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:25.848146 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101001f-bb2b-46b7-9c91-8a3a73d79775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:25.849035 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101001f-bb2b-46b7-9c91-8a3a73d79775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:25.849321 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101001f-bb2b-46b7-9c91-8a3a73d79775 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:25.849601 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101001f-bb2b-46b7-9c91-8a3a73d79775 admin admin] PATH_INFO: `/v3/users/261e4ebfb0504a21b6c54e05c0b8378f` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:25.864570 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101001f-bb2b-46b7-9c91-8a3a73d79775 admin admin] RBAC: Authorizing `identity:delete_user(user_id=261e4ebfb0504a21b6c54e05c0b8378f)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:25.866631 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101001f-bb2b-46b7-9c91-8a3a73d79775 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:26.056173 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-4101001f-bb2b-46b7-9c91-8a3a73d79775 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '261e4ebfb0504a21b6c54e05c0b8378f'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:26.063037 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-4101001f-bb2b-46b7-9c91-8a3a73d79775 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '261e4ebfb0504a21b6c54e05c0b8378f'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:26.063820 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-4101001f-bb2b-46b7-9c91-8a3a73d79775 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '261e4ebfb0504a21b6c54e05c0b8378f'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:26.078019 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-4101001f-bb2b-46b7-9c91-8a3a73d79775 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '261e4ebfb0504a21b6c54e05c0b8378f'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:26.162043 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-4101001f-bb2b-46b7-9c91-8a3a73d79775 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '261e4ebfb0504a21b6c54e05c0b8378f'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:26.168286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1332/2691] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:06:25 2022] DELETE /identity/v3/users/261e4ebfb0504a21b6c54e05c0b8378f => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:06:26.410482 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b621c0-eaca-4e32-b20b-4415f146cd8d service neutron] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:26.420896 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b621c0-eaca-4e32-b20b-4415f146cd8d service neutron] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:26.481818 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99c110-9e3b-44f8-afab-7580a000fe5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:26.482675 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99c110-9e3b-44f8-afab-7580a000fe5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:26.482970 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99c110-9e3b-44f8-afab-7580a000fe5e admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:26.483241 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99c110-9e3b-44f8-afab-7580a000fe5e admin admin] PATH_INFO: `/v3/projects/bbc47b5b4ab84fb7af928ca0a2b3b64f` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:26.495029 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c99c110-9e3b-44f8-afab-7580a000fe5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbc47b5b4ab84fb7af928ca0a2b3b64f)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:26.497058 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c99c110-9e3b-44f8-afab-7580a000fe5e admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:26.588642 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:06:26.592404 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-3c99c110-9e3b-44f8-afab-7580a000fe5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbc47b5b4ab84fb7af928ca0a2b3b64f', 'request_id': 'req-3c99c110-9e3b-44f8-afab-7580a000fe5e'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:26.599722 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-3c99c110-9e3b-44f8-afab-7580a000fe5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbc47b5b4ab84fb7af928ca0a2b3b64f', 'request_id': 'req-3c99c110-9e3b-44f8-afab-7580a000fe5e'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:26.671005 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-3c99c110-9e3b-44f8-afab-7580a000fe5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbc47b5b4ab84fb7af928ca0a2b3b64f', 'request_id': 'req-3c99c110-9e3b-44f8-afab-7580a000fe5e'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:26.682713 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-3c99c110-9e3b-44f8-afab-7580a000fe5e admin admin] The token cache is being invalidate because project bbc47b5b4ab84fb7af928ca0a2b3b64f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:06:26.683184 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-3c99c110-9e3b-44f8-afab-7580a000fe5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:26.684126 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-3c99c110-9e3b-44f8-afab-7580a000fe5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:26.685706 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1360/2692] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:06:26 2022] DELETE /identity/v3/projects/bbc47b5b4ab84fb7af928ca0a2b3b64f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:06:26.691183 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f721a-3b15-4c80-add6-6da2dd0e5af6 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:26.691480 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f721a-3b15-4c80-add6-6da2dd0e5af6 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:26.692034 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f721a-3b15-4c80-add6-6da2dd0e5af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:26.712645 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-9e1f721a-3b15-4c80-add6-6da2dd0e5af6 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:06:26.713872 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-9e1f721a-3b15-4c80-add6-6da2dd0e5af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:26.776408 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1333/2693] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:06:26.785049 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c52eb-b101-460a-a306-8dfcd66456d0 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:26.785338 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c52eb-b101-460a-a306-8dfcd66456d0 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:26.785641 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c52eb-b101-460a-a306-8dfcd66456d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:26.804042 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-b35c52eb-b101-460a-a306-8dfcd66456d0 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:06:26.805647 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-b35c52eb-b101-460a-a306-8dfcd66456d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:26.814123 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1361/2694] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:06:26.818310 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f721a-3b15-4c80-add6-6da2dd0e5af6 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:26.829240 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f721a-3b15-4c80-add6-6da2dd0e5af6 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:26.834092 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106da40-1de0-4bb6-8711-f060e2e1e711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:26.834751 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106da40-1de0-4bb6-8711-f060e2e1e711 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:26.835039 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106da40-1de0-4bb6-8711-f060e2e1e711 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:26.835314 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106da40-1de0-4bb6-8711-f060e2e1e711 admin admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:26.836099 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106da40-1de0-4bb6-8711-f060e2e1e711 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:06:26.836408 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106da40-1de0-4bb6-8711-f060e2e1e711 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:26.838010 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106da40-1de0-4bb6-8711-f060e2e1e711 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:26.850393 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1334/2695] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 16:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:06:26.854899 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c52eb-b101-460a-a306-8dfcd66456d0 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:26.864539 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c52eb-b101-460a-a306-8dfcd66456d0 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:26.869501 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba42de-f426-464a-bc9a-ee78c3424fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:26.870205 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba42de-f426-464a-bc9a-ee78c3424fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:26.870494 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba42de-f426-464a-bc9a-ee78c3424fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:26.870774 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba42de-f426-464a-bc9a-ee78c3424fa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:26.871480 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba42de-f426-464a-bc9a-ee78c3424fa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:26.873452 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba42de-f426-464a-bc9a-ee78c3424fa5 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:26.952314 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1362/2696] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:06:26 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:06:26.956963 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106da40-1de0-4bb6-8711-f060e2e1e711 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:26.967510 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106da40-1de0-4bb6-8711-f060e2e1e711 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:27.010484 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:06:27.022615 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16fca0-fdd2-430b-8ac5-b60455ad670d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:27.023288 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16fca0-fdd2-430b-8ac5-b60455ad670d admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:27.023574 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16fca0-fdd2-430b-8ac5-b60455ad670d admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:27.023883 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16fca0-fdd2-430b-8ac5-b60455ad670d admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:27.024586 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16fca0-fdd2-430b-8ac5-b60455ad670d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:27.026489 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16fca0-fdd2-430b-8ac5-b60455ad670d admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:27.084252 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1335/2697] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:06:26 2022] POST /identity/v3/users => generated 287 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:06:27.088498 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba42de-f426-464a-bc9a-ee78c3424fa5 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:27.099317 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba42de-f426-464a-bc9a-ee78c3424fa5 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:27.104074 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6ba24-0118-46f5-bfe6-511354ecf1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:27.104735 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6ba24-0118-46f5-bfe6-511354ecf1df admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:27.105026 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6ba24-0118-46f5-bfe6-511354ecf1df admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:27.105307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6ba24-0118-46f5-bfe6-511354ecf1df admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:27.106036 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e6ba24-0118-46f5-bfe6-511354ecf1df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:27.107673 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e6ba24-0118-46f5-bfe6-511354ecf1df admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:27.118713 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1363/2698] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:06:27.127023 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16fca0-fdd2-430b-8ac5-b60455ad670d admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:27.137743 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16fca0-fdd2-430b-8ac5-b60455ad670d admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:27.142304 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d2f7d-1b79-4d90-ba9f-60ce129eb89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:27.142948 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d2f7d-1b79-4d90-ba9f-60ce129eb89a admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:27.143231 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d2f7d-1b79-4d90-ba9f-60ce129eb89a admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:27.143504 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d2f7d-1b79-4d90-ba9f-60ce129eb89a admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:27.144252 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d2f7d-1b79-4d90-ba9f-60ce129eb89a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:27.145831 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d2f7d-1b79-4d90-ba9f-60ce129eb89a admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:27.155634 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1336/2699] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:06:27.159884 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6ba24-0118-46f5-bfe6-511354ecf1df admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:27.169905 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6ba24-0118-46f5-bfe6-511354ecf1df admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:27.175991 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac3655-620a-406e-a9a2-de775310a784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:27.176861 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac3655-620a-406e-a9a2-de775310a784 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:27.177146 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac3655-620a-406e-a9a2-de775310a784 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:27.177425 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac3655-620a-406e-a9a2-de775310a784 admin admin] PATH_INFO: `/v3/projects/8f02b3752a1340c880dcd855f0d7c113/users/dd976592aec04040b085c945535a1afc/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:27.192556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac3655-620a-406e-a9a2-de775310a784 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f02b3752a1340c880dcd855f0d7c113, user_id=dd976592aec04040b085c945535a1afc, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:27.195207 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac3655-620a-406e-a9a2-de775310a784 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:27.251066 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1364/2700] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:06:27 2022] PUT /identity/v3/projects/8f02b3752a1340c880dcd855f0d7c113/users/dd976592aec04040b085c945535a1afc/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:06:27.261118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e51289-655e-4931-94ff-1053d8237017 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:27.261410 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e51289-655e-4931-94ff-1053d8237017 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:27.261685 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e51289-655e-4931-94ff-1053d8237017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:27.288556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-a4e51289-655e-4931-94ff-1053d8237017 None None] MFA Rules not processed for user `dd976592aec04040b085c945535a1afc`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:06:27.289753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-a4e51289-655e-4931-94ff-1053d8237017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:27.355753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1337/2701] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:06:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:06:27.360775 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac3655-620a-406e-a9a2-de775310a784 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:27.426152 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac3655-620a-406e-a9a2-de775310a784 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:27.431410 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f90cb4-9782-479c-a88f-7765a0093992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:27.432101 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f90cb4-9782-479c-a88f-7765a0093992 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:27.432389 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f90cb4-9782-479c-a88f-7765a0093992 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:27.432786 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f90cb4-9782-479c-a88f-7765a0093992 admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:27.433495 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f90cb4-9782-479c-a88f-7765a0093992 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:27.435396 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f90cb4-9782-479c-a88f-7765a0093992 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:27.570246 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1365/2702] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:06:27 2022] POST /identity/v3/projects => generated 371 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:06:27.574445 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e51289-655e-4931-94ff-1053d8237017 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:27.585753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e51289-655e-4931-94ff-1053d8237017 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:27.644909 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433680f8-575f-48e3-8490-653517f68a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:27.645572 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433680f8-575f-48e3-8490-653517f68a53 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:27.645859 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433680f8-575f-48e3-8490-653517f68a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:27.646139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433680f8-575f-48e3-8490-653517f68a53 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:27.646916 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433680f8-575f-48e3-8490-653517f68a53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:27.648869 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433680f8-575f-48e3-8490-653517f68a53 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:27.745524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1338/2703] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:06:27 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:06:27.749308 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f90cb4-9782-479c-a88f-7765a0093992 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:27.759980 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f90cb4-9782-479c-a88f-7765a0093992 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:27.764656 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e0ee7-83c9-4025-895a-5994365ce752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:27.765318 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e0ee7-83c9-4025-895a-5994365ce752 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:27.765600 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e0ee7-83c9-4025-895a-5994365ce752 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:27.765907 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e0ee7-83c9-4025-895a-5994365ce752 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:27.766658 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e0ee7-83c9-4025-895a-5994365ce752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:27.768342 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e0ee7-83c9-4025-895a-5994365ce752 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:27.779151 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1366/2704] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:06:27.785093 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433680f8-575f-48e3-8490-653517f68a53 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:27.796204 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433680f8-575f-48e3-8490-653517f68a53 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:27.802087 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c33556-ab5e-44f4-83b1-f60c7b223841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:27.803003 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c33556-ab5e-44f4-83b1-f60c7b223841 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:27.803290 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c33556-ab5e-44f4-83b1-f60c7b223841 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:27.803569 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c33556-ab5e-44f4-83b1-f60c7b223841 admin admin] PATH_INFO: `/v3/projects/d8101b2644814a99a9f5411667f7abb8/users/afe44d10efef4f67b5a64a73cc465c0e/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:27.819199 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c33556-ab5e-44f4-83b1-f60c7b223841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8101b2644814a99a9f5411667f7abb8, user_id=afe44d10efef4f67b5a64a73cc465c0e, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:27.821923 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c33556-ab5e-44f4-83b1-f60c7b223841 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:27.929465 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1339/2705] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:06:27 2022] PUT /identity/v3/projects/d8101b2644814a99a9f5411667f7abb8/users/afe44d10efef4f67b5a64a73cc465c0e/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:06:27.933611 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e0ee7-83c9-4025-895a-5994365ce752 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:27.944127 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e0ee7-83c9-4025-895a-5994365ce752 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:27.985184 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:06:28.001255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9f8ad-ba50-43e1-b489-85f60a947180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:28.001923 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9f8ad-ba50-43e1-b489-85f60a947180 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:28.002207 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9f8ad-ba50-43e1-b489-85f60a947180 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:28.002572 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9f8ad-ba50-43e1-b489-85f60a947180 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:28.003261 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b9f8ad-ba50-43e1-b489-85f60a947180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:28.004906 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b9f8ad-ba50-43e1-b489-85f60a947180 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:28.014542 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1367/2706] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:06:28.019483 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c33556-ab5e-44f4-83b1-f60c7b223841 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:28.030040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c33556-ab5e-44f4-83b1-f60c7b223841 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:28.035272 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0063e19-db56-478a-a347-838912f3036b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:28.036234 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0063e19-db56-478a-a347-838912f3036b admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:28.036519 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0063e19-db56-478a-a347-838912f3036b admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:28.036812 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0063e19-db56-478a-a347-838912f3036b admin admin] PATH_INFO: `/v3/projects/d8101b2644814a99a9f5411667f7abb8/users/afe44d10efef4f67b5a64a73cc465c0e/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:28.038775 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0063e19-db56-478a-a347-838912f3036b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8101b2644814a99a9f5411667f7abb8, user_id=afe44d10efef4f67b5a64a73cc465c0e, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:28.041562 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0063e19-db56-478a-a347-838912f3036b admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:28.052302 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1340/2707] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:06:28 2022] PUT /identity/v3/projects/d8101b2644814a99a9f5411667f7abb8/users/afe44d10efef4f67b5a64a73cc465c0e/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:06:28.062714 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62926dbc-e594-4913-9b6d-437b7f7880af None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:28.062996 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62926dbc-e594-4913-9b6d-437b7f7880af None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:28.063275 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62926dbc-e594-4913-9b6d-437b7f7880af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:28.089652 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-62926dbc-e594-4913-9b6d-437b7f7880af None None] MFA Rules not processed for user `afe44d10efef4f67b5a64a73cc465c0e`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:06:28.090851 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-62926dbc-e594-4913-9b6d-437b7f7880af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:28.158342 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1368/2708] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:06:28 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:06:28.169649 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0063e19-db56-478a-a347-838912f3036b admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:28.171374 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-c0063e19-db56-478a-a347-838912f3036b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:28.182707 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:06:28.232615 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0063e19-db56-478a-a347-838912f3036b admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:28.236460 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d896f-5839-4074-b7ab-8ce933b7ad95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:28.237138 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d896f-5839-4074-b7ab-8ce933b7ad95 service cinder] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:28.237424 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d896f-5839-4074-b7ab-8ce933b7ad95 service cinder] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:28.237703 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d896f-5839-4074-b7ab-8ce933b7ad95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:28.246634 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d896f-5839-4074-b7ab-8ce933b7ad95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:28.248126 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d896f-5839-4074-b7ab-8ce933b7ad95 service cinder] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:28.258484 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1341/2709] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:06:28 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:06:28.458122 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62926dbc-e594-4913-9b6d-437b7f7880af None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:28.467966 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62926dbc-e594-4913-9b6d-437b7f7880af None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:28.475553 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdbffb-cd3c-4458-ad81-8b9fe6650f75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:28.475553 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdbffb-cd3c-4458-ad81-8b9fe6650f75 service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:28.475553 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdbffb-cd3c-4458-ad81-8b9fe6650f75 service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:28.475553 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdbffb-cd3c-4458-ad81-8b9fe6650f75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:28.530200 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacdbffb-cd3c-4458-ad81-8b9fe6650f75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:28.531657 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacdbffb-cd3c-4458-ad81-8b9fe6650f75 service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:28.540623 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1369/2710] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:06:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:06:30.337171 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d896f-5839-4074-b7ab-8ce933b7ad95 service cinder] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:30.338659 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-4f3d896f-5839-4074-b7ab-8ce933b7ad95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:30.403938 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d896f-5839-4074-b7ab-8ce933b7ad95 service cinder] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:30.409104 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f5138-1970-4d14-be10-cbab118e7116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:30.409957 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f5138-1970-4d14-be10-cbab118e7116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:30.410238 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f5138-1970-4d14-be10-cbab118e7116 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:30.410511 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f5138-1970-4d14-be10-cbab118e7116 admin admin] PATH_INFO: `/v3/users/320f80213e104643a40ecf09819939ce` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:30.411700 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f5138-1970-4d14-be10-cbab118e7116 admin admin] RBAC: Authorizing `identity:delete_user(user_id=320f80213e104643a40ecf09819939ce)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:30.413608 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f5138-1970-4d14-be10-cbab118e7116 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:30.650336 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-4b7f5138-1970-4d14-be10-cbab118e7116 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '320f80213e104643a40ecf09819939ce'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:30.657773 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-4b7f5138-1970-4d14-be10-cbab118e7116 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '320f80213e104643a40ecf09819939ce'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:30.658438 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-4b7f5138-1970-4d14-be10-cbab118e7116 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '320f80213e104643a40ecf09819939ce'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:30.670320 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-4b7f5138-1970-4d14-be10-cbab118e7116 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '320f80213e104643a40ecf09819939ce'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:30.773318 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-4b7f5138-1970-4d14-be10-cbab118e7116 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '320f80213e104643a40ecf09819939ce'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:30.779917 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1342/2711] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:06:30 2022] DELETE /identity/v3/users/320f80213e104643a40ecf09819939ce => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:06:30.784912 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626cdc9-45aa-4c55-bc7e-1a8e621c1733 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:30.785424 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626cdc9-45aa-4c55-bc7e-1a8e621c1733 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:30.785535 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626cdc9-45aa-4c55-bc7e-1a8e621c1733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:30.803185 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-c626cdc9-45aa-4c55-bc7e-1a8e621c1733 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:06:30.804415 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-c626cdc9-45aa-4c55-bc7e-1a8e621c1733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:30.872607 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1370/2712] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:06:30.883512 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f5138-1970-4d14-be10-cbab118e7116 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:30.885009 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-4b7f5138-1970-4d14-be10-cbab118e7116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:30.922898 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:06:30.946487 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f5138-1970-4d14-be10-cbab118e7116 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:30.950529 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11250a6e-c2a6-4f6d-b986-459c82128d66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:30.951182 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11250a6e-c2a6-4f6d-b986-459c82128d66 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:30.951470 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11250a6e-c2a6-4f6d-b986-459c82128d66 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:30.951780 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11250a6e-c2a6-4f6d-b986-459c82128d66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:30.963956 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11250a6e-c2a6-4f6d-b986-459c82128d66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:30.965428 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11250a6e-c2a6-4f6d-b986-459c82128d66 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:30.976893 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1343/2713] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:06:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:06:31.406752 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626cdc9-45aa-4c55-bc7e-1a8e621c1733 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:31.408447 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-c626cdc9-45aa-4c55-bc7e-1a8e621c1733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:31.415650 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:06:31.422385 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626cdc9-45aa-4c55-bc7e-1a8e621c1733 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:31.428013 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2120ee5-bf13-4b99-aa97-862bcc450c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:31.433946 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2120ee5-bf13-4b99-aa97-862bcc450c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:31.433946 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2120ee5-bf13-4b99-aa97-862bcc450c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:31.433946 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2120ee5-bf13-4b99-aa97-862bcc450c4f admin admin] PATH_INFO: `/v3/projects/307d4a7290044cd7a9e5ea10653e1649` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:31.433946 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2120ee5-bf13-4b99-aa97-862bcc450c4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=307d4a7290044cd7a9e5ea10653e1649)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:31.433946 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2120ee5-bf13-4b99-aa97-862bcc450c4f admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:31.586434 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-a2120ee5-bf13-4b99-aa97-862bcc450c4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '307d4a7290044cd7a9e5ea10653e1649', 'request_id': 'req-a2120ee5-bf13-4b99-aa97-862bcc450c4f'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:31.592800 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-a2120ee5-bf13-4b99-aa97-862bcc450c4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '307d4a7290044cd7a9e5ea10653e1649', 'request_id': 'req-a2120ee5-bf13-4b99-aa97-862bcc450c4f'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:31.689824 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-a2120ee5-bf13-4b99-aa97-862bcc450c4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '307d4a7290044cd7a9e5ea10653e1649', 'request_id': 'req-a2120ee5-bf13-4b99-aa97-862bcc450c4f'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:31.705281 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-a2120ee5-bf13-4b99-aa97-862bcc450c4f admin admin] The token cache is being invalidate because project 307d4a7290044cd7a9e5ea10653e1649 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:06:31.705574 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-a2120ee5-bf13-4b99-aa97-862bcc450c4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:31.706215 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-a2120ee5-bf13-4b99-aa97-862bcc450c4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:31.707806 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1371/2714] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:06:31 2022] DELETE /identity/v3/projects/307d4a7290044cd7a9e5ea10653e1649 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:06:31.712691 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fbc88-46bd-43b1-a02a-e8ec75492252 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:31.713182 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fbc88-46bd-43b1-a02a-e8ec75492252 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:31.713285 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fbc88-46bd-43b1-a02a-e8ec75492252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:31.730751 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-228fbc88-46bd-43b1-a02a-e8ec75492252 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:06:31.731966 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-228fbc88-46bd-43b1-a02a-e8ec75492252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:31.793180 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1344/2715] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:06:31.805966 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9469f92-cf59-462b-8de6-334f974bdacb None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:31.806491 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9469f92-cf59-462b-8de6-334f974bdacb None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:31.806614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9469f92-cf59-462b-8de6-334f974bdacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:31.825331 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-b9469f92-cf59-462b-8de6-334f974bdacb None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:06:31.831170 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-b9469f92-cf59-462b-8de6-334f974bdacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:31.834865 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1372/2716] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:06:31.839019 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fbc88-46bd-43b1-a02a-e8ec75492252 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:31.848733 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fbc88-46bd-43b1-a02a-e8ec75492252 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:31.853213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364891c-8f20-434c-8994-fa15baa58e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:31.853855 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364891c-8f20-434c-8994-fa15baa58e31 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:31.854134 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364891c-8f20-434c-8994-fa15baa58e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:31.854440 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364891c-8f20-434c-8994-fa15baa58e31 admin admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:31.855158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364891c-8f20-434c-8994-fa15baa58e31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:06:31.855511 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364891c-8f20-434c-8994-fa15baa58e31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:31.857074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364891c-8f20-434c-8994-fa15baa58e31 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:31.869108 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1345/2717] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 16:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:06:31.873552 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9469f92-cf59-462b-8de6-334f974bdacb None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:31.883495 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9469f92-cf59-462b-8de6-334f974bdacb None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:31.888229 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648ac5c-f3ff-48ca-9171-14c5b477db6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:31.888877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648ac5c-f3ff-48ca-9171-14c5b477db6f admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:31.889159 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648ac5c-f3ff-48ca-9171-14c5b477db6f admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:31.891893 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648ac5c-f3ff-48ca-9171-14c5b477db6f admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:31.891893 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d648ac5c-f3ff-48ca-9171-14c5b477db6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:31.892207 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d648ac5c-f3ff-48ca-9171-14c5b477db6f admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:31.970837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1373/2718] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:06:31 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:06:31.975083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364891c-8f20-434c-8994-fa15baa58e31 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:31.986365 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364891c-8f20-434c-8994-fa15baa58e31 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:32.052569 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22315901-d646-4a3f-84f4-44b614079653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:32.053240 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22315901-d646-4a3f-84f4-44b614079653 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:32.053525 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22315901-d646-4a3f-84f4-44b614079653 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:32.053800 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22315901-d646-4a3f-84f4-44b614079653 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:32.054498 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22315901-d646-4a3f-84f4-44b614079653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:32.056561 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22315901-d646-4a3f-84f4-44b614079653 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:32.165695 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1346/2719] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:06:31 2022] POST /identity/v3/users => generated 287 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:06:32.166834 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648ac5c-f3ff-48ca-9171-14c5b477db6f admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:32.178173 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648ac5c-f3ff-48ca-9171-14c5b477db6f admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:32.182681 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971df2c-5ed4-4ef1-a2a0-da595ce7920b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:32.183335 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971df2c-5ed4-4ef1-a2a0-da595ce7920b admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:32.183634 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971df2c-5ed4-4ef1-a2a0-da595ce7920b admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:32.183922 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971df2c-5ed4-4ef1-a2a0-da595ce7920b admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:32.184694 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3971df2c-5ed4-4ef1-a2a0-da595ce7920b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:32.186279 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3971df2c-5ed4-4ef1-a2a0-da595ce7920b admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:32.198481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1374/2720] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:06:32.202688 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22315901-d646-4a3f-84f4-44b614079653 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:32.215935 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22315901-d646-4a3f-84f4-44b614079653 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:32.223181 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14959e09-8fb0-4711-985c-1eccaf53b79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:32.223856 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14959e09-8fb0-4711-985c-1eccaf53b79c admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:32.224131 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14959e09-8fb0-4711-985c-1eccaf53b79c admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:32.224407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14959e09-8fb0-4711-985c-1eccaf53b79c admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:32.225204 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14959e09-8fb0-4711-985c-1eccaf53b79c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:32.226805 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14959e09-8fb0-4711-985c-1eccaf53b79c admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:32.239246 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1347/2721] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:06:32.243611 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971df2c-5ed4-4ef1-a2a0-da595ce7920b admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:32.253960 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971df2c-5ed4-4ef1-a2a0-da595ce7920b admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:32.258611 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a84b70-c732-42ef-bb89-c62824924268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:32.259636 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a84b70-c732-42ef-bb89-c62824924268 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:32.259946 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a84b70-c732-42ef-bb89-c62824924268 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:32.260284 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a84b70-c732-42ef-bb89-c62824924268 admin admin] PATH_INFO: `/v3/projects/a1fbb500c5ff47b4b8afc22fbca04796/users/9f6ce6e7962d452a94de366f23a852c6/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:32.275130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a84b70-c732-42ef-bb89-c62824924268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1fbb500c5ff47b4b8afc22fbca04796, user_id=9f6ce6e7962d452a94de366f23a852c6, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:32.277924 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a84b70-c732-42ef-bb89-c62824924268 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:32.381700 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1375/2722] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:06:32 2022] PUT /identity/v3/projects/a1fbb500c5ff47b4b8afc22fbca04796/users/9f6ce6e7962d452a94de366f23a852c6/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:06:32.393509 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499012c0-b9fb-453f-a8d1-1e330cd1da26 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:32.393799 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499012c0-b9fb-453f-a8d1-1e330cd1da26 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:32.394108 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499012c0-b9fb-453f-a8d1-1e330cd1da26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:32.422863 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-499012c0-b9fb-453f-a8d1-1e330cd1da26 None None] MFA Rules not processed for user `9f6ce6e7962d452a94de366f23a852c6`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:06:32.424185 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-499012c0-b9fb-453f-a8d1-1e330cd1da26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:32.454822 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:06:32.490573 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1348/2723] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:06:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:06:32.502389 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a84b70-c732-42ef-bb89-c62824924268 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:32.504247 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-06a84b70-c732-42ef-bb89-c62824924268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:32.563965 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a84b70-c732-42ef-bb89-c62824924268 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:32.567578 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf7490-de45-452d-97b6-889dd77257c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:32.568243 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf7490-de45-452d-97b6-889dd77257c0 service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:32.568526 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf7490-de45-452d-97b6-889dd77257c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:32.568826 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf7490-de45-452d-97b6-889dd77257c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:32.577131 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf7490-de45-452d-97b6-889dd77257c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:32.580319 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf7490-de45-452d-97b6-889dd77257c0 service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:32.589476 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1376/2724] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:06:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:06:37.710449 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499012c0-b9fb-453f-a8d1-1e330cd1da26 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:37.774151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499012c0-b9fb-453f-a8d1-1e330cd1da26 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:37.781847 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e8968-dbad-4a42-985b-c64844e4324a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:37.781847 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e8968-dbad-4a42-985b-c64844e4324a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:37.781847 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e8968-dbad-4a42-985b-c64844e4324a admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:37.781847 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e8968-dbad-4a42-985b-c64844e4324a admin admin] PATH_INFO: `/v3/users/9f6ce6e7962d452a94de366f23a852c6` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:37.782248 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e8968-dbad-4a42-985b-c64844e4324a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f6ce6e7962d452a94de366f23a852c6)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:37.783848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e8968-dbad-4a42-985b-c64844e4324a admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:37.960241 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-b72e8968-dbad-4a42-985b-c64844e4324a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f6ce6e7962d452a94de366f23a852c6'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:37.967097 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-b72e8968-dbad-4a42-985b-c64844e4324a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f6ce6e7962d452a94de366f23a852c6'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:37.967791 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-b72e8968-dbad-4a42-985b-c64844e4324a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f6ce6e7962d452a94de366f23a852c6'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:37.980219 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-b72e8968-dbad-4a42-985b-c64844e4324a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f6ce6e7962d452a94de366f23a852c6'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:38.032699 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-b72e8968-dbad-4a42-985b-c64844e4324a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f6ce6e7962d452a94de366f23a852c6'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:38.039041 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1349/2725] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:06:37 2022] DELETE /identity/v3/users/9f6ce6e7962d452a94de366f23a852c6 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:06:38.043507 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30a7f8-ddff-4ddd-acb6-e0e18b0aac48 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:38.044003 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30a7f8-ddff-4ddd-acb6-e0e18b0aac48 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:38.044100 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30a7f8-ddff-4ddd-acb6-e0e18b0aac48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:38.062200 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-5b30a7f8-ddff-4ddd-acb6-e0e18b0aac48 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:06:38.063561 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-5b30a7f8-ddff-4ddd-acb6-e0e18b0aac48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:38.083919 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:06:38.127578 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1377/2726] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:06:38.137462 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e8968-dbad-4a42-985b-c64844e4324a admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:38.138850 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-b72e8968-dbad-4a42-985b-c64844e4324a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:38.192306 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:06:38.199813 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e8968-dbad-4a42-985b-c64844e4324a admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:38.204556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf56bd4-1f08-49d5-859e-6960af3e0c70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:38.205236 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf56bd4-1f08-49d5-859e-6960af3e0c70 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:38.208187 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf56bd4-1f08-49d5-859e-6960af3e0c70 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:38.208187 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf56bd4-1f08-49d5-859e-6960af3e0c70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:38.215927 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf56bd4-1f08-49d5-859e-6960af3e0c70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:38.216919 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf56bd4-1f08-49d5-859e-6960af3e0c70 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:38.228145 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1350/2727] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:06:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:06:38.657790 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30a7f8-ddff-4ddd-acb6-e0e18b0aac48 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:38.659345 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-5b30a7f8-ddff-4ddd-acb6-e0e18b0aac48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:38.673562 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30a7f8-ddff-4ddd-acb6-e0e18b0aac48 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:38.678571 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04d7db-f39e-467e-91d9-8ff19e4f52e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:38.679636 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04d7db-f39e-467e-91d9-8ff19e4f52e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:38.680032 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04d7db-f39e-467e-91d9-8ff19e4f52e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:38.680322 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04d7db-f39e-467e-91d9-8ff19e4f52e6 admin admin] PATH_INFO: `/v3/projects/a1fbb500c5ff47b4b8afc22fbca04796` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:38.681530 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04d7db-f39e-467e-91d9-8ff19e4f52e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1fbb500c5ff47b4b8afc22fbca04796)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:38.683623 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04d7db-f39e-467e-91d9-8ff19e4f52e6 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:38.814911 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7f04d7db-f39e-467e-91d9-8ff19e4f52e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1fbb500c5ff47b4b8afc22fbca04796', 'request_id': 'req-7f04d7db-f39e-467e-91d9-8ff19e4f52e6'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:38.821607 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7f04d7db-f39e-467e-91d9-8ff19e4f52e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1fbb500c5ff47b4b8afc22fbca04796', 'request_id': 'req-7f04d7db-f39e-467e-91d9-8ff19e4f52e6'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:38.899154 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7f04d7db-f39e-467e-91d9-8ff19e4f52e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1fbb500c5ff47b4b8afc22fbca04796', 'request_id': 'req-7f04d7db-f39e-467e-91d9-8ff19e4f52e6'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:38.911389 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7f04d7db-f39e-467e-91d9-8ff19e4f52e6 admin admin] The token cache is being invalidate because project a1fbb500c5ff47b4b8afc22fbca04796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:06:38.911765 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7f04d7db-f39e-467e-91d9-8ff19e4f52e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:38.912446 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-7f04d7db-f39e-467e-91d9-8ff19e4f52e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:38.914271 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1378/2728] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:06:38 2022] DELETE /identity/v3/projects/a1fbb500c5ff47b4b8afc22fbca04796 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:06:38.919256 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebeafd0-b3f3-4697-83d3-c996663032c2 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:38.919897 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebeafd0-b3f3-4697-83d3-c996663032c2 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:38.920371 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebeafd0-b3f3-4697-83d3-c996663032c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:38.944705 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-0ebeafd0-b3f3-4697-83d3-c996663032c2 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:06:38.946040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-0ebeafd0-b3f3-4697-83d3-c996663032c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:39.009118 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1351/2729] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:06:39.017534 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df07f5-d24d-4d07-b069-d0d48fb9e26d None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:39.017824 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df07f5-d24d-4d07-b069-d0d48fb9e26d None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:39.018110 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df07f5-d24d-4d07-b069-d0d48fb9e26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:39.036543 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-83df07f5-d24d-4d07-b069-d0d48fb9e26d None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:06:39.040374 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-83df07f5-d24d-4d07-b069-d0d48fb9e26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:39.045767 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1379/2730] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:06:39.050892 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebeafd0-b3f3-4697-83d3-c996663032c2 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:39.060964 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebeafd0-b3f3-4697-83d3-c996663032c2 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:39.066139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab7492-0b0f-4d26-a503-bb66d52d7c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:39.066793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab7492-0b0f-4d26-a503-bb66d52d7c8b admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:39.067072 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab7492-0b0f-4d26-a503-bb66d52d7c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:39.067354 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab7492-0b0f-4d26-a503-bb66d52d7c8b admin admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:39.068114 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab7492-0b0f-4d26-a503-bb66d52d7c8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:06:39.074832 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab7492-0b0f-4d26-a503-bb66d52d7c8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:39.074832 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab7492-0b0f-4d26-a503-bb66d52d7c8b admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:39.082078 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1352/2731] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 16:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:06:39.086466 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df07f5-d24d-4d07-b069-d0d48fb9e26d None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:39.096443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df07f5-d24d-4d07-b069-d0d48fb9e26d None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:39.101404 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bc0da-aa1c-4e84-9b08-e4590ba9e218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:39.102077 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bc0da-aa1c-4e84-9b08-e4590ba9e218 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:39.102366 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bc0da-aa1c-4e84-9b08-e4590ba9e218 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:39.102648 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bc0da-aa1c-4e84-9b08-e4590ba9e218 admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:39.103340 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48bc0da-aa1c-4e84-9b08-e4590ba9e218 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:39.105368 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48bc0da-aa1c-4e84-9b08-e4590ba9e218 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:39.230675 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1380/2732] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:06:39 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:06:39.231850 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab7492-0b0f-4d26-a503-bb66d52d7c8b admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:39.242901 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab7492-0b0f-4d26-a503-bb66d52d7c8b admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:39.306343 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa09f9d-bc99-494d-ab15-cff84f8e87a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:39.307017 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa09f9d-bc99-494d-ab15-cff84f8e87a1 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:39.307307 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa09f9d-bc99-494d-ab15-cff84f8e87a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:39.307585 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa09f9d-bc99-494d-ab15-cff84f8e87a1 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:39.308299 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa09f9d-bc99-494d-ab15-cff84f8e87a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:39.310221 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa09f9d-bc99-494d-ab15-cff84f8e87a1 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:39.403848 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1353/2733] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:06:39 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:06:39.408448 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bc0da-aa1c-4e84-9b08-e4590ba9e218 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:39.418691 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bc0da-aa1c-4e84-9b08-e4590ba9e218 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:39.424435 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa543ba9-bc95-430e-97ec-8632b8d3c5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:39.425091 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa543ba9-bc95-430e-97ec-8632b8d3c5b3 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:39.425517 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa543ba9-bc95-430e-97ec-8632b8d3c5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:39.425669 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa543ba9-bc95-430e-97ec-8632b8d3c5b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:39.426351 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa543ba9-bc95-430e-97ec-8632b8d3c5b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:39.428048 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa543ba9-bc95-430e-97ec-8632b8d3c5b3 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:39.438494 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1381/2734] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:06:39.442574 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa09f9d-bc99-494d-ab15-cff84f8e87a1 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:39.452629 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa09f9d-bc99-494d-ab15-cff84f8e87a1 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:39.457260 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15956d-518a-4c6a-98f8-6e47e2b18f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:39.457914 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15956d-518a-4c6a-98f8-6e47e2b18f0b admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:39.458199 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15956d-518a-4c6a-98f8-6e47e2b18f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:39.458475 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15956d-518a-4c6a-98f8-6e47e2b18f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:39.459208 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15956d-518a-4c6a-98f8-6e47e2b18f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:39.460886 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15956d-518a-4c6a-98f8-6e47e2b18f0b admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:39.472008 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1354/2735] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:06:39.476050 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa543ba9-bc95-430e-97ec-8632b8d3c5b3 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:39.487283 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa543ba9-bc95-430e-97ec-8632b8d3c5b3 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:39.492293 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec43b3-ca09-441a-b5f3-6b5ecf1f2d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:39.493171 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec43b3-ca09-441a-b5f3-6b5ecf1f2d3d admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:39.493524 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec43b3-ca09-441a-b5f3-6b5ecf1f2d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:39.493796 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec43b3-ca09-441a-b5f3-6b5ecf1f2d3d admin admin] PATH_INFO: `/v3/projects/6968ca8e3161483383b1e5241dffd16b/users/cdf442a250dc4dd98766e021ae3d2dff/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:39.510714 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec43b3-ca09-441a-b5f3-6b5ecf1f2d3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6968ca8e3161483383b1e5241dffd16b, user_id=cdf442a250dc4dd98766e021ae3d2dff, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:39.513628 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec43b3-ca09-441a-b5f3-6b5ecf1f2d3d admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:39.607417 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1382/2736] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:06:39 2022] PUT /identity/v3/projects/6968ca8e3161483383b1e5241dffd16b/users/cdf442a250dc4dd98766e021ae3d2dff/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:06:39.618919 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60138e7-8d11-42b9-98d1-07eed88f3c6b None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:39.619210 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60138e7-8d11-42b9-98d1-07eed88f3c6b None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:39.619490 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60138e7-8d11-42b9-98d1-07eed88f3c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:39.646006 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-b60138e7-8d11-42b9-98d1-07eed88f3c6b None None] MFA Rules not processed for user `cdf442a250dc4dd98766e021ae3d2dff`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:06:39.647198 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-b60138e7-8d11-42b9-98d1-07eed88f3c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:39.694623 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:06:39.714610 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1355/2737] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:06:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:06:39.720193 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec43b3-ca09-441a-b5f3-6b5ecf1f2d3d admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:39.765280 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:06:39.781750 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec43b3-ca09-441a-b5f3-6b5ecf1f2d3d admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:39.786496 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa841f-79d9-4860-a8ab-bbef35fa25d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:39.787152 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa841f-79d9-4860-a8ab-bbef35fa25d5 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:39.787433 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa841f-79d9-4860-a8ab-bbef35fa25d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:39.787742 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa841f-79d9-4860-a8ab-bbef35fa25d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:39.788515 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa841f-79d9-4860-a8ab-bbef35fa25d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:39.790409 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa841f-79d9-4860-a8ab-bbef35fa25d5 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:39.896139 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1383/2738] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:06:39 2022] POST /identity/v3/projects => generated 377 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:06:39.899990 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60138e7-8d11-42b9-98d1-07eed88f3c6b None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:39.911879 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60138e7-8d11-42b9-98d1-07eed88f3c6b None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:39.969022 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f957ee8-b83a-4147-b67e-145af1275b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:39.969717 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f957ee8-b83a-4147-b67e-145af1275b41 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:39.969857 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f957ee8-b83a-4147-b67e-145af1275b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:39.970126 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f957ee8-b83a-4147-b67e-145af1275b41 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:39.970811 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f957ee8-b83a-4147-b67e-145af1275b41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:39.972886 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f957ee8-b83a-4147-b67e-145af1275b41 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:40.055550 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1356/2739] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:06:39 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:06:40.059545 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa841f-79d9-4860-a8ab-bbef35fa25d5 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:40.070211 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa841f-79d9-4860-a8ab-bbef35fa25d5 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:40.074979 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897355aa-281a-4fec-9dea-15ab9c055d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:40.075659 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897355aa-281a-4fec-9dea-15ab9c055d76 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:40.075947 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897355aa-281a-4fec-9dea-15ab9c055d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:40.076224 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897355aa-281a-4fec-9dea-15ab9c055d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:40.077070 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897355aa-281a-4fec-9dea-15ab9c055d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:40.079301 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897355aa-281a-4fec-9dea-15ab9c055d76 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:40.090940 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1384/2740] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:06:40.095718 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f957ee8-b83a-4147-b67e-145af1275b41 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:40.106418 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f957ee8-b83a-4147-b67e-145af1275b41 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:40.111130 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782b493-642f-4522-acd2-59dba4c09460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:40.111790 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782b493-642f-4522-acd2-59dba4c09460 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:40.112074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782b493-642f-4522-acd2-59dba4c09460 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:40.112351 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782b493-642f-4522-acd2-59dba4c09460 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:40.113182 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782b493-642f-4522-acd2-59dba4c09460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:40.114780 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782b493-642f-4522-acd2-59dba4c09460 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:40.125091 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1357/2741] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:06:40.129191 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897355aa-281a-4fec-9dea-15ab9c055d76 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:40.139102 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897355aa-281a-4fec-9dea-15ab9c055d76 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:40.144283 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9933a5b-a8e9-4715-b9a2-cc2e3c265b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:40.145160 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9933a5b-a8e9-4715-b9a2-cc2e3c265b20 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:40.145445 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9933a5b-a8e9-4715-b9a2-cc2e3c265b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:40.145723 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9933a5b-a8e9-4715-b9a2-cc2e3c265b20 admin admin] PATH_INFO: `/v3/projects/202d4234af624b1b9030363d3d7829a0/users/f01fc7799f3842219ae13dd5b6eb003a/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:40.160776 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9933a5b-a8e9-4715-b9a2-cc2e3c265b20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=202d4234af624b1b9030363d3d7829a0, user_id=f01fc7799f3842219ae13dd5b6eb003a, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:40.163413 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9933a5b-a8e9-4715-b9a2-cc2e3c265b20 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:40.251010 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1385/2742] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:06:40 2022] PUT /identity/v3/projects/202d4234af624b1b9030363d3d7829a0/users/f01fc7799f3842219ae13dd5b6eb003a/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:06:40.261998 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e56f9-6bd8-475b-85cb-1e5e34c928b3 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:40.262309 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e56f9-6bd8-475b-85cb-1e5e34c928b3 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:40.262588 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e56f9-6bd8-475b-85cb-1e5e34c928b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:40.291565 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-734e56f9-6bd8-475b-85cb-1e5e34c928b3 None None] MFA Rules not processed for user `f01fc7799f3842219ae13dd5b6eb003a`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:06:40.292941 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-734e56f9-6bd8-475b-85cb-1e5e34c928b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:40.361380 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1358/2743] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:06:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:06:40.365982 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9933a5b-a8e9-4715-b9a2-cc2e3c265b20 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:40.436200 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9933a5b-a8e9-4715-b9a2-cc2e3c265b20 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:40.441863 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2c46c-6e4b-4863-81ca-e6db291ab27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:40.442572 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2c46c-6e4b-4863-81ca-e6db291ab27c admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:40.442863 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2c46c-6e4b-4863-81ca-e6db291ab27c admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:40.443146 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2c46c-6e4b-4863-81ca-e6db291ab27c admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:40.443887 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2c46c-6e4b-4863-81ca-e6db291ab27c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:40.445906 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2c46c-6e4b-4863-81ca-e6db291ab27c admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:40.554415 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1386/2744] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:06:40 2022] POST /identity/v3/projects => generated 375 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:06:40.555760 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e56f9-6bd8-475b-85cb-1e5e34c928b3 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:40.567870 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e56f9-6bd8-475b-85cb-1e5e34c928b3 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:40.619704 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:06:40.627266 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2add2-ba22-4f8b-8689-b86f565d6c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:40.627970 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2add2-ba22-4f8b-8689-b86f565d6c46 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:40.628256 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2add2-ba22-4f8b-8689-b86f565d6c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:40.628530 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2add2-ba22-4f8b-8689-b86f565d6c46 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:40.629212 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2add2-ba22-4f8b-8689-b86f565d6c46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:40.631185 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2add2-ba22-4f8b-8689-b86f565d6c46 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:40.762266 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1359/2745] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:06:40 2022] POST /identity/v3/users => generated 294 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:06:40.766469 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2c46c-6e4b-4863-81ca-e6db291ab27c admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:40.776721 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2c46c-6e4b-4863-81ca-e6db291ab27c admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:40.781756 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb84e80-2eb5-4c5d-8fc6-6b5ae319772f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:40.782413 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb84e80-2eb5-4c5d-8fc6-6b5ae319772f admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:40.782695 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb84e80-2eb5-4c5d-8fc6-6b5ae319772f admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:40.782972 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb84e80-2eb5-4c5d-8fc6-6b5ae319772f admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:40.783721 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb84e80-2eb5-4c5d-8fc6-6b5ae319772f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:40.788938 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb84e80-2eb5-4c5d-8fc6-6b5ae319772f admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:40.797340 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1387/2746] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:06:40.801610 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2add2-ba22-4f8b-8689-b86f565d6c46 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:40.815316 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2add2-ba22-4f8b-8689-b86f565d6c46 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:40.817131 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648d9c4-c0f4-4b7d-b67e-5bfe0114318d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:40.818066 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648d9c4-c0f4-4b7d-b67e-5bfe0114318d admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:40.818357 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648d9c4-c0f4-4b7d-b67e-5bfe0114318d admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:40.818632 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648d9c4-c0f4-4b7d-b67e-5bfe0114318d admin admin] PATH_INFO: `/v3/projects/3b21be0941cf44b2a4fe57c8298c08cd/users/f38d6f8ab18a40aaaa5d48c548c9028d/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:40.833556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648d9c4-c0f4-4b7d-b67e-5bfe0114318d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b21be0941cf44b2a4fe57c8298c08cd, user_id=f38d6f8ab18a40aaaa5d48c548c9028d, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:40.836254 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648d9c4-c0f4-4b7d-b67e-5bfe0114318d admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:40.953060 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1360/2747] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:06:40 2022] PUT /identity/v3/projects/3b21be0941cf44b2a4fe57c8298c08cd/users/f38d6f8ab18a40aaaa5d48c548c9028d/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:06:40.957210 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb84e80-2eb5-4c5d-8fc6-6b5ae319772f admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:40.967098 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb84e80-2eb5-4c5d-8fc6-6b5ae319772f admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:41.029193 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b8f9e-9a44-4603-9940-0c4c6c185a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:41.030034 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b8f9e-9a44-4603-9940-0c4c6c185a30 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:41.030280 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b8f9e-9a44-4603-9940-0c4c6c185a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:41.031181 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b8f9e-9a44-4603-9940-0c4c6c185a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:41.031948 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b8f9e-9a44-4603-9940-0c4c6c185a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:41.033624 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b8f9e-9a44-4603-9940-0c4c6c185a30 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:41.043883 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1388/2748] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:06:41.048936 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648d9c4-c0f4-4b7d-b67e-5bfe0114318d admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:41.059392 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648d9c4-c0f4-4b7d-b67e-5bfe0114318d admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:41.064240 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb75a3f-cfb0-4c7f-ad5f-c3a8422c97fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:41.064972 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb75a3f-cfb0-4c7f-ad5f-c3a8422c97fd admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:41.065252 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb75a3f-cfb0-4c7f-ad5f-c3a8422c97fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:41.065573 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb75a3f-cfb0-4c7f-ad5f-c3a8422c97fd admin admin] PATH_INFO: `/v3/projects/3b21be0941cf44b2a4fe57c8298c08cd/users/f38d6f8ab18a40aaaa5d48c548c9028d/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:41.067455 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb75a3f-cfb0-4c7f-ad5f-c3a8422c97fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b21be0941cf44b2a4fe57c8298c08cd, user_id=f38d6f8ab18a40aaaa5d48c548c9028d, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:41.070093 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb75a3f-cfb0-4c7f-ad5f-c3a8422c97fd admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:41.080643 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1361/2749] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:06:41 2022] PUT /identity/v3/projects/3b21be0941cf44b2a4fe57c8298c08cd/users/f38d6f8ab18a40aaaa5d48c548c9028d/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:06:41.090641 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1b40a-7fac-4393-8ef9-9a0c94fe3120 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:41.095973 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1b40a-7fac-4393-8ef9-9a0c94fe3120 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:41.095973 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1b40a-7fac-4393-8ef9-9a0c94fe3120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:41.098802 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:06:41.119408 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-7cb1b40a-7fac-4393-8ef9-9a0c94fe3120 None None] MFA Rules not processed for user `f38d6f8ab18a40aaaa5d48c548c9028d`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:06:41.120723 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-7cb1b40a-7fac-4393-8ef9-9a0c94fe3120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:41.190972 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1389/2750] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:06:41 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:06:41.202577 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb75a3f-cfb0-4c7f-ad5f-c3a8422c97fd admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:41.204306 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-5cb75a3f-cfb0-4c7f-ad5f-c3a8422c97fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:41.262198 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb75a3f-cfb0-4c7f-ad5f-c3a8422c97fd admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:41.266047 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f5d2b-722d-4297-b6d0-13cc8057780a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:41.266681 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f5d2b-722d-4297-b6d0-13cc8057780a service cinder] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:41.266962 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f5d2b-722d-4297-b6d0-13cc8057780a service cinder] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:41.267236 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f5d2b-722d-4297-b6d0-13cc8057780a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:41.325262 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f5d2b-722d-4297-b6d0-13cc8057780a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:41.326749 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f5d2b-722d-4297-b6d0-13cc8057780a service cinder] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:41.336731 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1362/2751] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:06:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 16:06:43.353491 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1b40a-7fac-4393-8ef9-9a0c94fe3120 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:43.365349 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1b40a-7fac-4393-8ef9-9a0c94fe3120 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:43.369196 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc553bf6-3310-4296-9b94-4cd0b169d300 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:43.369838 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc553bf6-3310-4296-9b94-4cd0b169d300 service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:43.370125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc553bf6-3310-4296-9b94-4cd0b169d300 service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:43.370403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc553bf6-3310-4296-9b94-4cd0b169d300 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:43.428253 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc553bf6-3310-4296-9b94-4cd0b169d300 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:43.429967 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc553bf6-3310-4296-9b94-4cd0b169d300 service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:43.439031 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1390/2752] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:06:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:06:45.197357 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f5d2b-722d-4297-b6d0-13cc8057780a service cinder] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:45.206026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f5d2b-722d-4297-b6d0-13cc8057780a service cinder] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:45.209800 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7c1cd-c6f0-47b6-a0a2-df37d093bf35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:45.210447 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7c1cd-c6f0-47b6-a0a2-df37d093bf35 service cinder] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:45.210728 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7c1cd-c6f0-47b6-a0a2-df37d093bf35 service cinder] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:45.211004 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7c1cd-c6f0-47b6-a0a2-df37d093bf35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:45.220824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7c1cd-c6f0-47b6-a0a2-df37d093bf35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:45.222250 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7c1cd-c6f0-47b6-a0a2-df37d093bf35 service cinder] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:45.231685 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1363/2753] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:06:45 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:06:50.037219 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc553bf6-3310-4296-9b94-4cd0b169d300 service cinder] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:50.130921 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=100 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:06:50.143336 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc553bf6-3310-4296-9b94-4cd0b169d300 service cinder] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:50.147957 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb4ff0-8876-490c-9cbb-d3bf127c088a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:50.148819 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb4ff0-8876-490c-9cbb-d3bf127c088a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:50.150363 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb4ff0-8876-490c-9cbb-d3bf127c088a admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:50.150363 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb4ff0-8876-490c-9cbb-d3bf127c088a admin admin] PATH_INFO: `/v3/users/cdf442a250dc4dd98766e021ae3d2dff` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:50.150708 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb4ff0-8876-490c-9cbb-d3bf127c088a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdf442a250dc4dd98766e021ae3d2dff)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:50.152692 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb4ff0-8876-490c-9cbb-d3bf127c088a admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:50.383936 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-feeb4ff0-8876-490c-9cbb-d3bf127c088a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdf442a250dc4dd98766e021ae3d2dff'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:50.384590 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-feeb4ff0-8876-490c-9cbb-d3bf127c088a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdf442a250dc4dd98766e021ae3d2dff'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:50.385238 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-feeb4ff0-8876-490c-9cbb-d3bf127c088a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdf442a250dc4dd98766e021ae3d2dff'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:50.455593 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-feeb4ff0-8876-490c-9cbb-d3bf127c088a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdf442a250dc4dd98766e021ae3d2dff'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:50.466287 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-feeb4ff0-8876-490c-9cbb-d3bf127c088a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdf442a250dc4dd98766e021ae3d2dff'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:50.488359 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1391/2754] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:06:50 2022] DELETE /identity/v3/users/cdf442a250dc4dd98766e021ae3d2dff => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:06:50.493369 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40097622-6c5b-4476-883a-6ba8092c9ee4 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:50.494236 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40097622-6c5b-4476-883a-6ba8092c9ee4 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:50.494236 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40097622-6c5b-4476-883a-6ba8092c9ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:50.550577 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-40097622-6c5b-4476-883a-6ba8092c9ee4 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:06:50.552004 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-40097622-6c5b-4476-883a-6ba8092c9ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:50.569167 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:06:50.610535 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1364/2755] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:06:50.620439 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb4ff0-8876-490c-9cbb-d3bf127c088a admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:50.622047 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-feeb4ff0-8876-490c-9cbb-d3bf127c088a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:50.719298 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb4ff0-8876-490c-9cbb-d3bf127c088a admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:50.722996 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b5bab-3976-405a-9f7e-8d91d07be998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:50.723801 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b5bab-3976-405a-9f7e-8d91d07be998 service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:50.724091 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b5bab-3976-405a-9f7e-8d91d07be998 service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:50.724372 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b5bab-3976-405a-9f7e-8d91d07be998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:50.734260 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b5bab-3976-405a-9f7e-8d91d07be998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:50.735728 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b5bab-3976-405a-9f7e-8d91d07be998 service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:50.745190 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1392/2756] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:06:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:06:51.148703 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40097622-6c5b-4476-883a-6ba8092c9ee4 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:51.150173 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-40097622-6c5b-4476-883a-6ba8092c9ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:51.163615 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40097622-6c5b-4476-883a-6ba8092c9ee4 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:51.168384 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e117fc9-471e-4baa-ba26-e3c6db76b8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:51.169272 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e117fc9-471e-4baa-ba26-e3c6db76b8d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:51.169537 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e117fc9-471e-4baa-ba26-e3c6db76b8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:51.169811 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e117fc9-471e-4baa-ba26-e3c6db76b8d0 admin admin] PATH_INFO: `/v3/projects/6968ca8e3161483383b1e5241dffd16b` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:51.171355 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e117fc9-471e-4baa-ba26-e3c6db76b8d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6968ca8e3161483383b1e5241dffd16b)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:51.173463 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e117fc9-471e-4baa-ba26-e3c6db76b8d0 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:51.319564 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-2e117fc9-471e-4baa-ba26-e3c6db76b8d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6968ca8e3161483383b1e5241dffd16b', 'request_id': 'req-2e117fc9-471e-4baa-ba26-e3c6db76b8d0'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:51.325047 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-2e117fc9-471e-4baa-ba26-e3c6db76b8d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6968ca8e3161483383b1e5241dffd16b', 'request_id': 'req-2e117fc9-471e-4baa-ba26-e3c6db76b8d0'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:51.400830 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-2e117fc9-471e-4baa-ba26-e3c6db76b8d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6968ca8e3161483383b1e5241dffd16b', 'request_id': 'req-2e117fc9-471e-4baa-ba26-e3c6db76b8d0'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:51.412556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-2e117fc9-471e-4baa-ba26-e3c6db76b8d0 admin admin] The token cache is being invalidate because project 6968ca8e3161483383b1e5241dffd16b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:06:51.416624 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-2e117fc9-471e-4baa-ba26-e3c6db76b8d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:51.416624 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-2e117fc9-471e-4baa-ba26-e3c6db76b8d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:51.416624 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1365/2757] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:06:51 2022] DELETE /identity/v3/projects/6968ca8e3161483383b1e5241dffd16b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:06:51.419071 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b5bab-3976-405a-9f7e-8d91d07be998 service neutron] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:51.430385 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b5bab-3976-405a-9f7e-8d91d07be998 service neutron] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:51.459979 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:06:51.486949 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffaac03-b6b2-417e-88b9-cc2a3a287332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:51.487845 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaac03-b6b2-417e-88b9-cc2a3a287332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:51.488133 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaac03-b6b2-417e-88b9-cc2a3a287332 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:51.488406 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaac03-b6b2-417e-88b9-cc2a3a287332 admin admin] PATH_INFO: `/v3/users/f01fc7799f3842219ae13dd5b6eb003a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:51.489572 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffaac03-b6b2-417e-88b9-cc2a3a287332 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f01fc7799f3842219ae13dd5b6eb003a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:51.491588 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffaac03-b6b2-417e-88b9-cc2a3a287332 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:51.692541 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-4ffaac03-b6b2-417e-88b9-cc2a3a287332 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f01fc7799f3842219ae13dd5b6eb003a'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:51.693249 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-4ffaac03-b6b2-417e-88b9-cc2a3a287332 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f01fc7799f3842219ae13dd5b6eb003a'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:51.693996 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-4ffaac03-b6b2-417e-88b9-cc2a3a287332 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f01fc7799f3842219ae13dd5b6eb003a'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:51.786387 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-4ffaac03-b6b2-417e-88b9-cc2a3a287332 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f01fc7799f3842219ae13dd5b6eb003a'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:51.793860 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-4ffaac03-b6b2-417e-88b9-cc2a3a287332 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f01fc7799f3842219ae13dd5b6eb003a'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:51.813352 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1393/2758] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:06:51 2022] DELETE /identity/v3/users/f01fc7799f3842219ae13dd5b6eb003a => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:06:52.285903 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e117fc9-471e-4baa-ba26-e3c6db76b8d0 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:52.287458 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-2e117fc9-471e-4baa-ba26-e3c6db76b8d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:52.302025 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e117fc9-471e-4baa-ba26-e3c6db76b8d0 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:52.370464 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099b4c5-84e6-4626-b0f3-87bd997d3676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:52.371324 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099b4c5-84e6-4626-b0f3-87bd997d3676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:52.371616 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099b4c5-84e6-4626-b0f3-87bd997d3676 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:52.371926 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099b4c5-84e6-4626-b0f3-87bd997d3676 admin admin] PATH_INFO: `/v3/projects/202d4234af624b1b9030363d3d7829a0` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:52.373144 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1099b4c5-84e6-4626-b0f3-87bd997d3676 admin admin] RBAC: Authorizing `identity:delete_project(project_id=202d4234af624b1b9030363d3d7829a0)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:52.375325 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1099b4c5-84e6-4626-b0f3-87bd997d3676 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:52.488340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:06:52.489484 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-1099b4c5-84e6-4626-b0f3-87bd997d3676 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '202d4234af624b1b9030363d3d7829a0', 'request_id': 'req-1099b4c5-84e6-4626-b0f3-87bd997d3676'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:52.494701 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-1099b4c5-84e6-4626-b0f3-87bd997d3676 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '202d4234af624b1b9030363d3d7829a0', 'request_id': 'req-1099b4c5-84e6-4626-b0f3-87bd997d3676'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:52.612709 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-1099b4c5-84e6-4626-b0f3-87bd997d3676 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '202d4234af624b1b9030363d3d7829a0', 'request_id': 'req-1099b4c5-84e6-4626-b0f3-87bd997d3676'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:52.625131 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-1099b4c5-84e6-4626-b0f3-87bd997d3676 admin admin] The token cache is being invalidate because project 202d4234af624b1b9030363d3d7829a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:06:52.625678 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-1099b4c5-84e6-4626-b0f3-87bd997d3676 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:52.626779 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-1099b4c5-84e6-4626-b0f3-87bd997d3676 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:52.628420 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1366/2759] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:06:52 2022] DELETE /identity/v3/projects/202d4234af624b1b9030363d3d7829a0 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:06:52.632354 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffaac03-b6b2-417e-88b9-cc2a3a287332 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:52.633803 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-4ffaac03-b6b2-417e-88b9-cc2a3a287332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:52.647676 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffaac03-b6b2-417e-88b9-cc2a3a287332 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:52.705858 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5afc6-40c3-45e1-ba20-c95d150e078b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:52.706739 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5afc6-40c3-45e1-ba20-c95d150e078b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:52.707028 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5afc6-40c3-45e1-ba20-c95d150e078b admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:52.707310 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5afc6-40c3-45e1-ba20-c95d150e078b admin admin] PATH_INFO: `/v3/users/f38d6f8ab18a40aaaa5d48c548c9028d` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:52.708546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5afc6-40c3-45e1-ba20-c95d150e078b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f38d6f8ab18a40aaaa5d48c548c9028d)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:52.710477 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5afc6-40c3-45e1-ba20-c95d150e078b admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:52.932782 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-beb5afc6-40c3-45e1-ba20-c95d150e078b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f38d6f8ab18a40aaaa5d48c548c9028d'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:52.933460 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-beb5afc6-40c3-45e1-ba20-c95d150e078b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f38d6f8ab18a40aaaa5d48c548c9028d'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:52.934071 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-beb5afc6-40c3-45e1-ba20-c95d150e078b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f38d6f8ab18a40aaaa5d48c548c9028d'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:53.001273 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-beb5afc6-40c3-45e1-ba20-c95d150e078b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f38d6f8ab18a40aaaa5d48c548c9028d'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:53.002739 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:06:53.009233 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-beb5afc6-40c3-45e1-ba20-c95d150e078b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f38d6f8ab18a40aaaa5d48c548c9028d'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:53.026812 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1394/2760] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:06:52 2022] DELETE /identity/v3/users/f38d6f8ab18a40aaaa5d48c548c9028d => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:06:53.466089 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099b4c5-84e6-4626-b0f3-87bd997d3676 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:53.467567 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-1099b4c5-84e6-4626-b0f3-87bd997d3676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:53.480932 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099b4c5-84e6-4626-b0f3-87bd997d3676 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:53.540132 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90badb93-6eec-4aa7-a3e4-c28de0b80bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:53.540990 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90badb93-6eec-4aa7-a3e4-c28de0b80bfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:53.541274 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90badb93-6eec-4aa7-a3e4-c28de0b80bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:53.541548 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90badb93-6eec-4aa7-a3e4-c28de0b80bfc admin admin] PATH_INFO: `/v3/projects/3b21be0941cf44b2a4fe57c8298c08cd` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:53.542747 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90badb93-6eec-4aa7-a3e4-c28de0b80bfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b21be0941cf44b2a4fe57c8298c08cd)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:53.544717 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90badb93-6eec-4aa7-a3e4-c28de0b80bfc admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:53.699106 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-90badb93-6eec-4aa7-a3e4-c28de0b80bfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b21be0941cf44b2a4fe57c8298c08cd', 'request_id': 'req-90badb93-6eec-4aa7-a3e4-c28de0b80bfc'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:53.705019 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-90badb93-6eec-4aa7-a3e4-c28de0b80bfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b21be0941cf44b2a4fe57c8298c08cd', 'request_id': 'req-90badb93-6eec-4aa7-a3e4-c28de0b80bfc'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:53.781626 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-90badb93-6eec-4aa7-a3e4-c28de0b80bfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b21be0941cf44b2a4fe57c8298c08cd', 'request_id': 'req-90badb93-6eec-4aa7-a3e4-c28de0b80bfc'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:53.793647 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-90badb93-6eec-4aa7-a3e4-c28de0b80bfc admin admin] The token cache is being invalidate because project 3b21be0941cf44b2a4fe57c8298c08cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:06:53.793935 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-90badb93-6eec-4aa7-a3e4-c28de0b80bfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:53.794581 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-90badb93-6eec-4aa7-a3e4-c28de0b80bfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:06:53.797083 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1367/2761] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:06:53 2022] DELETE /identity/v3/projects/3b21be0941cf44b2a4fe57c8298c08cd => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:06:53.801930 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e22df-621b-4ca8-9e31-1fe193d72bb3 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:53.802401 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e22df-621b-4ca8-9e31-1fe193d72bb3 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:53.802517 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e22df-621b-4ca8-9e31-1fe193d72bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:53.839992 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-b55e22df-621b-4ca8-9e31-1fe193d72bb3 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:06:53.841215 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-b55e22df-621b-4ca8-9e31-1fe193d72bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:53.901472 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1395/2762] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:06:53.912281 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54593d-efcb-4328-9335-9fb139e186a2 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:53.912573 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54593d-efcb-4328-9335-9fb139e186a2 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:53.912852 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54593d-efcb-4328-9335-9fb139e186a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:53.933187 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-3a54593d-efcb-4328-9335-9fb139e186a2 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:06:53.934397 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-3a54593d-efcb-4328-9335-9fb139e186a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:53.942756 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1368/2763] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:06:53.947118 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e22df-621b-4ca8-9e31-1fe193d72bb3 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:53.957307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e22df-621b-4ca8-9e31-1fe193d72bb3 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:53.962029 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281447a-c707-4a71-a1bc-ace7d0ce2eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:53.962683 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281447a-c707-4a71-a1bc-ace7d0ce2eda admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:53.962999 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281447a-c707-4a71-a1bc-ace7d0ce2eda admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:53.963284 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281447a-c707-4a71-a1bc-ace7d0ce2eda admin admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:53.964034 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281447a-c707-4a71-a1bc-ace7d0ce2eda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:06:53.964346 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281447a-c707-4a71-a1bc-ace7d0ce2eda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:53.966209 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281447a-c707-4a71-a1bc-ace7d0ce2eda admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:53.978864 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1396/2764] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 16:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:06:53.984301 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54593d-efcb-4328-9335-9fb139e186a2 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:53.993756 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54593d-efcb-4328-9335-9fb139e186a2 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:53.998657 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f241bac-5b45-4336-9b5b-315c9ead3303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:53.999333 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f241bac-5b45-4336-9b5b-315c9ead3303 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:53.999639 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f241bac-5b45-4336-9b5b-315c9ead3303 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:53.999946 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f241bac-5b45-4336-9b5b-315c9ead3303 admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:54.000633 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f241bac-5b45-4336-9b5b-315c9ead3303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:54.002527 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f241bac-5b45-4336-9b5b-315c9ead3303 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:54.094408 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1369/2765] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:06:53 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:06:54.098601 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281447a-c707-4a71-a1bc-ace7d0ce2eda admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:54.108809 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281447a-c707-4a71-a1bc-ace7d0ce2eda admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:54.165510 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348cdc15-a24d-402e-b150-44162710a908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:54.166175 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cdc15-a24d-402e-b150-44162710a908 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:54.166458 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cdc15-a24d-402e-b150-44162710a908 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:54.166736 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cdc15-a24d-402e-b150-44162710a908 admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:54.167428 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348cdc15-a24d-402e-b150-44162710a908 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:54.169437 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348cdc15-a24d-402e-b150-44162710a908 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:54.271032 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1397/2766] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:06:54 2022] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:06:54.275145 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f241bac-5b45-4336-9b5b-315c9ead3303 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:54.286138 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f241bac-5b45-4336-9b5b-315c9ead3303 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:54.290798 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691be341-fc6c-4f0c-8876-c5b31d23b0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:54.291456 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691be341-fc6c-4f0c-8876-c5b31d23b0de admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:54.291770 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691be341-fc6c-4f0c-8876-c5b31d23b0de admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:54.292044 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691be341-fc6c-4f0c-8876-c5b31d23b0de admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:54.292767 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691be341-fc6c-4f0c-8876-c5b31d23b0de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:54.294359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691be341-fc6c-4f0c-8876-c5b31d23b0de admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:54.305347 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1370/2767] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:06:54.309382 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348cdc15-a24d-402e-b150-44162710a908 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:54.319733 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348cdc15-a24d-402e-b150-44162710a908 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:54.324634 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288968a8-81a9-4e90-83a6-6243bb1dc326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:54.325307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288968a8-81a9-4e90-83a6-6243bb1dc326 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:54.325594 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288968a8-81a9-4e90-83a6-6243bb1dc326 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:54.325874 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288968a8-81a9-4e90-83a6-6243bb1dc326 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:54.326608 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288968a8-81a9-4e90-83a6-6243bb1dc326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:54.328944 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288968a8-81a9-4e90-83a6-6243bb1dc326 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:54.339218 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1398/2768] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:06:54.344008 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691be341-fc6c-4f0c-8876-c5b31d23b0de admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:54.354035 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691be341-fc6c-4f0c-8876-c5b31d23b0de admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:54.358693 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e32c5-94a8-4cfb-b002-fb8d2b1be22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:54.359568 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e32c5-94a8-4cfb-b002-fb8d2b1be22b admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:54.359878 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e32c5-94a8-4cfb-b002-fb8d2b1be22b admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:54.360156 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e32c5-94a8-4cfb-b002-fb8d2b1be22b admin admin] PATH_INFO: `/v3/projects/89811f2de33e445cbe7264d225f0fef7/users/0ff4bcddf6324fe58b933409d684e58a/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:54.375066 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e32c5-94a8-4cfb-b002-fb8d2b1be22b admin admin] RBAC: Authorizing `identity:create_grant(project_id=89811f2de33e445cbe7264d225f0fef7, user_id=0ff4bcddf6324fe58b933409d684e58a, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:54.377748 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e32c5-94a8-4cfb-b002-fb8d2b1be22b admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:54.473059 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1371/2769] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:06:54 2022] PUT /identity/v3/projects/89811f2de33e445cbe7264d225f0fef7/users/0ff4bcddf6324fe58b933409d684e58a/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:06:54.484324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57412ec-5642-4adb-9420-e3e413964a83 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:54.484624 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57412ec-5642-4adb-9420-e3e413964a83 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:54.484923 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57412ec-5642-4adb-9420-e3e413964a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:54.513990 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-e57412ec-5642-4adb-9420-e3e413964a83 None None] MFA Rules not processed for user `0ff4bcddf6324fe58b933409d684e58a`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:06:54.516990 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-e57412ec-5642-4adb-9420-e3e413964a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:54.526773 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:06:54.581783 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1399/2770] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:06:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:06:54.586432 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e32c5-94a8-4cfb-b002-fb8d2b1be22b admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:54.590922 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:06:54.650098 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e32c5-94a8-4cfb-b002-fb8d2b1be22b admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:54.655067 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb1361-3ac5-4282-bfc5-7907be6257c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:54.655755 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb1361-3ac5-4282-bfc5-7907be6257c0 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:54.656047 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb1361-3ac5-4282-bfc5-7907be6257c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:54.656326 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb1361-3ac5-4282-bfc5-7907be6257c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:54.657021 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb1361-3ac5-4282-bfc5-7907be6257c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:54.658972 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb1361-3ac5-4282-bfc5-7907be6257c0 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:54.745750 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1372/2771] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:06:54 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:06:54.750577 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57412ec-5642-4adb-9420-e3e413964a83 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:54.761404 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57412ec-5642-4adb-9420-e3e413964a83 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:54.823824 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd9463-9543-487d-a722-c95364100508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:54.824751 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd9463-9543-487d-a722-c95364100508 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:54.825043 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd9463-9543-487d-a722-c95364100508 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:54.825325 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd9463-9543-487d-a722-c95364100508 admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:54.826018 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd9463-9543-487d-a722-c95364100508 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:54.828579 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd9463-9543-487d-a722-c95364100508 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:54.950291 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1400/2772] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:06:54 2022] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:06:54.956391 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb1361-3ac5-4282-bfc5-7907be6257c0 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:54.967234 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb1361-3ac5-4282-bfc5-7907be6257c0 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:54.972479 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70be99-7946-41b8-b673-5b9630eaa744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:54.973128 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70be99-7946-41b8-b673-5b9630eaa744 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:54.973411 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70be99-7946-41b8-b673-5b9630eaa744 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:54.973684 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70be99-7946-41b8-b673-5b9630eaa744 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:54.974403 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70be99-7946-41b8-b673-5b9630eaa744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:54.976033 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70be99-7946-41b8-b673-5b9630eaa744 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:54.986585 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1373/2773] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:06:54.990557 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd9463-9543-487d-a722-c95364100508 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:55.000559 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd9463-9543-487d-a722-c95364100508 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:55.005134 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40951546-8c1d-4557-b6b4-4f848d161d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:55.005784 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40951546-8c1d-4557-b6b4-4f848d161d29 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:55.006069 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40951546-8c1d-4557-b6b4-4f848d161d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:55.006347 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40951546-8c1d-4557-b6b4-4f848d161d29 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:55.007064 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40951546-8c1d-4557-b6b4-4f848d161d29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:55.008684 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40951546-8c1d-4557-b6b4-4f848d161d29 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:55.019277 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1401/2774] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:06:55.023277 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70be99-7946-41b8-b673-5b9630eaa744 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:55.033748 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70be99-7946-41b8-b673-5b9630eaa744 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:55.038182 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3d4d5-4213-4777-b171-0bdf96b99d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:55.039063 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3d4d5-4213-4777-b171-0bdf96b99d5d admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:55.039345 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3d4d5-4213-4777-b171-0bdf96b99d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:55.039643 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3d4d5-4213-4777-b171-0bdf96b99d5d admin admin] PATH_INFO: `/v3/projects/f0c0676d3fc34b3eb82ce8479adb6f59/users/d68ba7889dee41089975623c70aaf8e5/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:55.054069 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3d4d5-4213-4777-b171-0bdf96b99d5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0c0676d3fc34b3eb82ce8479adb6f59, user_id=d68ba7889dee41089975623c70aaf8e5, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:55.056741 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3d4d5-4213-4777-b171-0bdf96b99d5d admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:55.135416 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1374/2775] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:06:55 2022] PUT /identity/v3/projects/f0c0676d3fc34b3eb82ce8479adb6f59/users/d68ba7889dee41089975623c70aaf8e5/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:06:55.146275 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64731e-72f3-4d58-b841-d8cbcc002373 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:55.146568 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64731e-72f3-4d58-b841-d8cbcc002373 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:55.146850 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64731e-72f3-4d58-b841-d8cbcc002373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:55.174007 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-1b64731e-72f3-4d58-b841-d8cbcc002373 None None] MFA Rules not processed for user `d68ba7889dee41089975623c70aaf8e5`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:06:55.175210 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-1b64731e-72f3-4d58-b841-d8cbcc002373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:55.241436 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1402/2776] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:06:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:06:55.246215 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3d4d5-4213-4777-b171-0bdf96b99d5d admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:55.309471 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3d4d5-4213-4777-b171-0bdf96b99d5d admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:55.314266 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23769056-5172-4d53-a9e0-1f75c623ab89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:55.314921 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23769056-5172-4d53-a9e0-1f75c623ab89 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:55.315200 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23769056-5172-4d53-a9e0-1f75c623ab89 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:55.315481 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23769056-5172-4d53-a9e0-1f75c623ab89 admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:55.316204 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23769056-5172-4d53-a9e0-1f75c623ab89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:55.318978 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23769056-5172-4d53-a9e0-1f75c623ab89 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:55.389001 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1375/2777] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:06:55 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:06:55.393064 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64731e-72f3-4d58-b841-d8cbcc002373 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:55.404142 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64731e-72f3-4d58-b841-d8cbcc002373 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:55.423407 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:06:55.464385 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45a1bd-2dee-483d-80c9-6e97d55868cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:55.465173 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45a1bd-2dee-483d-80c9-6e97d55868cf admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:55.465456 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45a1bd-2dee-483d-80c9-6e97d55868cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:55.465733 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45a1bd-2dee-483d-80c9-6e97d55868cf admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:55.466487 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45a1bd-2dee-483d-80c9-6e97d55868cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:55.469238 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45a1bd-2dee-483d-80c9-6e97d55868cf admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:55.541702 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1403/2778] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:06:55 2022] POST /identity/v3/users => generated 299 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:06:55.546990 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23769056-5172-4d53-a9e0-1f75c623ab89 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:55.557696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23769056-5172-4d53-a9e0-1f75c623ab89 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:55.562573 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413bda7-e80f-405e-acc0-2538eff01d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:55.563158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413bda7-e80f-405e-acc0-2538eff01d42 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:55.563439 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413bda7-e80f-405e-acc0-2538eff01d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:55.563748 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413bda7-e80f-405e-acc0-2538eff01d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:55.564523 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413bda7-e80f-405e-acc0-2538eff01d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:55.566176 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413bda7-e80f-405e-acc0-2538eff01d42 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:55.577299 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1376/2779] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:06:55.581943 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45a1bd-2dee-483d-80c9-6e97d55868cf admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:55.592146 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45a1bd-2dee-483d-80c9-6e97d55868cf admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:55.597755 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbaffb-8d70-4c15-9806-ca89c2952227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:55.598655 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbaffb-8d70-4c15-9806-ca89c2952227 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:55.598939 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbaffb-8d70-4c15-9806-ca89c2952227 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:55.599217 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbaffb-8d70-4c15-9806-ca89c2952227 admin admin] PATH_INFO: `/v3/projects/a5ea92f30df34edeb1d7fa30033a851f/users/a6b458d9bcb44cfca8d96ea34dc2acfc/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:55.614200 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabbaffb-8d70-4c15-9806-ca89c2952227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ea92f30df34edeb1d7fa30033a851f, user_id=a6b458d9bcb44cfca8d96ea34dc2acfc, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:55.616895 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabbaffb-8d70-4c15-9806-ca89c2952227 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:55.683659 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1404/2780] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:06:55 2022] PUT /identity/v3/projects/a5ea92f30df34edeb1d7fa30033a851f/users/a6b458d9bcb44cfca8d96ea34dc2acfc/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:06:55.688722 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413bda7-e80f-405e-acc0-2538eff01d42 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:55.700049 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413bda7-e80f-405e-acc0-2538eff01d42 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:55.725140 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:06:55.758597 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa50cce-ad55-4e2f-9eab-017364d22ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:55.759266 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa50cce-ad55-4e2f-9eab-017364d22ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:55.759576 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa50cce-ad55-4e2f-9eab-017364d22ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:55.760030 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa50cce-ad55-4e2f-9eab-017364d22ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:55.760787 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa50cce-ad55-4e2f-9eab-017364d22ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:55.762548 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa50cce-ad55-4e2f-9eab-017364d22ba2 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:55.773193 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1377/2781] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:06:55.777418 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbaffb-8d70-4c15-9806-ca89c2952227 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:55.787811 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbaffb-8d70-4c15-9806-ca89c2952227 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:55.792636 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f1b4c-d768-49fb-b565-61d49ea910bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:55.793560 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f1b4c-d768-49fb-b565-61d49ea910bf admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:55.793847 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f1b4c-d768-49fb-b565-61d49ea910bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:55.794164 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f1b4c-d768-49fb-b565-61d49ea910bf admin admin] PATH_INFO: `/v3/projects/a5ea92f30df34edeb1d7fa30033a851f/users/a6b458d9bcb44cfca8d96ea34dc2acfc/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:55.797157 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f1b4c-d768-49fb-b565-61d49ea910bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ea92f30df34edeb1d7fa30033a851f, user_id=a6b458d9bcb44cfca8d96ea34dc2acfc, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:55.799941 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f1b4c-d768-49fb-b565-61d49ea910bf admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:55.812408 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1405/2782] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:06:55 2022] PUT /identity/v3/projects/a5ea92f30df34edeb1d7fa30033a851f/users/a6b458d9bcb44cfca8d96ea34dc2acfc/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:06:55.893909 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e7ebc-4b3c-445f-9cf3-c1c7aa51d59c None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:55.894224 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e7ebc-4b3c-445f-9cf3-c1c7aa51d59c None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:55.894619 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e7ebc-4b3c-445f-9cf3-c1c7aa51d59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:55.926696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-2f1e7ebc-4b3c-445f-9cf3-c1c7aa51d59c None None] MFA Rules not processed for user `a6b458d9bcb44cfca8d96ea34dc2acfc`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:06:55.927974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-2f1e7ebc-4b3c-445f-9cf3-c1c7aa51d59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:55.999464 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1378/2783] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:06:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:06:56.011215 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f1b4c-d768-49fb-b565-61d49ea910bf admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:56.013463 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-1d0f1b4c-d768-49fb-b565-61d49ea910bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:06:56.073439 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f1b4c-d768-49fb-b565-61d49ea910bf admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:56.078356 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e9dce-141b-4afc-8e9c-dea302122065 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:56.078356 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e9dce-141b-4afc-8e9c-dea302122065 service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:56.078356 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e9dce-141b-4afc-8e9c-dea302122065 service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:56.078356 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e9dce-141b-4afc-8e9c-dea302122065 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:56.136312 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e9dce-141b-4afc-8e9c-dea302122065 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:56.137834 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e9dce-141b-4afc-8e9c-dea302122065 service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:56.147424 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1406/2784] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:06:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:06:58.175696 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e7ebc-4b3c-445f-9cf3-c1c7aa51d59c None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:58.185552 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e7ebc-4b3c-445f-9cf3-c1c7aa51d59c None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:58.189204 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bde76d-d42f-48fa-93f7-ec046589c9b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:58.189836 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bde76d-d42f-48fa-93f7-ec046589c9b3 service cinder] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:58.190112 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bde76d-d42f-48fa-93f7-ec046589c9b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:58.190382 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bde76d-d42f-48fa-93f7-ec046589c9b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:58.250061 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bde76d-d42f-48fa-93f7-ec046589c9b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:58.251498 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bde76d-d42f-48fa-93f7-ec046589c9b3 service cinder] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:58.260448 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1379/2785] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:06:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:06:59.797965 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e9dce-141b-4afc-8e9c-dea302122065 service cinder] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:06:59.806942 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e9dce-141b-4afc-8e9c-dea302122065 service cinder] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:06:59.810579 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ad033-fb1e-41b9-8312-301dbe961fe9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:06:59.811444 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ad033-fb1e-41b9-8312-301dbe961fe9 service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:06:59.811959 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ad033-fb1e-41b9-8312-301dbe961fe9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:06:59.812243 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ad033-fb1e-41b9-8312-301dbe961fe9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:06:59.821292 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ad033-fb1e-41b9-8312-301dbe961fe9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:06:59.822738 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ad033-fb1e-41b9-8312-301dbe961fe9 service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:06:59.832468 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1407/2786] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:06:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:07:05.980042 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bde76d-d42f-48fa-93f7-ec046589c9b3 service cinder] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:06.030196 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=100 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:06.045917 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bde76d-d42f-48fa-93f7-ec046589c9b3 service cinder] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:06.050926 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75a94e-822c-4e43-99ad-1685c6877012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:06.051817 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75a94e-822c-4e43-99ad-1685c6877012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:06.052102 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75a94e-822c-4e43-99ad-1685c6877012 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:06.052403 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75a94e-822c-4e43-99ad-1685c6877012 admin admin] PATH_INFO: `/v3/users/0ff4bcddf6324fe58b933409d684e58a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:06.053579 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75a94e-822c-4e43-99ad-1685c6877012 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ff4bcddf6324fe58b933409d684e58a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:06.055506 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75a94e-822c-4e43-99ad-1685c6877012 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:06.243103 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-6f75a94e-822c-4e43-99ad-1685c6877012 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ff4bcddf6324fe58b933409d684e58a'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:06.249993 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-6f75a94e-822c-4e43-99ad-1685c6877012 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ff4bcddf6324fe58b933409d684e58a'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:06.250673 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-6f75a94e-822c-4e43-99ad-1685c6877012 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ff4bcddf6324fe58b933409d684e58a'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:06.262298 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-6f75a94e-822c-4e43-99ad-1685c6877012 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ff4bcddf6324fe58b933409d684e58a'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:06.332103 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-6f75a94e-822c-4e43-99ad-1685c6877012 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ff4bcddf6324fe58b933409d684e58a'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:06.338643 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1380/2787] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:07:05 2022] DELETE /identity/v3/users/0ff4bcddf6324fe58b933409d684e58a => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:07:06.343243 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24b175-8f53-4ef4-b91b-36a9ab10e3d3 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:06.344353 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24b175-8f53-4ef4-b91b-36a9ab10e3d3 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:06.344505 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24b175-8f53-4ef4-b91b-36a9ab10e3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:06.362045 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-ca24b175-8f53-4ef4-b91b-36a9ab10e3d3 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:07:06.363255 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-ca24b175-8f53-4ef4-b91b-36a9ab10e3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:06.375392 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:06.441321 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1408/2788] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:07:06.450238 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75a94e-822c-4e43-99ad-1685c6877012 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:06.452407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-6f75a94e-822c-4e43-99ad-1685c6877012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:06.521926 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75a94e-822c-4e43-99ad-1685c6877012 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:06.526278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5470b18-8903-460c-8a62-abae0efda6bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:06.526928 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5470b18-8903-460c-8a62-abae0efda6bb service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:06.527213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5470b18-8903-460c-8a62-abae0efda6bb service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:06.527488 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5470b18-8903-460c-8a62-abae0efda6bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:06.538457 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5470b18-8903-460c-8a62-abae0efda6bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:06.539952 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5470b18-8903-460c-8a62-abae0efda6bb service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:06.551153 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1381/2789] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:07:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:07:07.014992 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24b175-8f53-4ef4-b91b-36a9ab10e3d3 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:07.014992 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-ca24b175-8f53-4ef4-b91b-36a9ab10e3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:07.019931 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24b175-8f53-4ef4-b91b-36a9ab10e3d3 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:07.024797 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe81377-1343-410b-9868-4d4f4bd4a13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:07.025666 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe81377-1343-410b-9868-4d4f4bd4a13a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:07.025954 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe81377-1343-410b-9868-4d4f4bd4a13a admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:07.026259 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe81377-1343-410b-9868-4d4f4bd4a13a admin admin] PATH_INFO: `/v3/projects/89811f2de33e445cbe7264d225f0fef7` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:07.027495 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe81377-1343-410b-9868-4d4f4bd4a13a admin admin] RBAC: Authorizing `identity:delete_project(project_id=89811f2de33e445cbe7264d225f0fef7)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:07.029550 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe81377-1343-410b-9868-4d4f4bd4a13a admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:07.143361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-cbe81377-1343-410b-9868-4d4f4bd4a13a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89811f2de33e445cbe7264d225f0fef7', 'request_id': 'req-cbe81377-1343-410b-9868-4d4f4bd4a13a'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:07.150009 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-cbe81377-1343-410b-9868-4d4f4bd4a13a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89811f2de33e445cbe7264d225f0fef7', 'request_id': 'req-cbe81377-1343-410b-9868-4d4f4bd4a13a'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:07.223455 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-cbe81377-1343-410b-9868-4d4f4bd4a13a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89811f2de33e445cbe7264d225f0fef7', 'request_id': 'req-cbe81377-1343-410b-9868-4d4f4bd4a13a'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:07.235660 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-cbe81377-1343-410b-9868-4d4f4bd4a13a admin admin] The token cache is being invalidate because project 89811f2de33e445cbe7264d225f0fef7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:07:07.241806 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-cbe81377-1343-410b-9868-4d4f4bd4a13a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:07.241806 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-cbe81377-1343-410b-9868-4d4f4bd4a13a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:07.241806 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1409/2790] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:07:07 2022] DELETE /identity/v3/projects/89811f2de33e445cbe7264d225f0fef7 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:07:07.242213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5470b18-8903-460c-8a62-abae0efda6bb service neutron] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:07.252221 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5470b18-8903-460c-8a62-abae0efda6bb service neutron] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:07.312331 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5736035-aaa5-483b-8374-9fdd8b0fbfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:07.313214 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5736035-aaa5-483b-8374-9fdd8b0fbfbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:07.313501 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5736035-aaa5-483b-8374-9fdd8b0fbfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:07.313782 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5736035-aaa5-483b-8374-9fdd8b0fbfbb admin admin] PATH_INFO: `/v3/users/d68ba7889dee41089975623c70aaf8e5` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:07.314977 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5736035-aaa5-483b-8374-9fdd8b0fbfbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d68ba7889dee41089975623c70aaf8e5)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:07.317013 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5736035-aaa5-483b-8374-9fdd8b0fbfbb admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:07.327926 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:07.491850 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e5736035-aaa5-483b-8374-9fdd8b0fbfbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd68ba7889dee41089975623c70aaf8e5'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:07.498637 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e5736035-aaa5-483b-8374-9fdd8b0fbfbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd68ba7889dee41089975623c70aaf8e5'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:07.499308 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e5736035-aaa5-483b-8374-9fdd8b0fbfbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd68ba7889dee41089975623c70aaf8e5'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:07.511895 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e5736035-aaa5-483b-8374-9fdd8b0fbfbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd68ba7889dee41089975623c70aaf8e5'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:07.603463 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e5736035-aaa5-483b-8374-9fdd8b0fbfbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd68ba7889dee41089975623c70aaf8e5'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:07.610142 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1382/2791] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:07:07 2022] DELETE /identity/v3/users/d68ba7889dee41089975623c70aaf8e5 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:07:08.262079 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe81377-1343-410b-9868-4d4f4bd4a13a admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:08.264294 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-cbe81377-1343-410b-9868-4d4f4bd4a13a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:08.278175 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe81377-1343-410b-9868-4d4f4bd4a13a admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:08.361556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcd2f7-a54e-44df-a75a-2ea4124d7287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:08.361556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcd2f7-a54e-44df-a75a-2ea4124d7287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:08.361556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcd2f7-a54e-44df-a75a-2ea4124d7287 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:08.361556 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcd2f7-a54e-44df-a75a-2ea4124d7287 admin admin] PATH_INFO: `/v3/projects/f0c0676d3fc34b3eb82ce8479adb6f59` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:08.361962 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcd2f7-a54e-44df-a75a-2ea4124d7287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0c0676d3fc34b3eb82ce8479adb6f59)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:08.361962 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcd2f7-a54e-44df-a75a-2ea4124d7287 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:08.463204 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:08.470138 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-b1bcd2f7-a54e-44df-a75a-2ea4124d7287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0c0676d3fc34b3eb82ce8479adb6f59', 'request_id': 'req-b1bcd2f7-a54e-44df-a75a-2ea4124d7287'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:08.476395 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-b1bcd2f7-a54e-44df-a75a-2ea4124d7287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0c0676d3fc34b3eb82ce8479adb6f59', 'request_id': 'req-b1bcd2f7-a54e-44df-a75a-2ea4124d7287'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:08.606800 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-b1bcd2f7-a54e-44df-a75a-2ea4124d7287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0c0676d3fc34b3eb82ce8479adb6f59', 'request_id': 'req-b1bcd2f7-a54e-44df-a75a-2ea4124d7287'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:08.620385 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-b1bcd2f7-a54e-44df-a75a-2ea4124d7287 admin admin] The token cache is being invalidate because project f0c0676d3fc34b3eb82ce8479adb6f59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:07:08.620660 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-b1bcd2f7-a54e-44df-a75a-2ea4124d7287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:08.621352 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-b1bcd2f7-a54e-44df-a75a-2ea4124d7287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:08.622959 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1410/2792] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:07:08 2022] DELETE /identity/v3/projects/f0c0676d3fc34b3eb82ce8479adb6f59 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:07:08.632932 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5736035-aaa5-483b-8374-9fdd8b0fbfbb admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:08.632932 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-e5736035-aaa5-483b-8374-9fdd8b0fbfbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:08.645247 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5736035-aaa5-483b-8374-9fdd8b0fbfbb admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:08.710385 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86133d7-0d00-44e1-9ee0-c6a13610a1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:08.711273 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86133d7-0d00-44e1-9ee0-c6a13610a1c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:08.711574 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86133d7-0d00-44e1-9ee0-c6a13610a1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:08.712021 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86133d7-0d00-44e1-9ee0-c6a13610a1c0 admin admin] PATH_INFO: `/v3/users/a6b458d9bcb44cfca8d96ea34dc2acfc` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:08.713331 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86133d7-0d00-44e1-9ee0-c6a13610a1c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6b458d9bcb44cfca8d96ea34dc2acfc)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:08.715209 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86133d7-0d00-44e1-9ee0-c6a13610a1c0 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:08.884176 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcd2f7-a54e-44df-a75a-2ea4124d7287 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:08.885666 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-b1bcd2f7-a54e-44df-a75a-2ea4124d7287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:08.900006 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcd2f7-a54e-44df-a75a-2ea4124d7287 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:08.905617 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c20b3f-99dd-46e9-93d5-ee1710308d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:08.907175 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c20b3f-99dd-46e9-93d5-ee1710308d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:08.908043 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-d86133d7-0d00-44e1-9ee0-c6a13610a1c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6b458d9bcb44cfca8d96ea34dc2acfc'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:08.908178 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c20b3f-99dd-46e9-93d5-ee1710308d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:08.908497 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c20b3f-99dd-46e9-93d5-ee1710308d85 admin admin] PATH_INFO: `/v3/users/dd976592aec04040b085c945535a1afc` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:08.909827 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c20b3f-99dd-46e9-93d5-ee1710308d85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd976592aec04040b085c945535a1afc)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:08.911999 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c20b3f-99dd-46e9-93d5-ee1710308d85 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:08.915461 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-d86133d7-0d00-44e1-9ee0-c6a13610a1c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6b458d9bcb44cfca8d96ea34dc2acfc'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:08.916220 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-d86133d7-0d00-44e1-9ee0-c6a13610a1c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6b458d9bcb44cfca8d96ea34dc2acfc'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:08.941431 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-d86133d7-0d00-44e1-9ee0-c6a13610a1c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6b458d9bcb44cfca8d96ea34dc2acfc'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:09.032056 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-d86133d7-0d00-44e1-9ee0-c6a13610a1c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6b458d9bcb44cfca8d96ea34dc2acfc'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:09.038440 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1383/2793] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:07:08 2022] DELETE /identity/v3/users/a6b458d9bcb44cfca8d96ea34dc2acfc => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:07:09.108807 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-41c20b3f-99dd-46e9-93d5-ee1710308d85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd976592aec04040b085c945535a1afc'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:09.109541 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-41c20b3f-99dd-46e9-93d5-ee1710308d85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd976592aec04040b085c945535a1afc'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:09.110227 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-41c20b3f-99dd-46e9-93d5-ee1710308d85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd976592aec04040b085c945535a1afc'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:09.183435 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-41c20b3f-99dd-46e9-93d5-ee1710308d85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd976592aec04040b085c945535a1afc'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:09.191104 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-41c20b3f-99dd-46e9-93d5-ee1710308d85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd976592aec04040b085c945535a1afc'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:09.211101 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1411/2794] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:07:08 2022] DELETE /identity/v3/users/dd976592aec04040b085c945535a1afc => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:07:09.216238 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110f5a8-9a54-4866-b915-d46d55c222d6 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:09.216528 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110f5a8-9a54-4866-b915-d46d55c222d6 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:09.217514 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110f5a8-9a54-4866-b915-d46d55c222d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:09.229346 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:09.236025 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-1110f5a8-9a54-4866-b915-d46d55c222d6 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:07:09.237404 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-1110f5a8-9a54-4866-b915-d46d55c222d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:09.302018 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1384/2795] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:07:09.312302 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c20b3f-99dd-46e9-93d5-ee1710308d85 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:09.313830 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-41c20b3f-99dd-46e9-93d5-ee1710308d85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:09.378850 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c20b3f-99dd-46e9-93d5-ee1710308d85 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:09.382673 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b097a9-805f-4a32-a92f-eed60246e05b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:09.383347 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b097a9-805f-4a32-a92f-eed60246e05b service neutron] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:09.383657 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b097a9-805f-4a32-a92f-eed60246e05b service neutron] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:09.383938 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b097a9-805f-4a32-a92f-eed60246e05b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:09.394856 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b097a9-805f-4a32-a92f-eed60246e05b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:09.396368 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b097a9-805f-4a32-a92f-eed60246e05b service neutron] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:09.408017 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1412/2796] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:07:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:07:09.748408 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110f5a8-9a54-4866-b915-d46d55c222d6 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:09.750180 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-1110f5a8-9a54-4866-b915-d46d55c222d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:09.767254 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110f5a8-9a54-4866-b915-d46d55c222d6 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:09.768485 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c05d8d-e8c4-41b3-a499-0c09ac18e9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:09.769360 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c05d8d-e8c4-41b3-a499-0c09ac18e9a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:09.769702 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c05d8d-e8c4-41b3-a499-0c09ac18e9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:09.769978 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c05d8d-e8c4-41b3-a499-0c09ac18e9a4 admin admin] PATH_INFO: `/v3/projects/a5ea92f30df34edeb1d7fa30033a851f` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:09.771208 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c05d8d-e8c4-41b3-a499-0c09ac18e9a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5ea92f30df34edeb1d7fa30033a851f)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:09.773289 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c05d8d-e8c4-41b3-a499-0c09ac18e9a4 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:09.882730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b097a9-805f-4a32-a92f-eed60246e05b service neutron] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:09.884279 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-20b097a9-805f-4a32-a92f-eed60246e05b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:09.898009 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b097a9-805f-4a32-a92f-eed60246e05b service neutron] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:09.905479 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-42c05d8d-e8c4-41b3-a499-0c09ac18e9a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5ea92f30df34edeb1d7fa30033a851f', 'request_id': 'req-42c05d8d-e8c4-41b3-a499-0c09ac18e9a4'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:09.908272 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-42c05d8d-e8c4-41b3-a499-0c09ac18e9a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5ea92f30df34edeb1d7fa30033a851f', 'request_id': 'req-42c05d8d-e8c4-41b3-a499-0c09ac18e9a4'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:09.945622 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:09.963043 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45047ac-62e8-49ca-bfd8-48b5df36e654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:09.963955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45047ac-62e8-49ca-bfd8-48b5df36e654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:09.964239 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45047ac-62e8-49ca-bfd8-48b5df36e654 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:09.964517 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45047ac-62e8-49ca-bfd8-48b5df36e654 admin admin] PATH_INFO: `/v3/projects/8f02b3752a1340c880dcd855f0d7c113` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:09.965709 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45047ac-62e8-49ca-bfd8-48b5df36e654 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f02b3752a1340c880dcd855f0d7c113)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:09.967817 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45047ac-62e8-49ca-bfd8-48b5df36e654 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:09.980471 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-42c05d8d-e8c4-41b3-a499-0c09ac18e9a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5ea92f30df34edeb1d7fa30033a851f', 'request_id': 'req-42c05d8d-e8c4-41b3-a499-0c09ac18e9a4'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:09.993714 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-42c05d8d-e8c4-41b3-a499-0c09ac18e9a4 admin admin] The token cache is being invalidate because project a5ea92f30df34edeb1d7fa30033a851f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:07:09.994106 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-42c05d8d-e8c4-41b3-a499-0c09ac18e9a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:09.994662 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-42c05d8d-e8c4-41b3-a499-0c09ac18e9a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:09.996291 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1385/2797] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:07:09 2022] DELETE /identity/v3/projects/a5ea92f30df34edeb1d7fa30033a851f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:07:10.002016 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39a822-9d93-4e17-aa3f-c19bb00b8d9d None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:10.002378 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39a822-9d93-4e17-aa3f-c19bb00b8d9d None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:10.002668 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39a822-9d93-4e17-aa3f-c19bb00b8d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:10.032154 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-ab39a822-9d93-4e17-aa3f-c19bb00b8d9d None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:07:10.033352 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-ab39a822-9d93-4e17-aa3f-c19bb00b8d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:10.041413 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1386/2798] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:07:10.049322 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b503e3-fc40-42df-b2ce-6ca5e9ab68c0 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:10.049608 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b503e3-fc40-42df-b2ce-6ca5e9ab68c0 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:10.049883 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b503e3-fc40-42df-b2ce-6ca5e9ab68c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:10.069163 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-49b503e3-fc40-42df-b2ce-6ca5e9ab68c0 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:07:10.070441 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-49b503e3-fc40-42df-b2ce-6ca5e9ab68c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:10.079113 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1387/2799] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:07:10.083223 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b503e3-fc40-42df-b2ce-6ca5e9ab68c0 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:10.092988 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b503e3-fc40-42df-b2ce-6ca5e9ab68c0 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:10.097632 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81f93f-086c-4b13-981f-2fcccdb18fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:10.098276 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81f93f-086c-4b13-981f-2fcccdb18fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:10.098556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81f93f-086c-4b13-981f-2fcccdb18fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:10.098828 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81f93f-086c-4b13-981f-2fcccdb18fd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:10.099554 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81f93f-086c-4b13-981f-2fcccdb18fd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:07:10.099890 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81f93f-086c-4b13-981f-2fcccdb18fd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:10.101487 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81f93f-086c-4b13-981f-2fcccdb18fd9 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:10.114396 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1388/2800] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 16:07:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:07:10.118740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81f93f-086c-4b13-981f-2fcccdb18fd9 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:10.125781 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-d45047ac-62e8-49ca-bfd8-48b5df36e654 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f02b3752a1340c880dcd855f0d7c113', 'request_id': 'req-d45047ac-62e8-49ca-bfd8-48b5df36e654'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:10.128620 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81f93f-086c-4b13-981f-2fcccdb18fd9 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:10.132108 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-d45047ac-62e8-49ca-bfd8-48b5df36e654 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f02b3752a1340c880dcd855f0d7c113', 'request_id': 'req-d45047ac-62e8-49ca-bfd8-48b5df36e654'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:10.179491 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:10.187180 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1642a8-e938-45b5-aae3-62899e927c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:10.187884 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1642a8-e938-45b5-aae3-62899e927c9c admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:10.188173 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1642a8-e938-45b5-aae3-62899e927c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:10.188450 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1642a8-e938-45b5-aae3-62899e927c9c admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:10.189141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1642a8-e938-45b5-aae3-62899e927c9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:10.191063 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1642a8-e938-45b5-aae3-62899e927c9c admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:10.229117 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-d45047ac-62e8-49ca-bfd8-48b5df36e654 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f02b3752a1340c880dcd855f0d7c113', 'request_id': 'req-d45047ac-62e8-49ca-bfd8-48b5df36e654'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:10.240447 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-d45047ac-62e8-49ca-bfd8-48b5df36e654 admin admin] The token cache is being invalidate because project 8f02b3752a1340c880dcd855f0d7c113 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:07:10.240735 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-d45047ac-62e8-49ca-bfd8-48b5df36e654 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:10.241370 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-d45047ac-62e8-49ca-bfd8-48b5df36e654 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:10.242940 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1413/2801] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:07:09 2022] DELETE /identity/v3/projects/8f02b3752a1340c880dcd855f0d7c113 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:07:10.246747 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45047ac-62e8-49ca-bfd8-48b5df36e654 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:10.248603 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-d45047ac-62e8-49ca-bfd8-48b5df36e654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:10.260987 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45047ac-62e8-49ca-bfd8-48b5df36e654 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:10.266278 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf45b8-4152-432e-b74f-531bbaa37e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:10.267135 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf45b8-4152-432e-b74f-531bbaa37e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:10.267415 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf45b8-4152-432e-b74f-531bbaa37e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:10.267725 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf45b8-4152-432e-b74f-531bbaa37e8b admin admin] PATH_INFO: `/v3/users/afe44d10efef4f67b5a64a73cc465c0e` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:10.268901 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf45b8-4152-432e-b74f-531bbaa37e8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe44d10efef4f67b5a64a73cc465c0e)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:10.270810 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf45b8-4152-432e-b74f-531bbaa37e8b admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:10.320402 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1389/2802] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:07:10 2022] POST /identity/v3/projects => generated 369 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:07:10.324387 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1642a8-e938-45b5-aae3-62899e927c9c admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:10.326659 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-fa1642a8-e938-45b5-aae3-62899e927c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:10.389417 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1642a8-e938-45b5-aae3-62899e927c9c admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:10.394220 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d9cb0-cd8a-4d1a-beaf-2bfb1f870f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:10.394899 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d9cb0-cd8a-4d1a-beaf-2bfb1f870f78 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:10.395168 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d9cb0-cd8a-4d1a-beaf-2bfb1f870f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:10.395446 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d9cb0-cd8a-4d1a-beaf-2bfb1f870f78 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:10.396163 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d9cb0-cd8a-4d1a-beaf-2bfb1f870f78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:10.398082 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d9cb0-cd8a-4d1a-beaf-2bfb1f870f78 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:10.486120 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-8acf45b8-4152-432e-b74f-531bbaa37e8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe44d10efef4f67b5a64a73cc465c0e'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:10.486776 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-8acf45b8-4152-432e-b74f-531bbaa37e8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe44d10efef4f67b5a64a73cc465c0e'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:10.487403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-8acf45b8-4152-432e-b74f-531bbaa37e8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe44d10efef4f67b5a64a73cc465c0e'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:10.530321 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1390/2803] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:07:10 2022] POST /identity/v3/users => generated 285 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:07:10.534438 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d9cb0-cd8a-4d1a-beaf-2bfb1f870f78 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:10.536196 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-624d9cb0-cd8a-4d1a-beaf-2bfb1f870f78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:10.549556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d9cb0-cd8a-4d1a-beaf-2bfb1f870f78 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:10.554462 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcabdf-1990-4a23-92c5-adfadfccbbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:10.558041 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcabdf-1990-4a23-92c5-adfadfccbbf7 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:10.558171 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-8acf45b8-4152-432e-b74f-531bbaa37e8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe44d10efef4f67b5a64a73cc465c0e'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:10.558274 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcabdf-1990-4a23-92c5-adfadfccbbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:10.558274 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcabdf-1990-4a23-92c5-adfadfccbbf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:10.558274 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bcabdf-1990-4a23-92c5-adfadfccbbf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:10.558274 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bcabdf-1990-4a23-92c5-adfadfccbbf7 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:10.565650 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-8acf45b8-4152-432e-b74f-531bbaa37e8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe44d10efef4f67b5a64a73cc465c0e'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:10.569280 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1391/2804] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:07:10.573215 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcabdf-1990-4a23-92c5-adfadfccbbf7 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:10.583298 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcabdf-1990-4a23-92c5-adfadfccbbf7 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:10.584982 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1414/2805] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:07:10 2022] DELETE /identity/v3/users/afe44d10efef4f67b5a64a73cc465c0e => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:07:10.645247 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139fe2aa-d0f2-4c25-a31f-642fa81b7735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:10.645846 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fe2aa-d0f2-4c25-a31f-642fa81b7735 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:10.646129 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fe2aa-d0f2-4c25-a31f-642fa81b7735 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:10.646412 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fe2aa-d0f2-4c25-a31f-642fa81b7735 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:10.647187 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139fe2aa-d0f2-4c25-a31f-642fa81b7735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:10.648846 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139fe2aa-d0f2-4c25-a31f-642fa81b7735 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:10.663987 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1392/2806] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:07:10.664882 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf45b8-4152-432e-b74f-531bbaa37e8b admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:10.676849 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf45b8-4152-432e-b74f-531bbaa37e8b admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:10.681629 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789f8e0-ccd6-40a4-a3fa-7804267499d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:10.682534 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789f8e0-ccd6-40a4-a3fa-7804267499d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:10.682848 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789f8e0-ccd6-40a4-a3fa-7804267499d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:10.683159 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789f8e0-ccd6-40a4-a3fa-7804267499d9 admin admin] PATH_INFO: `/v3/projects/b2b5e63aa94b4122962ac21a7a377a2b/users/b2bc82368db94c66833ef404610e3661/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:10.699905 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5789f8e0-ccd6-40a4-a3fa-7804267499d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2b5e63aa94b4122962ac21a7a377a2b, user_id=b2bc82368db94c66833ef404610e3661, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:10.703228 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5789f8e0-ccd6-40a4-a3fa-7804267499d9 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:10.805922 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1415/2807] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:07:10 2022] PUT /identity/v3/projects/b2b5e63aa94b4122962ac21a7a377a2b/users/b2bc82368db94c66833ef404610e3661/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:07:10.818476 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63847e0b-af49-450c-9232-477da08cdd1c None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:10.818991 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63847e0b-af49-450c-9232-477da08cdd1c None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:10.819107 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63847e0b-af49-450c-9232-477da08cdd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:10.848502 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-63847e0b-af49-450c-9232-477da08cdd1c None None] MFA Rules not processed for user `b2bc82368db94c66833ef404610e3661`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:07:10.849734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-63847e0b-af49-450c-9232-477da08cdd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:10.900785 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:10.923030 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1393/2808] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:07:10 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:07:10.934872 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789f8e0-ccd6-40a4-a3fa-7804267499d9 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:10.936687 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-5789f8e0-ccd6-40a4-a3fa-7804267499d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:10.958881 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:10.996130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789f8e0-ccd6-40a4-a3fa-7804267499d9 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:10.999921 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc17a3d-fa2d-4e2f-83a7-631fc144cb37 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd003ff6cc73946da9203c69a167bbfff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:11.000578 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc17a3d-fa2d-4e2f-83a7-631fc144cb37 service glance] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:11.000864 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc17a3d-fa2d-4e2f-83a7-631fc144cb37 service glance] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:11.001160 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc17a3d-fa2d-4e2f-83a7-631fc144cb37 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:11.008007 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63847e0b-af49-450c-9232-477da08cdd1c None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:11.009457 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-63847e0b-af49-450c-9232-477da08cdd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:11.010999 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc17a3d-fa2d-4e2f-83a7-631fc144cb37 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:11.012495 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc17a3d-fa2d-4e2f-83a7-631fc144cb37 service glance] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:11.023932 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1416/2809] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:07:10 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:07:11.095249 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63847e0b-af49-450c-9232-477da08cdd1c None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:11.101152 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604364c1-0516-4475-a850-74b8b39e08ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:11.102026 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604364c1-0516-4475-a850-74b8b39e08ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:11.102313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604364c1-0516-4475-a850-74b8b39e08ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:11.102587 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604364c1-0516-4475-a850-74b8b39e08ed admin admin] PATH_INFO: `/v3/projects/d8101b2644814a99a9f5411667f7abb8` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:11.104035 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604364c1-0516-4475-a850-74b8b39e08ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8101b2644814a99a9f5411667f7abb8)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:11.108005 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604364c1-0516-4475-a850-74b8b39e08ed admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:11.213712 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-604364c1-0516-4475-a850-74b8b39e08ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8101b2644814a99a9f5411667f7abb8', 'request_id': 'req-604364c1-0516-4475-a850-74b8b39e08ed'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:11.220922 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-604364c1-0516-4475-a850-74b8b39e08ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8101b2644814a99a9f5411667f7abb8', 'request_id': 'req-604364c1-0516-4475-a850-74b8b39e08ed'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:11.281387 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-604364c1-0516-4475-a850-74b8b39e08ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8101b2644814a99a9f5411667f7abb8', 'request_id': 'req-604364c1-0516-4475-a850-74b8b39e08ed'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:11.293507 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-604364c1-0516-4475-a850-74b8b39e08ed admin admin] The token cache is being invalidate because project d8101b2644814a99a9f5411667f7abb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:07:11.293917 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-604364c1-0516-4475-a850-74b8b39e08ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:11.294592 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-604364c1-0516-4475-a850-74b8b39e08ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:11.298227 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1394/2810] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:07:11 2022] DELETE /identity/v3/projects/d8101b2644814a99a9f5411667f7abb8 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:07:11.302142 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f6118-de4b-49a5-b38d-86eae7bb83cc None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:11.302440 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f6118-de4b-49a5-b38d-86eae7bb83cc None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:11.302728 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f6118-de4b-49a5-b38d-86eae7bb83cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:11.322687 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-717f6118-de4b-49a5-b38d-86eae7bb83cc None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:07:11.323952 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-717f6118-de4b-49a5-b38d-86eae7bb83cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:11.385437 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1417/2811] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:07:11.394175 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b0c1a-6361-4541-b4fc-9674ddfdb058 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:11.394466 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b0c1a-6361-4541-b4fc-9674ddfdb058 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:11.394740 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b0c1a-6361-4541-b4fc-9674ddfdb058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:11.414549 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-e96b0c1a-6361-4541-b4fc-9674ddfdb058 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:07:11.415831 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-e96b0c1a-6361-4541-b4fc-9674ddfdb058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:11.424482 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1395/2812] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:07:11.429931 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f6118-de4b-49a5-b38d-86eae7bb83cc None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:11.444145 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f6118-de4b-49a5-b38d-86eae7bb83cc None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:11.448839 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06914873-71cd-40bc-a792-5f834c624bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:11.449500 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06914873-71cd-40bc-a792-5f834c624bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:11.449782 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06914873-71cd-40bc-a792-5f834c624bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:11.450057 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06914873-71cd-40bc-a792-5f834c624bf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:11.450785 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06914873-71cd-40bc-a792-5f834c624bf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:07:11.451796 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06914873-71cd-40bc-a792-5f834c624bf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:11.453486 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06914873-71cd-40bc-a792-5f834c624bf9 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:11.466035 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1418/2813] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 16:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 16:07:11.471519 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b0c1a-6361-4541-b4fc-9674ddfdb058 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:11.481136 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b0c1a-6361-4541-b4fc-9674ddfdb058 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:11.486688 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce2551-7850-4786-84a0-27b24133bb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:11.487376 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce2551-7850-4786-84a0-27b24133bb74 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:11.487706 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce2551-7850-4786-84a0-27b24133bb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:11.487991 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce2551-7850-4786-84a0-27b24133bb74 admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:11.488683 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce2551-7850-4786-84a0-27b24133bb74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:11.490663 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce2551-7850-4786-84a0-27b24133bb74 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:11.585969 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1396/2814] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:07:11 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:07:11.590026 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06914873-71cd-40bc-a792-5f834c624bf9 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:11.600816 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06914873-71cd-40bc-a792-5f834c624bf9 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:11.658704 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79d9b7-a38f-44a3-8f94-4b953e9729ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:11.659383 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79d9b7-a38f-44a3-8f94-4b953e9729ef admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:11.659693 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79d9b7-a38f-44a3-8f94-4b953e9729ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:11.659975 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79d9b7-a38f-44a3-8f94-4b953e9729ef admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:11.660679 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79d9b7-a38f-44a3-8f94-4b953e9729ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:11.662793 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79d9b7-a38f-44a3-8f94-4b953e9729ef admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:11.802226 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1419/2815] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:07:11 2022] POST /identity/v3/users => generated 290 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:07:11.806596 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce2551-7850-4786-84a0-27b24133bb74 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:11.817368 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce2551-7850-4786-84a0-27b24133bb74 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:11.821956 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f64b7-f163-4def-9158-abf13f498c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:11.822548 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f64b7-f163-4def-9158-abf13f498c59 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:11.822823 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f64b7-f163-4def-9158-abf13f498c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:11.823097 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f64b7-f163-4def-9158-abf13f498c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:11.823884 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f64b7-f163-4def-9158-abf13f498c59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:11.825476 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f64b7-f163-4def-9158-abf13f498c59 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:11.837221 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1397/2816] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:07:11.841343 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79d9b7-a38f-44a3-8f94-4b953e9729ef admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:11.852829 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79d9b7-a38f-44a3-8f94-4b953e9729ef admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:11.858568 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabaf61-c140-4517-adbd-a5af90b6ded9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:11.859257 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabaf61-c140-4517-adbd-a5af90b6ded9 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:11.859547 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabaf61-c140-4517-adbd-a5af90b6ded9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:11.859861 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabaf61-c140-4517-adbd-a5af90b6ded9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:11.860617 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dabaf61-c140-4517-adbd-a5af90b6ded9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:11.862269 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dabaf61-c140-4517-adbd-a5af90b6ded9 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:11.875528 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1420/2817] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:07:11.880008 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f64b7-f163-4def-9158-abf13f498c59 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:11.892599 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f64b7-f163-4def-9158-abf13f498c59 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:11.897266 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59deb4b-ba61-438e-8b70-8d73b6d9ab68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:11.898153 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59deb4b-ba61-438e-8b70-8d73b6d9ab68 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:11.898442 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59deb4b-ba61-438e-8b70-8d73b6d9ab68 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:11.898910 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59deb4b-ba61-438e-8b70-8d73b6d9ab68 admin admin] PATH_INFO: `/v3/projects/6d52ffff253941ffb7ed32baef816a8b/users/36a92535158a4914aeb6e04ce5f8ac7a/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:11.917229 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59deb4b-ba61-438e-8b70-8d73b6d9ab68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d52ffff253941ffb7ed32baef816a8b, user_id=36a92535158a4914aeb6e04ce5f8ac7a, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:11.917967 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59deb4b-ba61-438e-8b70-8d73b6d9ab68 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:12.036181 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1398/2818] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:07:11 2022] PUT /identity/v3/projects/6d52ffff253941ffb7ed32baef816a8b/users/36a92535158a4914aeb6e04ce5f8ac7a/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:07:12.048282 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046790f8-c42f-448e-bb77-21fc34c8c09d None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:12.048643 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046790f8-c42f-448e-bb77-21fc34c8c09d None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:12.048990 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046790f8-c42f-448e-bb77-21fc34c8c09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:12.077704 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-046790f8-c42f-448e-bb77-21fc34c8c09d None None] MFA Rules not processed for user `36a92535158a4914aeb6e04ce5f8ac7a`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:07:12.079008 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-046790f8-c42f-448e-bb77-21fc34c8c09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:12.097003 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:12.148882 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1421/2819] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:07:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:07:12.153387 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59deb4b-ba61-438e-8b70-8d73b6d9ab68 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:12.166725 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:12.221616 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59deb4b-ba61-438e-8b70-8d73b6d9ab68 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:12.226357 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b170e-70dd-4590-8f29-6725d11f2a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:12.227014 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b170e-70dd-4590-8f29-6725d11f2a87 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:12.227302 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b170e-70dd-4590-8f29-6725d11f2a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:12.227580 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b170e-70dd-4590-8f29-6725d11f2a87 admin admin] PATH_INFO: `/v3/projects` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:12.228388 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b170e-70dd-4590-8f29-6725d11f2a87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:12.230327 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b170e-70dd-4590-8f29-6725d11f2a87 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:12.319560 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1399/2820] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:07:12 2022] POST /identity/v3/projects => generated 381 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:07:12.323865 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046790f8-c42f-448e-bb77-21fc34c8c09d None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:12.335982 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046790f8-c42f-448e-bb77-21fc34c8c09d None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:12.398111 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cca3d-5f21-4828-8ccf-10e7fbe8aa3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:12.398789 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cca3d-5f21-4828-8ccf-10e7fbe8aa3a admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:12.399072 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cca3d-5f21-4828-8ccf-10e7fbe8aa3a admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:12.399350 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cca3d-5f21-4828-8ccf-10e7fbe8aa3a admin admin] PATH_INFO: `/v3/users` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:12.400083 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9cca3d-5f21-4828-8ccf-10e7fbe8aa3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:12.402049 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9cca3d-5f21-4828-8ccf-10e7fbe8aa3a admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:12.503752 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1422/2821] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:07:12 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:07:12.506332 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b170e-70dd-4590-8f29-6725d11f2a87 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:12.518293 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b170e-70dd-4590-8f29-6725d11f2a87 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:12.523430 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23f4d1-777c-466d-b568-1040bf868a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:12.524189 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23f4d1-777c-466d-b568-1040bf868a13 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:12.529794 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23f4d1-777c-466d-b568-1040bf868a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:12.529794 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23f4d1-777c-466d-b568-1040bf868a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:12.529794 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be23f4d1-777c-466d-b568-1040bf868a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:12.529794 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be23f4d1-777c-466d-b568-1040bf868a13 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:12.540022 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1400/2822] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:07:12.544323 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cca3d-5f21-4828-8ccf-10e7fbe8aa3a admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:12.557144 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cca3d-5f21-4828-8ccf-10e7fbe8aa3a admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:12.562487 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce1b15-2290-4adc-81ba-a3c0e1453b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:12.563460 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce1b15-2290-4adc-81ba-a3c0e1453b56 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:12.563787 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce1b15-2290-4adc-81ba-a3c0e1453b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:12.564094 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce1b15-2290-4adc-81ba-a3c0e1453b56 admin admin] PATH_INFO: `/v3/projects/c30d747bd2044fe5b4c33d8d7e93f482/users/5b77b2e37248434bb87753d64a7d862c/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:12.581527 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce1b15-2290-4adc-81ba-a3c0e1453b56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c30d747bd2044fe5b4c33d8d7e93f482, user_id=5b77b2e37248434bb87753d64a7d862c, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:12.584271 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce1b15-2290-4adc-81ba-a3c0e1453b56 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:12.653019 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1423/2823] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:07:12 2022] PUT /identity/v3/projects/c30d747bd2044fe5b4c33d8d7e93f482/users/5b77b2e37248434bb87753d64a7d862c/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:07:12.658243 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23f4d1-777c-466d-b568-1040bf868a13 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:12.668497 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23f4d1-777c-466d-b568-1040bf868a13 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:12.730893 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee309d-37be-4f0f-bb7b-105c4f9bf0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:12.731475 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee309d-37be-4f0f-bb7b-105c4f9bf0cd admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:12.731793 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee309d-37be-4f0f-bb7b-105c4f9bf0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:12.732226 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee309d-37be-4f0f-bb7b-105c4f9bf0cd admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:12.734046 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee309d-37be-4f0f-bb7b-105c4f9bf0cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:12.735685 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee309d-37be-4f0f-bb7b-105c4f9bf0cd admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:12.745975 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1401/2824] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:07:12.750930 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce1b15-2290-4adc-81ba-a3c0e1453b56 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:12.761416 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce1b15-2290-4adc-81ba-a3c0e1453b56 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:12.766319 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaadf34-e5a6-4103-bbe1-d9149b991afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:12.767192 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaadf34-e5a6-4103-bbe1-d9149b991afd admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:12.767865 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaadf34-e5a6-4103-bbe1-d9149b991afd admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:12.767865 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaadf34-e5a6-4103-bbe1-d9149b991afd admin admin] PATH_INFO: `/v3/projects/c30d747bd2044fe5b4c33d8d7e93f482/users/5b77b2e37248434bb87753d64a7d862c/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:12.770102 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaadf34-e5a6-4103-bbe1-d9149b991afd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c30d747bd2044fe5b4c33d8d7e93f482, user_id=5b77b2e37248434bb87753d64a7d862c, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:12.772898 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaadf34-e5a6-4103-bbe1-d9149b991afd admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:12.784615 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1424/2825] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:07:12 2022] PUT /identity/v3/projects/c30d747bd2044fe5b4c33d8d7e93f482/users/5b77b2e37248434bb87753d64a7d862c/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:07:12.796392 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465a7fd-5050-4583-b0b1-0394b44911c0 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:12.796689 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465a7fd-5050-4583-b0b1-0394b44911c0 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:12.796973 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465a7fd-5050-4583-b0b1-0394b44911c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:12.824474 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-a465a7fd-5050-4583-b0b1-0394b44911c0 None None] MFA Rules not processed for user `5b77b2e37248434bb87753d64a7d862c`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:07:12.825695 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-a465a7fd-5050-4583-b0b1-0394b44911c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:12.899125 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1402/2826] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:07:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:07:12.917452 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaadf34-e5a6-4103-bbe1-d9149b991afd admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:12.919148 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-abaadf34-e5a6-4103-bbe1-d9149b991afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:12.983946 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaadf34-e5a6-4103-bbe1-d9149b991afd admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:12.988700 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc5cc5-e17a-4c85-9965-7b83eaaeb638 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:12.989369 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc5cc5-e17a-4c85-9965-7b83eaaeb638 service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:12.989663 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc5cc5-e17a-4c85-9965-7b83eaaeb638 service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:12.989943 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc5cc5-e17a-4c85-9965-7b83eaaeb638 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:13.000290 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc5cc5-e17a-4c85-9965-7b83eaaeb638 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:13.001916 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc5cc5-e17a-4c85-9965-7b83eaaeb638 service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:13.013046 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1425/2827] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:07:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:07:14.029471 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465a7fd-5050-4583-b0b1-0394b44911c0 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:14.039264 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465a7fd-5050-4583-b0b1-0394b44911c0 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:14.043936 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb245a-309a-4740-9395-dbfa23b5dc8f tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b77b2e37248434bb87753d64a7d862c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c30d747bd2044fe5b4c33d8d7e93f482', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:14.044860 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb245a-309a-4740-9395-dbfa23b5dc8f tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:14.045020 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb245a-309a-4740-9395-dbfa23b5dc8f tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:14.045182 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb245a-309a-4740-9395-dbfa23b5dc8f tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:14.046307 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb245a-309a-4740-9395-dbfa23b5dc8f tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:07:14.046619 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb245a-309a-4740-9395-dbfa23b5dc8f tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:14.048241 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb245a-309a-4740-9395-dbfa23b5dc8f tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:14.049872 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:14.061958 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1403/2828] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 16:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:07:14.066036 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc5cc5-e17a-4c85-9965-7b83eaaeb638 service cinder] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:14.075147 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc5cc5-e17a-4c85-9965-7b83eaaeb638 service cinder] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:14.081050 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec70725-23f7-412d-ae82-2701eefe683e tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b77b2e37248434bb87753d64a7d862c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c30d747bd2044fe5b4c33d8d7e93f482', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:14.083795 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec70725-23f7-412d-ae82-2701eefe683e tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:14.083795 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec70725-23f7-412d-ae82-2701eefe683e tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:14.083795 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec70725-23f7-412d-ae82-2701eefe683e tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:14.083795 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec70725-23f7-412d-ae82-2701eefe683e tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:14.084904 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec70725-23f7-412d-ae82-2701eefe683e tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:14.095354 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:14.211775 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1426/2829] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:07:14 2022] POST /identity/v3/projects => generated 353 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:07:14.216064 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb245a-309a-4740-9395-dbfa23b5dc8f tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:14.226779 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb245a-309a-4740-9395-dbfa23b5dc8f tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:14.287448 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8280e9-1ac7-44d4-a285-c13be206b9f2 tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b77b2e37248434bb87753d64a7d862c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c30d747bd2044fe5b4c33d8d7e93f482', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:14.288232 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8280e9-1ac7-44d4-a285-c13be206b9f2 tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:14.288724 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8280e9-1ac7-44d4-a285-c13be206b9f2 tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:14.289008 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8280e9-1ac7-44d4-a285-c13be206b9f2 tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:14.290052 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8280e9-1ac7-44d4-a285-c13be206b9f2 tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:07:14.290407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8280e9-1ac7-44d4-a285-c13be206b9f2 tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:14.292428 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8280e9-1ac7-44d4-a285-c13be206b9f2 tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:14.306571 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1404/2830] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 16:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:07:14.346185 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec70725-23f7-412d-ae82-2701eefe683e tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:14.356830 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec70725-23f7-412d-ae82-2701eefe683e tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:14.362073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3392e52-26e3-4135-803a-74c7a537dfb6 tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b77b2e37248434bb87753d64a7d862c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c30d747bd2044fe5b4c33d8d7e93f482', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:14.362932 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3392e52-26e3-4135-803a-74c7a537dfb6 tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:14.363217 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3392e52-26e3-4135-803a-74c7a537dfb6 tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:14.363493 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3392e52-26e3-4135-803a-74c7a537dfb6 tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] PATH_INFO: `/v3/projects/5300cdccdf154c8489e236cc57e6905c` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:14.364710 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3392e52-26e3-4135-803a-74c7a537dfb6 tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5300cdccdf154c8489e236cc57e6905c)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:14.366658 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3392e52-26e3-4135-803a-74c7a537dfb6 tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:14.495178 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-f3392e52-26e3-4135-803a-74c7a537dfb6 tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5300cdccdf154c8489e236cc57e6905c', 'request_id': 'req-f3392e52-26e3-4135-803a-74c7a537dfb6'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:14.502203 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-f3392e52-26e3-4135-803a-74c7a537dfb6 tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5300cdccdf154c8489e236cc57e6905c', 'request_id': 'req-f3392e52-26e3-4135-803a-74c7a537dfb6'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:14.561055 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-f3392e52-26e3-4135-803a-74c7a537dfb6 tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5300cdccdf154c8489e236cc57e6905c', 'request_id': 'req-f3392e52-26e3-4135-803a-74c7a537dfb6'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:14.573837 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-f3392e52-26e3-4135-803a-74c7a537dfb6 tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] The token cache is being invalidate because project 5300cdccdf154c8489e236cc57e6905c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:07:14.574130 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-f3392e52-26e3-4135-803a-74c7a537dfb6 tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:14.574807 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-f3392e52-26e3-4135-803a-74c7a537dfb6 tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:14.576662 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1427/2831] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:07:14 2022] DELETE /identity/v3/projects/5300cdccdf154c8489e236cc57e6905c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:07:15.222108 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8280e9-1ac7-44d4-a285-c13be206b9f2 tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:15.224296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-be8280e9-1ac7-44d4-a285-c13be206b9f2 tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:15.291865 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8280e9-1ac7-44d4-a285-c13be206b9f2 tempest-VolumeQuotaClassesTest-2130220228 tempest-VolumeQuotaClassesTest-2130220228-project-admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:15.351743 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53fe7f-0821-4bc2-83da-56f79134e0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:15.352559 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53fe7f-0821-4bc2-83da-56f79134e0ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:15.352829 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53fe7f-0821-4bc2-83da-56f79134e0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:15.353104 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53fe7f-0821-4bc2-83da-56f79134e0ab admin admin] PATH_INFO: `/v3/users/36a92535158a4914aeb6e04ce5f8ac7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:15.354339 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53fe7f-0821-4bc2-83da-56f79134e0ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=36a92535158a4914aeb6e04ce5f8ac7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:15.356316 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53fe7f-0821-4bc2-83da-56f79134e0ab admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:15.537614 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:15.545869 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-3c53fe7f-0821-4bc2-83da-56f79134e0ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36a92535158a4914aeb6e04ce5f8ac7a'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:15.553198 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-3c53fe7f-0821-4bc2-83da-56f79134e0ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36a92535158a4914aeb6e04ce5f8ac7a'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:15.553926 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-3c53fe7f-0821-4bc2-83da-56f79134e0ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36a92535158a4914aeb6e04ce5f8ac7a'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:15.567104 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-3c53fe7f-0821-4bc2-83da-56f79134e0ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36a92535158a4914aeb6e04ce5f8ac7a'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:15.626274 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-3c53fe7f-0821-4bc2-83da-56f79134e0ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36a92535158a4914aeb6e04ce5f8ac7a'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:15.632617 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1405/2832] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:07:15 2022] DELETE /identity/v3/users/36a92535158a4914aeb6e04ce5f8ac7a => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:07:15.637242 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf81d57-35b9-4882-8673-edec22732d67 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:15.637728 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf81d57-35b9-4882-8673-edec22732d67 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:15.637839 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf81d57-35b9-4882-8673-edec22732d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:15.657073 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-9cf81d57-35b9-4882-8673-edec22732d67 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:07:15.658381 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-9cf81d57-35b9-4882-8673-edec22732d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:15.720141 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1428/2833] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:07:15.729753 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53fe7f-0821-4bc2-83da-56f79134e0ab admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:15.731200 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-3c53fe7f-0821-4bc2-83da-56f79134e0ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:15.791315 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53fe7f-0821-4bc2-83da-56f79134e0ab admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:15.796053 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89572f3a-9ced-4dd7-93bb-696b5078872e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:15.796707 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89572f3a-9ced-4dd7-93bb-696b5078872e service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:15.796990 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89572f3a-9ced-4dd7-93bb-696b5078872e service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:15.797266 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89572f3a-9ced-4dd7-93bb-696b5078872e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:15.806993 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89572f3a-9ced-4dd7-93bb-696b5078872e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:15.808593 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89572f3a-9ced-4dd7-93bb-696b5078872e service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:15.818834 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1406/2834] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:07:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:07:16.227423 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf81d57-35b9-4882-8673-edec22732d67 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:16.228915 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-9cf81d57-35b9-4882-8673-edec22732d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:16.243929 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf81d57-35b9-4882-8673-edec22732d67 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:16.250891 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9aa8d-5128-4d48-8845-8ff60fd5ae33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:16.251933 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9aa8d-5128-4d48-8845-8ff60fd5ae33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:16.252092 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9aa8d-5128-4d48-8845-8ff60fd5ae33 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:16.252361 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9aa8d-5128-4d48-8845-8ff60fd5ae33 admin admin] PATH_INFO: `/v3/projects/6d52ffff253941ffb7ed32baef816a8b` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:16.253632 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c9aa8d-5128-4d48-8845-8ff60fd5ae33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d52ffff253941ffb7ed32baef816a8b)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:16.255623 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c9aa8d-5128-4d48-8845-8ff60fd5ae33 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:16.400032 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-a0c9aa8d-5128-4d48-8845-8ff60fd5ae33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d52ffff253941ffb7ed32baef816a8b', 'request_id': 'req-a0c9aa8d-5128-4d48-8845-8ff60fd5ae33'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:16.407178 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-a0c9aa8d-5128-4d48-8845-8ff60fd5ae33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d52ffff253941ffb7ed32baef816a8b', 'request_id': 'req-a0c9aa8d-5128-4d48-8845-8ff60fd5ae33'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:16.529599 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-a0c9aa8d-5128-4d48-8845-8ff60fd5ae33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d52ffff253941ffb7ed32baef816a8b', 'request_id': 'req-a0c9aa8d-5128-4d48-8845-8ff60fd5ae33'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:16.536997 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=83,keystone:INSERT=3,keystone:DELETE=14 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:16.541937 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-a0c9aa8d-5128-4d48-8845-8ff60fd5ae33 admin admin] The token cache is being invalidate because project 6d52ffff253941ffb7ed32baef816a8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:07:16.542217 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-a0c9aa8d-5128-4d48-8845-8ff60fd5ae33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:16.542878 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-a0c9aa8d-5128-4d48-8845-8ff60fd5ae33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:16.545475 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1429/2835] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:07:16 2022] DELETE /identity/v3/projects/6d52ffff253941ffb7ed32baef816a8b => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:07:16.549612 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89572f3a-9ced-4dd7-93bb-696b5078872e service neutron] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:16.565211 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89572f3a-9ced-4dd7-93bb-696b5078872e service neutron] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:16.630569 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcb684-cf47-4de0-b58e-34b10b319339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:16.631450 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcb684-cf47-4de0-b58e-34b10b319339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:16.631767 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcb684-cf47-4de0-b58e-34b10b319339 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:16.632048 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcb684-cf47-4de0-b58e-34b10b319339 admin admin] PATH_INFO: `/v3/users/5b77b2e37248434bb87753d64a7d862c` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:16.633268 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fcb684-cf47-4de0-b58e-34b10b319339 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b77b2e37248434bb87753d64a7d862c)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:16.635244 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fcb684-cf47-4de0-b58e-34b10b319339 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:16.829050 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-42fcb684-cf47-4de0-b58e-34b10b319339 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b77b2e37248434bb87753d64a7d862c'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:16.836092 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-42fcb684-cf47-4de0-b58e-34b10b319339 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b77b2e37248434bb87753d64a7d862c'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:16.836774 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-42fcb684-cf47-4de0-b58e-34b10b319339 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b77b2e37248434bb87753d64a7d862c'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:16.838656 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:16.851814 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-42fcb684-cf47-4de0-b58e-34b10b319339 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b77b2e37248434bb87753d64a7d862c'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:16.963020 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-42fcb684-cf47-4de0-b58e-34b10b319339 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b77b2e37248434bb87753d64a7d862c'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:16.969586 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1407/2836] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:07:16 2022] DELETE /identity/v3/users/5b77b2e37248434bb87753d64a7d862c => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:07:17.505843 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9aa8d-5128-4d48-8845-8ff60fd5ae33 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:17.507574 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-a0c9aa8d-5128-4d48-8845-8ff60fd5ae33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:17.521116 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9aa8d-5128-4d48-8845-8ff60fd5ae33 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:17.587746 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60e4dc-c789-4402-b2a7-46768eb50d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:17.588618 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60e4dc-c789-4402-b2a7-46768eb50d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:17.588910 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60e4dc-c789-4402-b2a7-46768eb50d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:17.589193 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60e4dc-c789-4402-b2a7-46768eb50d28 admin admin] PATH_INFO: `/v3/projects/c30d747bd2044fe5b4c33d8d7e93f482` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:17.590370 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a60e4dc-c789-4402-b2a7-46768eb50d28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c30d747bd2044fe5b4c33d8d7e93f482)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:17.592388 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a60e4dc-c789-4402-b2a7-46768eb50d28 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:17.731769 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-6a60e4dc-c789-4402-b2a7-46768eb50d28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c30d747bd2044fe5b4c33d8d7e93f482', 'request_id': 'req-6a60e4dc-c789-4402-b2a7-46768eb50d28'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:17.739458 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-6a60e4dc-c789-4402-b2a7-46768eb50d28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c30d747bd2044fe5b4c33d8d7e93f482', 'request_id': 'req-6a60e4dc-c789-4402-b2a7-46768eb50d28'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:17.803280 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-6a60e4dc-c789-4402-b2a7-46768eb50d28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c30d747bd2044fe5b4c33d8d7e93f482', 'request_id': 'req-6a60e4dc-c789-4402-b2a7-46768eb50d28'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:17.815129 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-6a60e4dc-c789-4402-b2a7-46768eb50d28 admin admin] The token cache is being invalidate because project c30d747bd2044fe5b4c33d8d7e93f482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:07:17.815403 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-6a60e4dc-c789-4402-b2a7-46768eb50d28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:17.816125 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-6a60e4dc-c789-4402-b2a7-46768eb50d28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:17.817692 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1430/2837] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:07:17 2022] DELETE /identity/v3/projects/c30d747bd2044fe5b4c33d8d7e93f482 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:07:17.822975 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36531ffc-32db-48fe-8af6-388273df2d53 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:17.823536 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36531ffc-32db-48fe-8af6-388273df2d53 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:17.823676 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36531ffc-32db-48fe-8af6-388273df2d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:17.843587 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-36531ffc-32db-48fe-8af6-388273df2d53 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:07:17.847426 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-36531ffc-32db-48fe-8af6-388273df2d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:17.912677 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1408/2838] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:07:17.921634 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f189158-cce8-47bc-b7d7-d093c1a66030 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:17.921922 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f189158-cce8-47bc-b7d7-d093c1a66030 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:17.922202 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f189158-cce8-47bc-b7d7-d093c1a66030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:17.941039 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-6f189158-cce8-47bc-b7d7-d093c1a66030 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:07:17.942256 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-6f189158-cce8-47bc-b7d7-d093c1a66030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:17.950394 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1431/2839] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:07:17.955253 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36531ffc-32db-48fe-8af6-388273df2d53 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:17.965286 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36531ffc-32db-48fe-8af6-388273df2d53 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:17.970745 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0aa607-de7e-4e20-9beb-aede5833460a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:17.971396 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0aa607-de7e-4e20-9beb-aede5833460a admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:17.971718 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0aa607-de7e-4e20-9beb-aede5833460a admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:17.971996 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0aa607-de7e-4e20-9beb-aede5833460a admin admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:17.972715 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0aa607-de7e-4e20-9beb-aede5833460a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:07:17.973015 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0aa607-de7e-4e20-9beb-aede5833460a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:17.974606 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0aa607-de7e-4e20-9beb-aede5833460a admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:17.987952 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1409/2840] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 16:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:07:17.992311 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f189158-cce8-47bc-b7d7-d093c1a66030 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:18.002520 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f189158-cce8-47bc-b7d7-d093c1a66030 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:18.007217 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49c4e4-0e42-4891-b5d2-b42cde057fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:18.007910 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49c4e4-0e42-4891-b5d2-b42cde057fff admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:18.008202 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49c4e4-0e42-4891-b5d2-b42cde057fff admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:18.008482 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49c4e4-0e42-4891-b5d2-b42cde057fff admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:18.009207 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49c4e4-0e42-4891-b5d2-b42cde057fff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:18.011108 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49c4e4-0e42-4891-b5d2-b42cde057fff admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:18.127674 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1432/2841] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:07:17 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:07:18.131786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0aa607-de7e-4e20-9beb-aede5833460a admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:18.142407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0aa607-de7e-4e20-9beb-aede5833460a admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:18.203213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf6e6e-decf-4d5d-838c-cda8c22bf1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:18.203965 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf6e6e-decf-4d5d-838c-cda8c22bf1a5 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:18.204416 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf6e6e-decf-4d5d-838c-cda8c22bf1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:18.204890 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf6e6e-decf-4d5d-838c-cda8c22bf1a5 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:18.205782 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf6e6e-decf-4d5d-838c-cda8c22bf1a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:18.207927 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf6e6e-decf-4d5d-838c-cda8c22bf1a5 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:18.323561 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1410/2842] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:07:18 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:07:18.325146 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49c4e4-0e42-4891-b5d2-b42cde057fff admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:18.336810 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49c4e4-0e42-4891-b5d2-b42cde057fff admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:18.342040 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da1373-b70e-4c60-9d5c-7ea11cd06e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:18.342713 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da1373-b70e-4c60-9d5c-7ea11cd06e11 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:18.343000 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da1373-b70e-4c60-9d5c-7ea11cd06e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:18.343277 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da1373-b70e-4c60-9d5c-7ea11cd06e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:18.344054 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52da1373-b70e-4c60-9d5c-7ea11cd06e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:18.345658 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52da1373-b70e-4c60-9d5c-7ea11cd06e11 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:18.356687 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1433/2843] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:07:18.361556 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf6e6e-decf-4d5d-838c-cda8c22bf1a5 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:18.372196 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf6e6e-decf-4d5d-838c-cda8c22bf1a5 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:18.377139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44840cf1-0c06-45c3-8a3d-961c75c6256f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:18.377868 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44840cf1-0c06-45c3-8a3d-961c75c6256f admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:18.378087 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44840cf1-0c06-45c3-8a3d-961c75c6256f admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:18.378362 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44840cf1-0c06-45c3-8a3d-961c75c6256f admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:18.379087 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44840cf1-0c06-45c3-8a3d-961c75c6256f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:18.380713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44840cf1-0c06-45c3-8a3d-961c75c6256f admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:18.391360 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1411/2844] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 16:07:18.396052 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da1373-b70e-4c60-9d5c-7ea11cd06e11 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:18.407390 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da1373-b70e-4c60-9d5c-7ea11cd06e11 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:18.412056 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93beba8a-f903-436d-a8b7-971171805367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:18.412947 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93beba8a-f903-436d-a8b7-971171805367 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:18.413226 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93beba8a-f903-436d-a8b7-971171805367 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:18.413502 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93beba8a-f903-436d-a8b7-971171805367 admin admin] PATH_INFO: `/v3/projects/27574066be934246920da183b58e3b64/users/10b2e7fb30ec4b839d6f139bbd7776cb/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:18.428250 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93beba8a-f903-436d-a8b7-971171805367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27574066be934246920da183b58e3b64, user_id=10b2e7fb30ec4b839d6f139bbd7776cb, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:18.431087 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93beba8a-f903-436d-a8b7-971171805367 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:18.512863 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1434/2845] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:07:18 2022] PUT /identity/v3/projects/27574066be934246920da183b58e3b64/users/10b2e7fb30ec4b839d6f139bbd7776cb/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:07:18.526618 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c89f8a-ae9d-44d8-9fd0-7d9db93dcc90 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:18.526914 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c89f8a-ae9d-44d8-9fd0-7d9db93dcc90 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:18.527201 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c89f8a-ae9d-44d8-9fd0-7d9db93dcc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:18.555605 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-f2c89f8a-ae9d-44d8-9fd0-7d9db93dcc90 None None] MFA Rules not processed for user `10b2e7fb30ec4b839d6f139bbd7776cb`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:07:18.556880 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-f2c89f8a-ae9d-44d8-9fd0-7d9db93dcc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:18.594611 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:18.632281 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1412/2846] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:07:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:07:18.636664 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93beba8a-f903-436d-a8b7-971171805367 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:18.668320 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:18.710448 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93beba8a-f903-436d-a8b7-971171805367 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:18.716465 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff348957-0c51-43b4-ab81-28b7e48b7fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:18.717248 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff348957-0c51-43b4-ab81-28b7e48b7fcd admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:18.717538 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff348957-0c51-43b4-ab81-28b7e48b7fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:18.717819 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff348957-0c51-43b4-ab81-28b7e48b7fcd admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:18.718554 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff348957-0c51-43b4-ab81-28b7e48b7fcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:18.720682 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff348957-0c51-43b4-ab81-28b7e48b7fcd admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:18.856600 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1435/2847] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:07:18 2022] POST /identity/v3/projects => generated 383 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 16:07:18.861520 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c89f8a-ae9d-44d8-9fd0-7d9db93dcc90 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:18.873638 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c89f8a-ae9d-44d8-9fd0-7d9db93dcc90 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:18.939531 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca84e0-ff02-4261-88ea-1c7a8b0b7ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:18.940151 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca84e0-ff02-4261-88ea-1c7a8b0b7ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:18.940434 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca84e0-ff02-4261-88ea-1c7a8b0b7ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:18.940708 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca84e0-ff02-4261-88ea-1c7a8b0b7ab7 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:18.941407 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca84e0-ff02-4261-88ea-1c7a8b0b7ab7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:18.943332 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca84e0-ff02-4261-88ea-1c7a8b0b7ab7 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:19.047693 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1413/2848] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:07:18 2022] POST /identity/v3/users => generated 298 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:07:19.051897 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff348957-0c51-43b4-ab81-28b7e48b7fcd admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:19.065115 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff348957-0c51-43b4-ab81-28b7e48b7fcd admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:19.070025 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49777331-c669-4407-acb6-8db44e9940f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:19.070757 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49777331-c669-4407-acb6-8db44e9940f8 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:19.071046 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49777331-c669-4407-acb6-8db44e9940f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:19.071328 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49777331-c669-4407-acb6-8db44e9940f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:19.072131 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49777331-c669-4407-acb6-8db44e9940f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:19.073801 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49777331-c669-4407-acb6-8db44e9940f8 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:19.087670 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1436/2849] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:07:19.093883 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca84e0-ff02-4261-88ea-1c7a8b0b7ab7 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:19.106635 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca84e0-ff02-4261-88ea-1c7a8b0b7ab7 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:19.113135 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4131da-8f2a-487c-b92e-e13be40a84e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:19.114046 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4131da-8f2a-487c-b92e-e13be40a84e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:19.114355 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4131da-8f2a-487c-b92e-e13be40a84e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:19.114636 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4131da-8f2a-487c-b92e-e13be40a84e9 admin admin] PATH_INFO: `/v3/projects/14f8df844e4d48cabf7cf6d52b4c5541/users/d4ab3e9e3737425da23789f970c6aebe/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:19.132126 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4131da-8f2a-487c-b92e-e13be40a84e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14f8df844e4d48cabf7cf6d52b4c5541, user_id=d4ab3e9e3737425da23789f970c6aebe, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:19.134835 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4131da-8f2a-487c-b92e-e13be40a84e9 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:19.231068 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1414/2850] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:07:19 2022] PUT /identity/v3/projects/14f8df844e4d48cabf7cf6d52b4c5541/users/d4ab3e9e3737425da23789f970c6aebe/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:07:19.236396 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49777331-c669-4407-acb6-8db44e9940f8 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:19.252296 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49777331-c669-4407-acb6-8db44e9940f8 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:19.324214 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3f1fe-b24a-4755-b729-3d05b875a72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:19.324889 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3f1fe-b24a-4755-b729-3d05b875a72d admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:19.325176 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3f1fe-b24a-4755-b729-3d05b875a72d admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:19.325458 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3f1fe-b24a-4755-b729-3d05b875a72d admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:19.326226 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3f1fe-b24a-4755-b729-3d05b875a72d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:19.327864 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3f1fe-b24a-4755-b729-3d05b875a72d admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:19.338047 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1437/2851] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:07:19.343436 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4131da-8f2a-487c-b92e-e13be40a84e9 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:19.354473 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4131da-8f2a-487c-b92e-e13be40a84e9 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:19.360067 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35bd87-db38-44ef-bcd7-2c2a90c44b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:19.360950 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35bd87-db38-44ef-bcd7-2c2a90c44b16 admin admin] REQUEST_METHOD: `PUT` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:19.361237 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35bd87-db38-44ef-bcd7-2c2a90c44b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:19.361513 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35bd87-db38-44ef-bcd7-2c2a90c44b16 admin admin] PATH_INFO: `/v3/projects/14f8df844e4d48cabf7cf6d52b4c5541/users/d4ab3e9e3737425da23789f970c6aebe/roles/3ab888f5f68740bd8f9df4447f4f5a7a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:19.366154 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35bd87-db38-44ef-bcd7-2c2a90c44b16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14f8df844e4d48cabf7cf6d52b4c5541, user_id=d4ab3e9e3737425da23789f970c6aebe, role_id=3ab888f5f68740bd8f9df4447f4f5a7a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:19.369206 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35bd87-db38-44ef-bcd7-2c2a90c44b16 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:19.380420 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1415/2852] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:07:19 2022] PUT /identity/v3/projects/14f8df844e4d48cabf7cf6d52b4c5541/users/d4ab3e9e3737425da23789f970c6aebe/roles/3ab888f5f68740bd8f9df4447f4f5a7a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:07:19.390782 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8b5eb-4677-495d-83fa-82a8b646dc4c None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:19.391074 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8b5eb-4677-495d-83fa-82a8b646dc4c None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:19.391358 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8b5eb-4677-495d-83fa-82a8b646dc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:19.418757 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-03e8b5eb-4677-495d-83fa-82a8b646dc4c None None] MFA Rules not processed for user `d4ab3e9e3737425da23789f970c6aebe`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:07:19.421007 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-03e8b5eb-4677-495d-83fa-82a8b646dc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:19.492661 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1438/2853] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:07:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:07:19.503965 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35bd87-db38-44ef-bcd7-2c2a90c44b16 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:19.505735 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-bb35bd87-db38-44ef-bcd7-2c2a90c44b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:19.608327 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35bd87-db38-44ef-bcd7-2c2a90c44b16 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:19.612142 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306360c-abe8-4b30-a3de-cfffccb59c31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:19.612796 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306360c-abe8-4b30-a3de-cfffccb59c31 service cinder] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:19.613085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306360c-abe8-4b30-a3de-cfffccb59c31 service cinder] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:19.613368 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306360c-abe8-4b30-a3de-cfffccb59c31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:19.624005 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306360c-abe8-4b30-a3de-cfffccb59c31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:19.625483 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306360c-abe8-4b30-a3de-cfffccb59c31 service cinder] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:19.635170 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1416/2854] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:07:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:07:19.738243 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8b5eb-4677-495d-83fa-82a8b646dc4c None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:19.748809 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8b5eb-4677-495d-83fa-82a8b646dc4c None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:19.752302 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87768a-319d-41a9-8b2e-f81e8e06609f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:19.752941 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87768a-319d-41a9-8b2e-f81e8e06609f service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:19.753233 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87768a-319d-41a9-8b2e-f81e8e06609f service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:19.753507 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87768a-319d-41a9-8b2e-f81e8e06609f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:19.772518 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:19.814916 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87768a-319d-41a9-8b2e-f81e8e06609f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:19.816431 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87768a-319d-41a9-8b2e-f81e8e06609f service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:19.826464 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1439/2855] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:07:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:07:22.956395 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306360c-abe8-4b30-a3de-cfffccb59c31 service cinder] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:22.965280 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:23.019222 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306360c-abe8-4b30-a3de-cfffccb59c31 service cinder] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:23.024052 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9ae03-a9df-4e47-b15a-5d7ac7e98211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:23.024945 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9ae03-a9df-4e47-b15a-5d7ac7e98211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:23.025232 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9ae03-a9df-4e47-b15a-5d7ac7e98211 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:23.025509 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9ae03-a9df-4e47-b15a-5d7ac7e98211 admin admin] PATH_INFO: `/v3/users/10b2e7fb30ec4b839d6f139bbd7776cb` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:23.026727 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9ae03-a9df-4e47-b15a-5d7ac7e98211 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10b2e7fb30ec4b839d6f139bbd7776cb)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:23.028769 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9ae03-a9df-4e47-b15a-5d7ac7e98211 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:23.215166 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-3cd9ae03-a9df-4e47-b15a-5d7ac7e98211 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10b2e7fb30ec4b839d6f139bbd7776cb'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:23.222003 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-3cd9ae03-a9df-4e47-b15a-5d7ac7e98211 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10b2e7fb30ec4b839d6f139bbd7776cb'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:23.222679 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-3cd9ae03-a9df-4e47-b15a-5d7ac7e98211 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10b2e7fb30ec4b839d6f139bbd7776cb'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:23.234270 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-3cd9ae03-a9df-4e47-b15a-5d7ac7e98211 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10b2e7fb30ec4b839d6f139bbd7776cb'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:23.294303 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-3cd9ae03-a9df-4e47-b15a-5d7ac7e98211 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10b2e7fb30ec4b839d6f139bbd7776cb'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:23.301916 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1417/2856] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:07:22 2022] DELETE /identity/v3/users/10b2e7fb30ec4b839d6f139bbd7776cb => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:07:23.306802 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c66a25-c321-4933-869f-7c5c5d65c510 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:23.307295 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c66a25-c321-4933-869f-7c5c5d65c510 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:23.307413 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c66a25-c321-4933-869f-7c5c5d65c510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:23.325163 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-e0c66a25-c321-4933-869f-7c5c5d65c510 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:07:23.326524 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-e0c66a25-c321-4933-869f-7c5c5d65c510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:23.386843 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1440/2857] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:07:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:07:23.396979 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9ae03-a9df-4e47-b15a-5d7ac7e98211 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:23.398353 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-3cd9ae03-a9df-4e47-b15a-5d7ac7e98211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:23.457206 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9ae03-a9df-4e47-b15a-5d7ac7e98211 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:23.460961 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b4aea-e88e-4401-8394-70a7b2c14107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:23.461607 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b4aea-e88e-4401-8394-70a7b2c14107 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:23.461894 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b4aea-e88e-4401-8394-70a7b2c14107 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:23.462171 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b4aea-e88e-4401-8394-70a7b2c14107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:23.472155 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b4aea-e88e-4401-8394-70a7b2c14107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:23.473599 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b4aea-e88e-4401-8394-70a7b2c14107 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:23.485543 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1418/2858] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:07:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:07:23.891482 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c66a25-c321-4933-869f-7c5c5d65c510 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:23.892970 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-e0c66a25-c321-4933-869f-7c5c5d65c510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:23.905401 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c66a25-c321-4933-869f-7c5c5d65c510 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:23.911136 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635964e1-d8bc-4802-b7d1-bdba89f5023e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:23.912030 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635964e1-d8bc-4802-b7d1-bdba89f5023e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:23.912319 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635964e1-d8bc-4802-b7d1-bdba89f5023e admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:23.912602 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635964e1-d8bc-4802-b7d1-bdba89f5023e admin admin] PATH_INFO: `/v3/projects/27574066be934246920da183b58e3b64` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:23.913862 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635964e1-d8bc-4802-b7d1-bdba89f5023e admin admin] RBAC: Authorizing `identity:delete_project(project_id=27574066be934246920da183b58e3b64)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:23.923357 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635964e1-d8bc-4802-b7d1-bdba89f5023e admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:24.080278 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-635964e1-d8bc-4802-b7d1-bdba89f5023e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27574066be934246920da183b58e3b64', 'request_id': 'req-635964e1-d8bc-4802-b7d1-bdba89f5023e'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:24.086517 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-635964e1-d8bc-4802-b7d1-bdba89f5023e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27574066be934246920da183b58e3b64', 'request_id': 'req-635964e1-d8bc-4802-b7d1-bdba89f5023e'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:24.186475 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-635964e1-d8bc-4802-b7d1-bdba89f5023e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27574066be934246920da183b58e3b64', 'request_id': 'req-635964e1-d8bc-4802-b7d1-bdba89f5023e'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:24.197932 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-635964e1-d8bc-4802-b7d1-bdba89f5023e admin admin] The token cache is being invalidate because project 27574066be934246920da183b58e3b64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:07:24.198221 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-635964e1-d8bc-4802-b7d1-bdba89f5023e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:24.198857 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-635964e1-d8bc-4802-b7d1-bdba89f5023e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:24.200617 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1441/2859] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:07:23 2022] DELETE /identity/v3/projects/27574066be934246920da183b58e3b64 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:07:24.204757 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b4aea-e88e-4401-8394-70a7b2c14107 service neutron] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:24.215179 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b4aea-e88e-4401-8394-70a7b2c14107 service neutron] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:24.241977 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:24.272237 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71828f73-d2ed-41a1-ad95-870f0bf7977a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:24.273113 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71828f73-d2ed-41a1-ad95-870f0bf7977a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:24.273395 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71828f73-d2ed-41a1-ad95-870f0bf7977a admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:24.273665 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71828f73-d2ed-41a1-ad95-870f0bf7977a admin admin] PATH_INFO: `/v3/users/d4ab3e9e3737425da23789f970c6aebe` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:24.274845 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71828f73-d2ed-41a1-ad95-870f0bf7977a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4ab3e9e3737425da23789f970c6aebe)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:24.276809 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71828f73-d2ed-41a1-ad95-870f0bf7977a admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:24.498842 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-71828f73-d2ed-41a1-ad95-870f0bf7977a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4ab3e9e3737425da23789f970c6aebe'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:24.499961 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-71828f73-d2ed-41a1-ad95-870f0bf7977a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4ab3e9e3737425da23789f970c6aebe'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:24.500701 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-71828f73-d2ed-41a1-ad95-870f0bf7977a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4ab3e9e3737425da23789f970c6aebe'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:24.512527 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-71828f73-d2ed-41a1-ad95-870f0bf7977a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4ab3e9e3737425da23789f970c6aebe'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:24.616899 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-71828f73-d2ed-41a1-ad95-870f0bf7977a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4ab3e9e3737425da23789f970c6aebe'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:24.624131 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1419/2860] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:07:24 2022] DELETE /identity/v3/users/d4ab3e9e3737425da23789f970c6aebe => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:07:25.046622 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635964e1-d8bc-4802-b7d1-bdba89f5023e admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:25.048131 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-635964e1-d8bc-4802-b7d1-bdba89f5023e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:25.065046 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635964e1-d8bc-4802-b7d1-bdba89f5023e admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:25.106481 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:25.124260 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd75f6-8fb0-4471-8054-a41ea4fbf1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:25.125363 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd75f6-8fb0-4471-8054-a41ea4fbf1d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:25.125685 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd75f6-8fb0-4471-8054-a41ea4fbf1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:25.125998 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd75f6-8fb0-4471-8054-a41ea4fbf1d0 admin admin] PATH_INFO: `/v3/projects/14f8df844e4d48cabf7cf6d52b4c5541` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:25.127273 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd75f6-8fb0-4471-8054-a41ea4fbf1d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14f8df844e4d48cabf7cf6d52b4c5541)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:25.129468 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd75f6-8fb0-4471-8054-a41ea4fbf1d0 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:25.244048 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-2ccd75f6-8fb0-4471-8054-a41ea4fbf1d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14f8df844e4d48cabf7cf6d52b4c5541', 'request_id': 'req-2ccd75f6-8fb0-4471-8054-a41ea4fbf1d0'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:25.250343 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-2ccd75f6-8fb0-4471-8054-a41ea4fbf1d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14f8df844e4d48cabf7cf6d52b4c5541', 'request_id': 'req-2ccd75f6-8fb0-4471-8054-a41ea4fbf1d0'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:25.340362 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-2ccd75f6-8fb0-4471-8054-a41ea4fbf1d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14f8df844e4d48cabf7cf6d52b4c5541', 'request_id': 'req-2ccd75f6-8fb0-4471-8054-a41ea4fbf1d0'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:25.352208 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-2ccd75f6-8fb0-4471-8054-a41ea4fbf1d0 admin admin] The token cache is being invalidate because project 14f8df844e4d48cabf7cf6d52b4c5541 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:07:25.352500 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-2ccd75f6-8fb0-4471-8054-a41ea4fbf1d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:25.353155 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-2ccd75f6-8fb0-4471-8054-a41ea4fbf1d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:25.354705 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1442/2861] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:07:25 2022] DELETE /identity/v3/projects/14f8df844e4d48cabf7cf6d52b4c5541 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:07:25.361632 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8529d-e2a8-48f9-97c9-c4d0ce5676e8 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:25.362112 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8529d-e2a8-48f9-97c9-c4d0ce5676e8 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:25.362236 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8529d-e2a8-48f9-97c9-c4d0ce5676e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:25.380134 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-62d8529d-e2a8-48f9-97c9-c4d0ce5676e8 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:07:25.381340 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-62d8529d-e2a8-48f9-97c9-c4d0ce5676e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:25.441481 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1420/2862] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:07:25.449882 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738819c-0c75-46fb-845c-e47c2e00d2e3 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:25.450179 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738819c-0c75-46fb-845c-e47c2e00d2e3 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:25.450465 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738819c-0c75-46fb-845c-e47c2e00d2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:25.469947 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-f738819c-0c75-46fb-845c-e47c2e00d2e3 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:07:25.471149 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-f738819c-0c75-46fb-845c-e47c2e00d2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:25.479096 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1443/2863] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:07:25.484005 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8529d-e2a8-48f9-97c9-c4d0ce5676e8 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:25.493798 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8529d-e2a8-48f9-97c9-c4d0ce5676e8 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:25.498410 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842eab9-e66e-4cbd-b708-4b2aeb8f3dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:25.499414 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842eab9-e66e-4cbd-b708-4b2aeb8f3dbd admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:25.499749 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842eab9-e66e-4cbd-b708-4b2aeb8f3dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:25.500035 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842eab9-e66e-4cbd-b708-4b2aeb8f3dbd admin admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:25.500765 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842eab9-e66e-4cbd-b708-4b2aeb8f3dbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:07:25.501072 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842eab9-e66e-4cbd-b708-4b2aeb8f3dbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:25.502677 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842eab9-e66e-4cbd-b708-4b2aeb8f3dbd admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:25.515125 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1421/2864] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 16:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:07:25.519530 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738819c-0c75-46fb-845c-e47c2e00d2e3 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:25.529007 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738819c-0c75-46fb-845c-e47c2e00d2e3 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:25.534374 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b997727-51e0-4a8b-8499-153d44dc6163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:25.535035 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b997727-51e0-4a8b-8499-153d44dc6163 admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:25.535318 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b997727-51e0-4a8b-8499-153d44dc6163 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:25.535613 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b997727-51e0-4a8b-8499-153d44dc6163 admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:25.536311 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b997727-51e0-4a8b-8499-153d44dc6163 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:25.538253 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b997727-51e0-4a8b-8499-153d44dc6163 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:25.621876 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1444/2865] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:07:25 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:07:25.625954 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842eab9-e66e-4cbd-b708-4b2aeb8f3dbd admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:25.636117 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842eab9-e66e-4cbd-b708-4b2aeb8f3dbd admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:25.670229 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:25.693160 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1ebb7-5ebe-4ac3-b0fb-db492526f1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:25.693819 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1ebb7-5ebe-4ac3-b0fb-db492526f1b4 admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:25.694099 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1ebb7-5ebe-4ac3-b0fb-db492526f1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:25.694371 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1ebb7-5ebe-4ac3-b0fb-db492526f1b4 admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:25.695054 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1ebb7-5ebe-4ac3-b0fb-db492526f1b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:25.697027 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1ebb7-5ebe-4ac3-b0fb-db492526f1b4 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:25.781548 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1422/2866] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:07:25 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:07:25.785492 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b997727-51e0-4a8b-8499-153d44dc6163 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:25.797020 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b997727-51e0-4a8b-8499-153d44dc6163 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:25.801853 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa0c8b-6e2c-410b-b6bf-6b78d08d172b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:25.802521 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa0c8b-6e2c-410b-b6bf-6b78d08d172b admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:25.802811 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa0c8b-6e2c-410b-b6bf-6b78d08d172b admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:25.803692 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa0c8b-6e2c-410b-b6bf-6b78d08d172b admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:25.803933 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa0c8b-6e2c-410b-b6bf-6b78d08d172b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:25.805567 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa0c8b-6e2c-410b-b6bf-6b78d08d172b admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:25.816595 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1445/2867] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:07:25.820489 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1ebb7-5ebe-4ac3-b0fb-db492526f1b4 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:25.831280 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1ebb7-5ebe-4ac3-b0fb-db492526f1b4 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:25.836853 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b44b0-f8c0-4416-ba2f-cf77e3ff1ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:25.836853 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b44b0-f8c0-4416-ba2f-cf77e3ff1ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:25.837062 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b44b0-f8c0-4416-ba2f-cf77e3ff1ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:25.837174 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b44b0-f8c0-4416-ba2f-cf77e3ff1ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:25.837917 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b44b0-f8c0-4416-ba2f-cf77e3ff1ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:25.839510 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b44b0-f8c0-4416-ba2f-cf77e3ff1ba6 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:25.851209 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1423/2868] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:07:25.855399 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa0c8b-6e2c-410b-b6bf-6b78d08d172b admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:25.866391 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa0c8b-6e2c-410b-b6bf-6b78d08d172b admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:25.871106 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db121f2e-94b9-4cc2-be3c-48b72acffb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:25.872029 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db121f2e-94b9-4cc2-be3c-48b72acffb4d admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:25.872320 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db121f2e-94b9-4cc2-be3c-48b72acffb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:25.872619 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db121f2e-94b9-4cc2-be3c-48b72acffb4d admin admin] PATH_INFO: `/v3/projects/d959217c9f124ef9b2c5f5e7a31b01f7/users/39218d0380c6459d926a9b415697bb3d/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:25.888608 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db121f2e-94b9-4cc2-be3c-48b72acffb4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d959217c9f124ef9b2c5f5e7a31b01f7, user_id=39218d0380c6459d926a9b415697bb3d, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:25.891974 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db121f2e-94b9-4cc2-be3c-48b72acffb4d admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:25.960657 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1446/2869] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:07:25 2022] PUT /identity/v3/projects/d959217c9f124ef9b2c5f5e7a31b01f7/users/39218d0380c6459d926a9b415697bb3d/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:07:25.972980 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ee5fa-634c-4aea-8d9d-b8252764b693 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:25.973296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ee5fa-634c-4aea-8d9d-b8252764b693 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:25.973573 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ee5fa-634c-4aea-8d9d-b8252764b693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:26.000196 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-d67ee5fa-634c-4aea-8d9d-b8252764b693 None None] MFA Rules not processed for user `39218d0380c6459d926a9b415697bb3d`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:07:26.001401 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-d67ee5fa-634c-4aea-8d9d-b8252764b693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:26.067131 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1424/2870] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:07:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:07:26.079007 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db121f2e-94b9-4cc2-be3c-48b72acffb4d admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:26.080822 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-db121f2e-94b9-4cc2-be3c-48b72acffb4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:26.140330 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db121f2e-94b9-4cc2-be3c-48b72acffb4d admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:26.143933 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f83d26-5324-421a-b451-be80cc6fa4a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:26.144580 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f83d26-5324-421a-b451-be80cc6fa4a2 service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:26.144864 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f83d26-5324-421a-b451-be80cc6fa4a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:26.145139 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f83d26-5324-421a-b451-be80cc6fa4a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:26.153546 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f83d26-5324-421a-b451-be80cc6fa4a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:26.155036 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f83d26-5324-421a-b451-be80cc6fa4a2 service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:26.164153 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1447/2871] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:07:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:07:30.383682 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ee5fa-634c-4aea-8d9d-b8252764b693 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:30.450505 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ee5fa-634c-4aea-8d9d-b8252764b693 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:30.456691 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1e07a-08e4-42ad-8a0d-ee6c27bdbab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:30.457578 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1e07a-08e4-42ad-8a0d-ee6c27bdbab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:30.458015 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1e07a-08e4-42ad-8a0d-ee6c27bdbab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:30.458313 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1e07a-08e4-42ad-8a0d-ee6c27bdbab1 admin admin] PATH_INFO: `/v3/users/39218d0380c6459d926a9b415697bb3d` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:30.459501 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1e07a-08e4-42ad-8a0d-ee6c27bdbab1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39218d0380c6459d926a9b415697bb3d)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:30.461583 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1e07a-08e4-42ad-8a0d-ee6c27bdbab1 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:30.710069 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:30.711570 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-dce1e07a-08e4-42ad-8a0d-ee6c27bdbab1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39218d0380c6459d926a9b415697bb3d'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:30.718430 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-dce1e07a-08e4-42ad-8a0d-ee6c27bdbab1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39218d0380c6459d926a9b415697bb3d'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:30.719144 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-dce1e07a-08e4-42ad-8a0d-ee6c27bdbab1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39218d0380c6459d926a9b415697bb3d'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:30.730792 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-dce1e07a-08e4-42ad-8a0d-ee6c27bdbab1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39218d0380c6459d926a9b415697bb3d'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:30.868815 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-dce1e07a-08e4-42ad-8a0d-ee6c27bdbab1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39218d0380c6459d926a9b415697bb3d'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:30.875805 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1425/2872] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:07:30 2022] DELETE /identity/v3/users/39218d0380c6459d926a9b415697bb3d => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:07:30.881124 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35aa1f-e983-474a-922b-0ce90ba3e94d None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:30.881673 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35aa1f-e983-474a-922b-0ce90ba3e94d None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:30.881673 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35aa1f-e983-474a-922b-0ce90ba3e94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:30.899919 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-af35aa1f-e983-474a-922b-0ce90ba3e94d None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:07:30.901180 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-af35aa1f-e983-474a-922b-0ce90ba3e94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:30.906981 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:30.961727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1448/2873] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:07:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:07:30.972295 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1e07a-08e4-42ad-8a0d-ee6c27bdbab1 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:30.974510 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-dce1e07a-08e4-42ad-8a0d-ee6c27bdbab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:31.034278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1e07a-08e4-42ad-8a0d-ee6c27bdbab1 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:31.038230 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5430c6e-aad5-4178-b343-77b060d3913a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:31.038968 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5430c6e-aad5-4178-b343-77b060d3913a service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:31.039249 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5430c6e-aad5-4178-b343-77b060d3913a service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:31.039521 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5430c6e-aad5-4178-b343-77b060d3913a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:31.049503 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5430c6e-aad5-4178-b343-77b060d3913a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:31.051264 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5430c6e-aad5-4178-b343-77b060d3913a service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:31.061642 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1426/2874] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:07:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:07:31.498738 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35aa1f-e983-474a-922b-0ce90ba3e94d None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:31.501218 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-af35aa1f-e983-474a-922b-0ce90ba3e94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:31.521590 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35aa1f-e983-474a-922b-0ce90ba3e94d None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:31.527529 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac754c-3bdc-4c94-8a3e-4bd2172045b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:31.528337 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac754c-3bdc-4c94-8a3e-4bd2172045b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:31.528668 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac754c-3bdc-4c94-8a3e-4bd2172045b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:31.528966 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac754c-3bdc-4c94-8a3e-4bd2172045b1 admin admin] PATH_INFO: `/v3/projects/d959217c9f124ef9b2c5f5e7a31b01f7` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:31.530466 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac754c-3bdc-4c94-8a3e-4bd2172045b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d959217c9f124ef9b2c5f5e7a31b01f7)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:31.534455 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac754c-3bdc-4c94-8a3e-4bd2172045b1 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:31.657134 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-2cac754c-3bdc-4c94-8a3e-4bd2172045b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd959217c9f124ef9b2c5f5e7a31b01f7', 'request_id': 'req-2cac754c-3bdc-4c94-8a3e-4bd2172045b1'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:31.663614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-2cac754c-3bdc-4c94-8a3e-4bd2172045b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd959217c9f124ef9b2c5f5e7a31b01f7', 'request_id': 'req-2cac754c-3bdc-4c94-8a3e-4bd2172045b1'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:31.771167 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-2cac754c-3bdc-4c94-8a3e-4bd2172045b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd959217c9f124ef9b2c5f5e7a31b01f7', 'request_id': 'req-2cac754c-3bdc-4c94-8a3e-4bd2172045b1'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:31.782477 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-2cac754c-3bdc-4c94-8a3e-4bd2172045b1 admin admin] The token cache is being invalidate because project d959217c9f124ef9b2c5f5e7a31b01f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:07:31.782767 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-2cac754c-3bdc-4c94-8a3e-4bd2172045b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:31.783396 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-2cac754c-3bdc-4c94-8a3e-4bd2172045b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:31.785159 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1449/2875] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:07:31 2022] DELETE /identity/v3/projects/d959217c9f124ef9b2c5f5e7a31b01f7 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:07:31.790139 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb42f1-ae5a-46fd-b067-cd8d07569bf3 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:31.790626 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb42f1-ae5a-46fd-b067-cd8d07569bf3 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:31.790725 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb42f1-ae5a-46fd-b067-cd8d07569bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:31.809213 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-6ebb42f1-ae5a-46fd-b067-cd8d07569bf3 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:07:31.810454 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-6ebb42f1-ae5a-46fd-b067-cd8d07569bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:31.870659 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1427/2876] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:07:31.878736 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b03c0-9288-4bd6-bf70-442cf7644fde None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:31.879029 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b03c0-9288-4bd6-bf70-442cf7644fde None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:31.879314 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b03c0-9288-4bd6-bf70-442cf7644fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:31.897720 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-ce1b03c0-9288-4bd6-bf70-442cf7644fde None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:07:31.898921 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-ce1b03c0-9288-4bd6-bf70-442cf7644fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:31.907581 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1450/2877] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:07:31.911823 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb42f1-ae5a-46fd-b067-cd8d07569bf3 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:31.922424 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb42f1-ae5a-46fd-b067-cd8d07569bf3 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:31.926991 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d5381-61f0-4098-9627-95672963f75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:31.927689 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d5381-61f0-4098-9627-95672963f75b admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:31.927974 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d5381-61f0-4098-9627-95672963f75b admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:31.928249 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d5381-61f0-4098-9627-95672963f75b admin admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:31.928999 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d5381-61f0-4098-9627-95672963f75b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:07:31.929305 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d5381-61f0-4098-9627-95672963f75b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:31.930897 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d5381-61f0-4098-9627-95672963f75b admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:31.943222 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1428/2878] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 16:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:07:31.960991 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b03c0-9288-4bd6-bf70-442cf7644fde None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:31.971499 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b03c0-9288-4bd6-bf70-442cf7644fde None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:31.976329 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fa895-15a1-4b54-b0c7-9982862d188a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:31.977029 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fa895-15a1-4b54-b0c7-9982862d188a admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:31.977316 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fa895-15a1-4b54-b0c7-9982862d188a admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:31.977597 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fa895-15a1-4b54-b0c7-9982862d188a admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:31.978295 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067fa895-15a1-4b54-b0c7-9982862d188a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:31.980270 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067fa895-15a1-4b54-b0c7-9982862d188a admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:32.110778 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1451/2879] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:07:31 2022] POST /identity/v3/projects => generated 389 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:07:32.114936 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d5381-61f0-4098-9627-95672963f75b admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:32.125181 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d5381-61f0-4098-9627-95672963f75b admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:32.174711 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:32.183484 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818482a-4cd9-4b9c-a4b8-f7c7c14a0dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:32.184248 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818482a-4cd9-4b9c-a4b8-f7c7c14a0dfb admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:32.184525 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818482a-4cd9-4b9c-a4b8-f7c7c14a0dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:32.184796 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818482a-4cd9-4b9c-a4b8-f7c7c14a0dfb admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:32.185494 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818482a-4cd9-4b9c-a4b8-f7c7c14a0dfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:32.187460 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818482a-4cd9-4b9c-a4b8-f7c7c14a0dfb admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:32.272734 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1429/2880] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:07:32 2022] POST /identity/v3/users => generated 295 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:07:32.276935 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fa895-15a1-4b54-b0c7-9982862d188a admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:32.288471 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fa895-15a1-4b54-b0c7-9982862d188a admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:32.293202 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66505c-b2cd-4a40-9acd-9e6c34be1b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:32.293860 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66505c-b2cd-4a40-9acd-9e6c34be1b05 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:32.294147 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66505c-b2cd-4a40-9acd-9e6c34be1b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:32.294427 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66505c-b2cd-4a40-9acd-9e6c34be1b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:32.295486 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66505c-b2cd-4a40-9acd-9e6c34be1b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:32.297247 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66505c-b2cd-4a40-9acd-9e6c34be1b05 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:32.308436 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1452/2881] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:07:32.312601 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818482a-4cd9-4b9c-a4b8-f7c7c14a0dfb admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:32.322932 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818482a-4cd9-4b9c-a4b8-f7c7c14a0dfb admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:32.327565 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d11b8-850a-4588-9fc9-d02ce488fe5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:32.328786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d11b8-850a-4588-9fc9-d02ce488fe5c admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:32.329049 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d11b8-850a-4588-9fc9-d02ce488fe5c admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:32.329368 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d11b8-850a-4588-9fc9-d02ce488fe5c admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:32.330092 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d11b8-850a-4588-9fc9-d02ce488fe5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:32.331710 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d11b8-850a-4588-9fc9-d02ce488fe5c admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:32.342799 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1430/2882] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:07:32.347505 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66505c-b2cd-4a40-9acd-9e6c34be1b05 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:32.357741 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66505c-b2cd-4a40-9acd-9e6c34be1b05 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:32.363027 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cadfb0e-7764-4cb1-be9c-74188120ea46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:32.363950 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadfb0e-7764-4cb1-be9c-74188120ea46 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:32.364238 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadfb0e-7764-4cb1-be9c-74188120ea46 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:32.364517 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadfb0e-7764-4cb1-be9c-74188120ea46 admin admin] PATH_INFO: `/v3/projects/20917c35fad34f64b95d86f6819611ae/users/872cb56911ca4c6c8c1f6d620cf14ad0/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:32.379237 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cadfb0e-7764-4cb1-be9c-74188120ea46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20917c35fad34f64b95d86f6819611ae, user_id=872cb56911ca4c6c8c1f6d620cf14ad0, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:32.381976 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cadfb0e-7764-4cb1-be9c-74188120ea46 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:32.451460 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1453/2883] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:07:32 2022] PUT /identity/v3/projects/20917c35fad34f64b95d86f6819611ae/users/872cb56911ca4c6c8c1f6d620cf14ad0/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:07:32.463533 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8d1ec-2842-472a-9d80-9f8c3d9110d5 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:32.463864 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8d1ec-2842-472a-9d80-9f8c3d9110d5 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:32.464148 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8d1ec-2842-472a-9d80-9f8c3d9110d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:32.494248 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-44c8d1ec-2842-472a-9d80-9f8c3d9110d5 None None] MFA Rules not processed for user `872cb56911ca4c6c8c1f6d620cf14ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:07:32.495477 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-44c8d1ec-2842-472a-9d80-9f8c3d9110d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:32.562436 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1431/2884] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:07:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:07:32.573229 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cadfb0e-7764-4cb1-be9c-74188120ea46 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:32.574904 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-4cadfb0e-7764-4cb1-be9c-74188120ea46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:32.610828 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:32.634373 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cadfb0e-7764-4cb1-be9c-74188120ea46 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:32.638076 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324791e-9528-4906-ab42-d3ad8da4bb27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:32.638730 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324791e-9528-4906-ab42-d3ad8da4bb27 service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:32.639007 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324791e-9528-4906-ab42-d3ad8da4bb27 service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:32.639281 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324791e-9528-4906-ab42-d3ad8da4bb27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:32.649810 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324791e-9528-4906-ab42-d3ad8da4bb27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:32.651324 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324791e-9528-4906-ab42-d3ad8da4bb27 service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:32.660857 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1454/2885] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:07:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:07:42.559481 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=42,keystone:INSERT=3 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:42.699530 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=12 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:44.397674 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8d1ec-2842-472a-9d80-9f8c3d9110d5 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:44.399107 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-44c8d1ec-2842-472a-9d80-9f8c3d9110d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:44.465166 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8d1ec-2842-472a-9d80-9f8c3d9110d5 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:44.470034 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3194128-3e5a-4fc7-8d95-bdf3909b8f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:44.471522 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3194128-3e5a-4fc7-8d95-bdf3909b8f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:44.471830 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3194128-3e5a-4fc7-8d95-bdf3909b8f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:44.472674 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3194128-3e5a-4fc7-8d95-bdf3909b8f95 admin admin] PATH_INFO: `/v3/users/b2bc82368db94c66833ef404610e3661` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:44.473296 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3194128-3e5a-4fc7-8d95-bdf3909b8f95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2bc82368db94c66833ef404610e3661)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:44.475266 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3194128-3e5a-4fc7-8d95-bdf3909b8f95 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:44.636351 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e3194128-3e5a-4fc7-8d95-bdf3909b8f95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2bc82368db94c66833ef404610e3661'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:44.644067 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e3194128-3e5a-4fc7-8d95-bdf3909b8f95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2bc82368db94c66833ef404610e3661'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:44.644769 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e3194128-3e5a-4fc7-8d95-bdf3909b8f95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2bc82368db94c66833ef404610e3661'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:44.657251 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e3194128-3e5a-4fc7-8d95-bdf3909b8f95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2bc82368db94c66833ef404610e3661'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:44.754397 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e3194128-3e5a-4fc7-8d95-bdf3909b8f95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2bc82368db94c66833ef404610e3661'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:44.760923 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1432/2886] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:07:44 2022] DELETE /identity/v3/users/b2bc82368db94c66833ef404610e3661 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:07:44.765709 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcf220-9fd6-408b-8d54-1bf11189f8fc None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:44.766213 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcf220-9fd6-408b-8d54-1bf11189f8fc None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:44.766354 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcf220-9fd6-408b-8d54-1bf11189f8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:44.784371 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-c9bcf220-9fd6-408b-8d54-1bf11189f8fc None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:07:44.785577 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-c9bcf220-9fd6-408b-8d54-1bf11189f8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:44.846707 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1455/2887] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:07:44.856619 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3194128-3e5a-4fc7-8d95-bdf3909b8f95 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:44.858032 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-e3194128-3e5a-4fc7-8d95-bdf3909b8f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:44.917969 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3194128-3e5a-4fc7-8d95-bdf3909b8f95 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:44.921869 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aca0f4-dcb7-4033-9efb-49af33edce14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:44.922510 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aca0f4-dcb7-4033-9efb-49af33edce14 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:44.922794 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aca0f4-dcb7-4033-9efb-49af33edce14 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:44.923158 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aca0f4-dcb7-4033-9efb-49af33edce14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:44.934885 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aca0f4-dcb7-4033-9efb-49af33edce14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:44.936361 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aca0f4-dcb7-4033-9efb-49af33edce14 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:44.946825 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1433/2888] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:07:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:07:45.383352 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bcf220-9fd6-408b-8d54-1bf11189f8fc None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:45.384760 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-c9bcf220-9fd6-408b-8d54-1bf11189f8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:45.389823 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aca0f4-dcb7-4033-9efb-49af33edce14 service neutron] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:45.392077 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-20aca0f4-dcb7-4033-9efb-49af33edce14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:45.398475 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bcf220-9fd6-408b-8d54-1bf11189f8fc None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:45.403711 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5dde6-382f-41b4-b361-64c53eba56bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:45.404642 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5dde6-382f-41b4-b361-64c53eba56bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:45.404938 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5dde6-382f-41b4-b361-64c53eba56bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:45.405219 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5dde6-382f-41b4-b361-64c53eba56bf admin admin] PATH_INFO: `/v3/projects/b2b5e63aa94b4122962ac21a7a377a2b` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:45.406441 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd5dde6-382f-41b4-b361-64c53eba56bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2b5e63aa94b4122962ac21a7a377a2b)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:45.407016 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aca0f4-dcb7-4033-9efb-49af33edce14 service neutron] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:45.409047 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd5dde6-382f-41b4-b361-64c53eba56bf admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:45.414626 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc416d7-8b1e-4bc1-8b90-4402c87a21a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:45.414983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc416d7-8b1e-4bc1-8b90-4402c87a21a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:45.415267 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc416d7-8b1e-4bc1-8b90-4402c87a21a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:45.415548 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc416d7-8b1e-4bc1-8b90-4402c87a21a6 admin admin] PATH_INFO: `/v3/users/872cb56911ca4c6c8c1f6d620cf14ad0` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:45.416862 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc416d7-8b1e-4bc1-8b90-4402c87a21a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=872cb56911ca4c6c8c1f6d620cf14ad0)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:45.419452 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc416d7-8b1e-4bc1-8b90-4402c87a21a6 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:45.438085 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:45.547275 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-ecd5dde6-382f-41b4-b361-64c53eba56bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2b5e63aa94b4122962ac21a7a377a2b', 'request_id': 'req-ecd5dde6-382f-41b4-b361-64c53eba56bf'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:45.554416 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-ecd5dde6-382f-41b4-b361-64c53eba56bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2b5e63aa94b4122962ac21a7a377a2b', 'request_id': 'req-ecd5dde6-382f-41b4-b361-64c53eba56bf'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:45.668108 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-ecd5dde6-382f-41b4-b361-64c53eba56bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2b5e63aa94b4122962ac21a7a377a2b', 'request_id': 'req-ecd5dde6-382f-41b4-b361-64c53eba56bf'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:45.682890 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-ecd5dde6-382f-41b4-b361-64c53eba56bf admin admin] The token cache is being invalidate because project b2b5e63aa94b4122962ac21a7a377a2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:07:45.683318 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-ecd5dde6-382f-41b4-b361-64c53eba56bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:45.684217 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-ecd5dde6-382f-41b4-b361-64c53eba56bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:45.684514 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-4bc416d7-8b1e-4bc1-8b90-4402c87a21a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '872cb56911ca4c6c8c1f6d620cf14ad0'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:45.686186 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1456/2889] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:07:45 2022] DELETE /identity/v3/projects/b2b5e63aa94b4122962ac21a7a377a2b => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:07:45.692713 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-4bc416d7-8b1e-4bc1-8b90-4402c87a21a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '872cb56911ca4c6c8c1f6d620cf14ad0'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:45.746323 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-4bc416d7-8b1e-4bc1-8b90-4402c87a21a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '872cb56911ca4c6c8c1f6d620cf14ad0'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:45.746323 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-4bc416d7-8b1e-4bc1-8b90-4402c87a21a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '872cb56911ca4c6c8c1f6d620cf14ad0'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:45.833615 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-4bc416d7-8b1e-4bc1-8b90-4402c87a21a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '872cb56911ca4c6c8c1f6d620cf14ad0'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:45.840964 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1434/2890] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:07:45 2022] DELETE /identity/v3/users/872cb56911ca4c6c8c1f6d620cf14ad0 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:07:45.846745 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb7d42-3b44-4187-a9e2-8d604c4fa6bb None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:45.846745 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb7d42-3b44-4187-a9e2-8d604c4fa6bb None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:45.849143 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb7d42-3b44-4187-a9e2-8d604c4fa6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:45.866887 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-eceb7d42-3b44-4187-a9e2-8d604c4fa6bb None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:07:45.868877 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-eceb7d42-3b44-4187-a9e2-8d604c4fa6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:45.936662 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1457/2891] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:07:45.946628 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc416d7-8b1e-4bc1-8b90-4402c87a21a6 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:45.948095 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-4bc416d7-8b1e-4bc1-8b90-4402c87a21a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:46.006045 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc416d7-8b1e-4bc1-8b90-4402c87a21a6 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:46.009644 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01403fc9-de82-4339-bd86-3134748b4b5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:46.010291 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01403fc9-de82-4339-bd86-3134748b4b5f service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:46.010574 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01403fc9-de82-4339-bd86-3134748b4b5f service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:46.010854 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01403fc9-de82-4339-bd86-3134748b4b5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:46.021449 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01403fc9-de82-4339-bd86-3134748b4b5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:46.023128 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01403fc9-de82-4339-bd86-3134748b4b5f service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:46.033232 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1435/2892] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:07:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:07:46.497607 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb7d42-3b44-4187-a9e2-8d604c4fa6bb None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:46.499041 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-eceb7d42-3b44-4187-a9e2-8d604c4fa6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:46.514905 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb7d42-3b44-4187-a9e2-8d604c4fa6bb None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:46.520256 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61185673-30bf-4ea6-9995-3d5e56f94948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:46.521385 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61185673-30bf-4ea6-9995-3d5e56f94948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:46.521669 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61185673-30bf-4ea6-9995-3d5e56f94948 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:46.521927 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61185673-30bf-4ea6-9995-3d5e56f94948 admin admin] PATH_INFO: `/v3/projects/20917c35fad34f64b95d86f6819611ae` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:46.523520 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61185673-30bf-4ea6-9995-3d5e56f94948 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20917c35fad34f64b95d86f6819611ae)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:46.525438 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61185673-30bf-4ea6-9995-3d5e56f94948 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:46.548191 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:46.631568 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-61185673-30bf-4ea6-9995-3d5e56f94948 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20917c35fad34f64b95d86f6819611ae', 'request_id': 'req-61185673-30bf-4ea6-9995-3d5e56f94948'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:46.638169 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-61185673-30bf-4ea6-9995-3d5e56f94948 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20917c35fad34f64b95d86f6819611ae', 'request_id': 'req-61185673-30bf-4ea6-9995-3d5e56f94948'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:46.701815 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-61185673-30bf-4ea6-9995-3d5e56f94948 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20917c35fad34f64b95d86f6819611ae', 'request_id': 'req-61185673-30bf-4ea6-9995-3d5e56f94948'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:46.713131 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-61185673-30bf-4ea6-9995-3d5e56f94948 admin admin] The token cache is being invalidate because project 20917c35fad34f64b95d86f6819611ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:07:46.713422 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-61185673-30bf-4ea6-9995-3d5e56f94948 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:46.714055 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-61185673-30bf-4ea6-9995-3d5e56f94948 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:46.715614 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1458/2893] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:07:46 2022] DELETE /identity/v3/projects/20917c35fad34f64b95d86f6819611ae => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:07:46.720624 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08cd2d5-c196-475a-8547-f8b7e05342de None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:46.721136 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08cd2d5-c196-475a-8547-f8b7e05342de None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:46.721536 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08cd2d5-c196-475a-8547-f8b7e05342de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:46.739842 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-a08cd2d5-c196-475a-8547-f8b7e05342de None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:07:46.741041 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-a08cd2d5-c196-475a-8547-f8b7e05342de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:46.802535 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1436/2894] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:07:46.811050 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644995e-94b0-4d64-95c2-2daa5c76306d None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:46.811343 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644995e-94b0-4d64-95c2-2daa5c76306d None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:46.811650 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644995e-94b0-4d64-95c2-2daa5c76306d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:46.831479 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-d644995e-94b0-4d64-95c2-2daa5c76306d None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:07:46.832722 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-d644995e-94b0-4d64-95c2-2daa5c76306d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:46.840774 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1459/2895] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:07:46.845081 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08cd2d5-c196-475a-8547-f8b7e05342de None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:46.855366 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08cd2d5-c196-475a-8547-f8b7e05342de None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:46.861040 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba78e56-111e-4ed0-98e3-98bcd48110d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:46.862339 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba78e56-111e-4ed0-98e3-98bcd48110d7 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:46.862649 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba78e56-111e-4ed0-98e3-98bcd48110d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:46.862923 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba78e56-111e-4ed0-98e3-98bcd48110d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:46.863688 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba78e56-111e-4ed0-98e3-98bcd48110d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 16:07:46.864002 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba78e56-111e-4ed0-98e3-98bcd48110d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:46.865648 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba78e56-111e-4ed0-98e3-98bcd48110d7 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:46.878466 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1437/2896] 10.222.0.39 () {58 vars in 1152 bytes} [Mon May 23 16:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 16:07:46.884008 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644995e-94b0-4d64-95c2-2daa5c76306d None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:46.893505 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644995e-94b0-4d64-95c2-2daa5c76306d None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:46.898244 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e33762-05f7-4fd0-98aa-462e10abb23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:46.898899 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e33762-05f7-4fd0-98aa-462e10abb23b admin admin] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:46.899186 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e33762-05f7-4fd0-98aa-462e10abb23b admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:46.899493 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e33762-05f7-4fd0-98aa-462e10abb23b admin admin] PATH_INFO: `/v3/projects` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:46.900234 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e33762-05f7-4fd0-98aa-462e10abb23b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:46.902120 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e33762-05f7-4fd0-98aa-462e10abb23b admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:46.998374 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1460/2897] 10.222.0.39 () {60 vars in 1152 bytes} [Mon May 23 16:07:46 2022] POST /identity/v3/projects => generated 399 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:07:47.002608 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba78e56-111e-4ed0-98e3-98bcd48110d7 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:47.012984 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba78e56-111e-4ed0-98e3-98bcd48110d7 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:47.034204 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:47.071074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec740e-29fc-4df8-89c4-4b2d1d03261a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:47.071803 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec740e-29fc-4df8-89c4-4b2d1d03261a admin admin] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:47.072090 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec740e-29fc-4df8-89c4-4b2d1d03261a admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:47.072367 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec740e-29fc-4df8-89c4-4b2d1d03261a admin admin] PATH_INFO: `/v3/users` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:47.073054 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec740e-29fc-4df8-89c4-4b2d1d03261a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:47.075039 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec740e-29fc-4df8-89c4-4b2d1d03261a admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:47.153524 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1438/2898] 10.222.0.39 () {60 vars in 1143 bytes} [Mon May 23 16:07:47 2022] POST /identity/v3/users => generated 300 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 16:07:47.157695 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e33762-05f7-4fd0-98aa-462e10abb23b admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:47.168964 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e33762-05f7-4fd0-98aa-462e10abb23b admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:47.173967 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870426c5-25a6-4df1-8c2d-027b8d6da953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:47.174634 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870426c5-25a6-4df1-8c2d-027b8d6da953 admin admin] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:47.174907 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870426c5-25a6-4df1-8c2d-027b8d6da953 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:47.175181 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870426c5-25a6-4df1-8c2d-027b8d6da953 admin admin] PATH_INFO: `/v3/roles` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:47.175972 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870426c5-25a6-4df1-8c2d-027b8d6da953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:47.177561 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870426c5-25a6-4df1-8c2d-027b8d6da953 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:47.188126 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1461/2899] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:07:47.192778 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec740e-29fc-4df8-89c4-4b2d1d03261a admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:47.203084 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec740e-29fc-4df8-89c4-4b2d1d03261a admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:47.208516 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cded464-45e1-4a65-9473-b8c6090781d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:47.209188 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cded464-45e1-4a65-9473-b8c6090781d0 admin admin] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:47.209474 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cded464-45e1-4a65-9473-b8c6090781d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:47.209754 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cded464-45e1-4a65-9473-b8c6090781d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:47.210485 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cded464-45e1-4a65-9473-b8c6090781d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:47.212154 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cded464-45e1-4a65-9473-b8c6090781d0 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:47.224130 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1439/2900] 10.222.0.39 () {58 vars in 1121 bytes} [Mon May 23 16:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 16:07:47.228434 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870426c5-25a6-4df1-8c2d-027b8d6da953 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:47.239538 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870426c5-25a6-4df1-8c2d-027b8d6da953 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:47.244330 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b568b-2c9e-4177-a02f-ff392976b876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:47.245220 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b568b-2c9e-4177-a02f-ff392976b876 admin admin] REQUEST_METHOD: `PUT` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:47.245506 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b568b-2c9e-4177-a02f-ff392976b876 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:47.245788 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b568b-2c9e-4177-a02f-ff392976b876 admin admin] PATH_INFO: `/v3/projects/18e46c791d074a45bddcad3084d4db80/users/b93f3eac369449fe8b397c64a21fa0ae/roles/c41a7cd1c92b45a7bff9632d07b48006` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:47.261484 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b568b-2c9e-4177-a02f-ff392976b876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18e46c791d074a45bddcad3084d4db80, user_id=b93f3eac369449fe8b397c64a21fa0ae, role_id=c41a7cd1c92b45a7bff9632d07b48006)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:47.264112 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b568b-2c9e-4177-a02f-ff392976b876 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:47.349346 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1462/2901] 10.222.0.39 () {60 vars in 1482 bytes} [Mon May 23 16:07:47 2022] PUT /identity/v3/projects/18e46c791d074a45bddcad3084d4db80/users/b93f3eac369449fe8b397c64a21fa0ae/roles/c41a7cd1c92b45a7bff9632d07b48006 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:07:47.359778 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ac970-27e5-4620-89cf-37af89d25567 None None] REQUEST_METHOD: `POST` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:47.360074 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ac970-27e5-4620-89cf-37af89d25567 None None] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:47.360359 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ac970-27e5-4620-89cf-37af89d25567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:47.386971 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.auth.core [None req-040ac970-27e5-4620-89cf-37af89d25567 None None] MFA Rules not processed for user `b93f3eac369449fe8b397c64a21fa0ae`. Rule list: `[]` (Enabled: `True`). {{(pid=87192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:07:47.388202 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-040ac970-27e5-4620-89cf-37af89d25567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:47.454141 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1440/2902] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:07:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 16:07:47.466197 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b568b-2c9e-4177-a02f-ff392976b876 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:47.467926 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-999b568b-2c9e-4177-a02f-ff392976b876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:47.527168 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b568b-2c9e-4177-a02f-ff392976b876 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:47.530754 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d07d79-b970-469d-9cd6-7c549a8de086 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3514c56baee94de39d6be4c8790ef76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:47.531402 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d07d79-b970-469d-9cd6-7c549a8de086 service cinder] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:47.531727 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d07d79-b970-469d-9cd6-7c549a8de086 service cinder] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:47.532008 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d07d79-b970-469d-9cd6-7c549a8de086 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:47.541803 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d07d79-b970-469d-9cd6-7c549a8de086 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:47.543279 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d07d79-b970-469d-9cd6-7c549a8de086 service cinder] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:47.553415 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1463/2903] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:07:47 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:07:51.061695 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ac970-27e5-4620-89cf-37af89d25567 None None] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:51.063127 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-040ac970-27e5-4620-89cf-37af89d25567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:51.122298 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ac970-27e5-4620-89cf-37af89d25567 None None] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:51.125874 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7380d-45ec-4b07-8a78-7e18f0dc35d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:51.126513 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7380d-45ec-4b07-8a78-7e18f0dc35d3 service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:51.126832 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7380d-45ec-4b07-8a78-7e18f0dc35d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:51.127107 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7380d-45ec-4b07-8a78-7e18f0dc35d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:51.128867 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-18e7380d-45ec-4b07-8a78-7e18f0dc35d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:51.182567 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:51.196195 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7380d-45ec-4b07-8a78-7e18f0dc35d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:51.197647 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7380d-45ec-4b07-8a78-7e18f0dc35d3 service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:51.208140 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1441/2904] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:07:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:07:52.112566 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d07d79-b970-469d-9cd6-7c549a8de086 service cinder] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:52.118421 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-09d07d79-b970-469d-9cd6-7c549a8de086 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:52.169841 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:52.204994 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d07d79-b970-469d-9cd6-7c549a8de086 service cinder] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:52.217238 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144fb28-2a34-4523-a946-3ac990046cea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f7895b7b5748e7b4461f7fde1d558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:52.217911 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144fb28-2a34-4523-a946-3ac990046cea service nova] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:52.218199 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144fb28-2a34-4523-a946-3ac990046cea service nova] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:52.218480 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144fb28-2a34-4523-a946-3ac990046cea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:52.221160 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-a144fb28-2a34-4523-a946-3ac990046cea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:52.242805 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144fb28-2a34-4523-a946-3ac990046cea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:52.245961 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144fb28-2a34-4523-a946-3ac990046cea service nova] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:52.259432 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1464/2905] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:07:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:07:53.587297 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7380d-45ec-4b07-8a78-7e18f0dc35d3 service neutron] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:53.649690 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7380d-45ec-4b07-8a78-7e18f0dc35d3 service neutron] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:53.654251 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92b0e3-aebb-4cc4-9375-8d626c178708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:53.655126 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92b0e3-aebb-4cc4-9375-8d626c178708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:53.655408 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92b0e3-aebb-4cc4-9375-8d626c178708 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:53.655724 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92b0e3-aebb-4cc4-9375-8d626c178708 admin admin] PATH_INFO: `/v3/users/b93f3eac369449fe8b397c64a21fa0ae` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:53.656939 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92b0e3-aebb-4cc4-9375-8d626c178708 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b93f3eac369449fe8b397c64a21fa0ae)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:53.659126 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92b0e3-aebb-4cc4-9375-8d626c178708 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:53.858956 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-ae92b0e3-aebb-4cc4-9375-8d626c178708 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b93f3eac369449fe8b397c64a21fa0ae'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:53.866858 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-ae92b0e3-aebb-4cc4-9375-8d626c178708 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b93f3eac369449fe8b397c64a21fa0ae'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:53.867729 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-ae92b0e3-aebb-4cc4-9375-8d626c178708 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b93f3eac369449fe8b397c64a21fa0ae'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:53.883365 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-ae92b0e3-aebb-4cc4-9375-8d626c178708 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b93f3eac369449fe8b397c64a21fa0ae'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:53.993211 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-ae92b0e3-aebb-4cc4-9375-8d626c178708 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b93f3eac369449fe8b397c64a21fa0ae'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:54.000169 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1442/2906] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:07:53 2022] DELETE /identity/v3/users/b93f3eac369449fe8b397c64a21fa0ae => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:07:54.006095 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209fad7-2072-4ce8-a3ef-3abdf65a7f28 None None] REQUEST_METHOD: `POST` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:54.006607 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209fad7-2072-4ce8-a3ef-3abdf65a7f28 None None] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:54.006725 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209fad7-2072-4ce8-a3ef-3abdf65a7f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:54.024250 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.auth.core [None req-6209fad7-2072-4ce8-a3ef-3abdf65a7f28 None None] MFA Rules not processed for user `e5936312ffff4fbfb32882db5724bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=87191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 16:07:54.025449 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-6209fad7-2072-4ce8-a3ef-3abdf65a7f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:54.085709 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1465/2907] 10.222.0.39 () {58 vars in 957 bytes} [Mon May 23 16:07:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 16:07:54.095285 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92b0e3-aebb-4cc4-9375-8d626c178708 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:54.096736 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-ae92b0e3-aebb-4cc4-9375-8d626c178708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:54.154278 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92b0e3-aebb-4cc4-9375-8d626c178708 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:54.158059 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be552cd6-fdd9-47fd-b200-9e30e24defcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:54.158711 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be552cd6-fdd9-47fd-b200-9e30e24defcb service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:54.158996 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be552cd6-fdd9-47fd-b200-9e30e24defcb service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:54.159273 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be552cd6-fdd9-47fd-b200-9e30e24defcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:54.168450 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be552cd6-fdd9-47fd-b200-9e30e24defcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:54.170191 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be552cd6-fdd9-47fd-b200-9e30e24defcb service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:54.180412 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1443/2908] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:07:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:07:54.646940 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209fad7-2072-4ce8-a3ef-3abdf65a7f28 None None] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:54.648723 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-6209fad7-2072-4ce8-a3ef-3abdf65a7f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:54.662212 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209fad7-2072-4ce8-a3ef-3abdf65a7f28 None None] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:54.667535 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4167ac2-1964-46b8-9c9f-e488b33c8055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:54.669380 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4167ac2-1964-46b8-9c9f-e488b33c8055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:54.669380 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4167ac2-1964-46b8-9c9f-e488b33c8055 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:54.669380 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4167ac2-1964-46b8-9c9f-e488b33c8055 admin admin] PATH_INFO: `/v3/projects/18e46c791d074a45bddcad3084d4db80` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:54.670628 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4167ac2-1964-46b8-9c9f-e488b33c8055 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18e46c791d074a45bddcad3084d4db80)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:54.672726 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4167ac2-1964-46b8-9c9f-e488b33c8055 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:54.800272 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-c4167ac2-1964-46b8-9c9f-e488b33c8055 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18e46c791d074a45bddcad3084d4db80', 'request_id': 'req-c4167ac2-1964-46b8-9c9f-e488b33c8055'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:54.806552 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-c4167ac2-1964-46b8-9c9f-e488b33c8055 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18e46c791d074a45bddcad3084d4db80', 'request_id': 'req-c4167ac2-1964-46b8-9c9f-e488b33c8055'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:54.881545 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-c4167ac2-1964-46b8-9c9f-e488b33c8055 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18e46c791d074a45bddcad3084d4db80', 'request_id': 'req-c4167ac2-1964-46b8-9c9f-e488b33c8055'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:54.881545 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-c4167ac2-1964-46b8-9c9f-e488b33c8055 admin admin] The token cache is being invalidate because project 18e46c791d074a45bddcad3084d4db80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:07:54.881545 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-c4167ac2-1964-46b8-9c9f-e488b33c8055 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:54.881545 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-c4167ac2-1964-46b8-9c9f-e488b33c8055 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:07:54.883074 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1466/2909] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:07:54 2022] DELETE /identity/v3/projects/18e46c791d074a45bddcad3084d4db80 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:07:57.643916 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be552cd6-fdd9-47fd-b200-9e30e24defcb service neutron] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:07:57.645349 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-be552cd6-fdd9-47fd-b200-9e30e24defcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:57.656986 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be552cd6-fdd9-47fd-b200-9e30e24defcb service neutron] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:07:57.662441 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:07:57.707786 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c69fa4-5b4e-4d4c-88f0-9d84567a817b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f831a06a9cf344a2aa068c20a987b6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:07:57.708446 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c69fa4-5b4e-4d4c-88f0-9d84567a817b service neutron] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:07:57.708780 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c69fa4-5b4e-4d4c-88f0-9d84567a817b service neutron] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:07:57.709052 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c69fa4-5b4e-4d4c-88f0-9d84567a817b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:07:57.710870 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-d8c69fa4-5b4e-4d4c-88f0-9d84567a817b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:07:57.779123 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c69fa4-5b4e-4d4c-88f0-9d84567a817b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:07:57.780511 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c69fa4-5b4e-4d4c-88f0-9d84567a817b service neutron] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:07:57.791476 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1444/2910] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:07:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:08:01.167915 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4167ac2-1964-46b8-9c9f-e488b33c8055 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:08:01.170507 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-c4167ac2-1964-46b8-9c9f-e488b33c8055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:08:01.230013 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:08:01.245428 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4167ac2-1964-46b8-9c9f-e488b33c8055 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:08:01.250496 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a43e7-eb38-4b1e-90c1-b7637ae1ad51 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f06d35d7cc48658262bf79d9c72280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:08:01.251152 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a43e7-eb38-4b1e-90c1-b7637ae1ad51 service placement] REQUEST_METHOD: `GET` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:08:01.251994 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a43e7-eb38-4b1e-90c1-b7637ae1ad51 service placement] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:08:01.252443 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a43e7-eb38-4b1e-90c1-b7637ae1ad51 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:08:01.254346 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-a23a43e7-eb38-4b1e-90c1-b7637ae1ad51 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:08:01.269297 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a43e7-eb38-4b1e-90c1-b7637ae1ad51 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:08:01.271009 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a43e7-eb38-4b1e-90c1-b7637ae1ad51 service placement] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:08:01.285137 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1467/2911] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:08:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:08:05.141335 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c69fa4-5b4e-4d4c-88f0-9d84567a817b service neutron] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:08:05.143543 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-d8c69fa4-5b4e-4d4c-88f0-9d84567a817b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:08:05.156895 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c69fa4-5b4e-4d4c-88f0-9d84567a817b service neutron] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:08:05.161819 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a6931-2406-4bff-bd86-24a5650a4e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:08:05.162822 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a6931-2406-4bff-bd86-24a5650a4e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:08:05.163102 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a6931-2406-4bff-bd86-24a5650a4e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:08:05.163378 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a6931-2406-4bff-bd86-24a5650a4e58 admin admin] PATH_INFO: `/v3/users/1d4c1a9323564133817374393d52fba4` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:08:05.164581 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a6931-2406-4bff-bd86-24a5650a4e58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d4c1a9323564133817374393d52fba4)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:08:05.166484 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a6931-2406-4bff-bd86-24a5650a4e58 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:08:05.381824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e36a6931-2406-4bff-bd86-24a5650a4e58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d4c1a9323564133817374393d52fba4'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:08:05.388984 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e36a6931-2406-4bff-bd86-24a5650a4e58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d4c1a9323564133817374393d52fba4'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:08:05.389656 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e36a6931-2406-4bff-bd86-24a5650a4e58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d4c1a9323564133817374393d52fba4'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:08:05.401488 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e36a6931-2406-4bff-bd86-24a5650a4e58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d4c1a9323564133817374393d52fba4'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:08:05.493410 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-e36a6931-2406-4bff-bd86-24a5650a4e58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d4c1a9323564133817374393d52fba4'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:08:05.500178 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1445/2912] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:08:05 2022] DELETE /identity/v3/users/1d4c1a9323564133817374393d52fba4 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:08:05.743216 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a43e7-eb38-4b1e-90c1-b7637ae1ad51 service placement] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:08:05.754297 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a43e7-eb38-4b1e-90c1-b7637ae1ad51 service placement] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:08:05.811616 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407edcc-abe9-46eb-875b-4897b87a98d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:08:05.812498 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407edcc-abe9-46eb-875b-4897b87a98d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:08:05.812784 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407edcc-abe9-46eb-875b-4897b87a98d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:08:05.813065 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407edcc-abe9-46eb-875b-4897b87a98d4 admin admin] PATH_INFO: `/v3/projects/c5b06f17eb584370bb4771cb7c7b69d5` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:08:05.814661 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407edcc-abe9-46eb-875b-4897b87a98d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5b06f17eb584370bb4771cb7c7b69d5)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:08:05.817248 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407edcc-abe9-46eb-875b-4897b87a98d4 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:08:05.958682 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-a407edcc-abe9-46eb-875b-4897b87a98d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5b06f17eb584370bb4771cb7c7b69d5', 'request_id': 'req-a407edcc-abe9-46eb-875b-4897b87a98d4'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:08:05.964846 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-a407edcc-abe9-46eb-875b-4897b87a98d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5b06f17eb584370bb4771cb7c7b69d5', 'request_id': 'req-a407edcc-abe9-46eb-875b-4897b87a98d4'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:08:06.021216 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-a407edcc-abe9-46eb-875b-4897b87a98d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5b06f17eb584370bb4771cb7c7b69d5', 'request_id': 'req-a407edcc-abe9-46eb-875b-4897b87a98d4'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:08:06.034062 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-a407edcc-abe9-46eb-875b-4897b87a98d4 admin admin] The token cache is being invalidate because project c5b06f17eb584370bb4771cb7c7b69d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:08:06.034349 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-a407edcc-abe9-46eb-875b-4897b87a98d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:08:06.034992 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-a407edcc-abe9-46eb-875b-4897b87a98d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:08:06.036681 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1468/2913] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:08:05 2022] DELETE /identity/v3/projects/c5b06f17eb584370bb4771cb7c7b69d5 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:08:06.040638 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a6931-2406-4bff-bd86-24a5650a4e58 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:08:06.042006 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-e36a6931-2406-4bff-bd86-24a5650a4e58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:08:06.056069 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a6931-2406-4bff-bd86-24a5650a4e58 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:08:06.086701 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:08:06.114532 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497f945-0496-4113-afee-5d3d920f6dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:08:06.115615 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497f945-0496-4113-afee-5d3d920f6dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:08:06.116097 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497f945-0496-4113-afee-5d3d920f6dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:08:06.116425 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497f945-0496-4113-afee-5d3d920f6dd3 admin admin] PATH_INFO: `/v3/users/011c5b11d11e4ef2bd3bdaa3b28a3b6a` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:08:06.118107 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497f945-0496-4113-afee-5d3d920f6dd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=011c5b11d11e4ef2bd3bdaa3b28a3b6a)` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:08:06.120211 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497f945-0496-4113-afee-5d3d920f6dd3 admin admin] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:08:06.310731 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-b497f945-0496-4113-afee-5d3d920f6dd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '011c5b11d11e4ef2bd3bdaa3b28a3b6a'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:08:06.320348 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-b497f945-0496-4113-afee-5d3d920f6dd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '011c5b11d11e4ef2bd3bdaa3b28a3b6a'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:08:06.321025 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-b497f945-0496-4113-afee-5d3d920f6dd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '011c5b11d11e4ef2bd3bdaa3b28a3b6a'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:08:06.334095 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-b497f945-0496-4113-afee-5d3d920f6dd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '011c5b11d11e4ef2bd3bdaa3b28a3b6a'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:08:06.392772 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.notifications [None req-b497f945-0496-4113-afee-5d3d920f6dd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '011c5b11d11e4ef2bd3bdaa3b28a3b6a'} {{(pid=87192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:08:06.398938 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1446/2914] 10.222.0.39 () {58 vars in 1223 bytes} [Mon May 23 16:08:06 2022] DELETE /identity/v3/users/011c5b11d11e4ef2bd3bdaa3b28a3b6a => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 16:08:06.675178 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407edcc-abe9-46eb-875b-4897b87a98d4 admin admin] Authenticating user token {{(pid=87191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:08:06.681467 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.fernet_utils [None req-a407edcc-abe9-46eb-875b-4897b87a98d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:08:06.690461 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407edcc-abe9-46eb-875b-4897b87a98d4 admin admin] Validating token access rules against request {{(pid=87191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:08:06.749955 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e00b08-65bf-4b72-8160-65b9d4878e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5936312ffff4fbfb32882db5724bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c760023a56dc4c499f942685a1652dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:08:06.750758 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e00b08-65bf-4b72-8160-65b9d4878e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:08:06.751038 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e00b08-65bf-4b72-8160-65b9d4878e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:08:06.752360 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e00b08-65bf-4b72-8160-65b9d4878e90 admin admin] PATH_INFO: `/v3/projects/753d0c95a4744e02bba7baef4febb578` {{(pid=87191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:08:06.753177 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e00b08-65bf-4b72-8160-65b9d4878e90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=753d0c95a4744e02bba7baef4febb578)` {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:08:06.755090 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e00b08-65bf-4b72-8160-65b9d4878e90 admin admin] RBAC: Authorization granted {{(pid=87191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:08:06.772572 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:08:06.885307 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-e7e00b08-65bf-4b72-8160-65b9d4878e90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '753d0c95a4744e02bba7baef4febb578', 'request_id': 'req-e7e00b08-65bf-4b72-8160-65b9d4878e90'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:08:06.891852 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-e7e00b08-65bf-4b72-8160-65b9d4878e90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '753d0c95a4744e02bba7baef4febb578', 'request_id': 'req-e7e00b08-65bf-4b72-8160-65b9d4878e90'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:08:06.981276 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-e7e00b08-65bf-4b72-8160-65b9d4878e90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '753d0c95a4744e02bba7baef4febb578', 'request_id': 'req-e7e00b08-65bf-4b72-8160-65b9d4878e90'} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:08:06.993354 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-e7e00b08-65bf-4b72-8160-65b9d4878e90 admin admin] The token cache is being invalidate because project 753d0c95a4744e02bba7baef4febb578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 16:08:06.993771 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-e7e00b08-65bf-4b72-8160-65b9d4878e90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:08:06.994605 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG keystone.notifications [None req-e7e00b08-65bf-4b72-8160-65b9d4878e90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 16:08:06.996906 dv-cinder-842119-2-smb devstack@keystone.service[87191]: [pid: 87191|app: 0|req: 1469/2915] 10.222.0.39 () {58 vars in 1232 bytes} [Mon May 23 16:08:06 2022] DELETE /identity/v3/projects/753d0c95a4744e02bba7baef4febb578 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 16:08:16.395274 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=39,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:08:17.053477 dv-cinder-842119-2-smb devstack@keystone.service[87191]: DEBUG dbcounter [-] [87191] Writing DB stats keystone:SELECT=17,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 16:09:35.032219 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497f945-0496-4113-afee-5d3d920f6dd3 admin admin] Authenticating user token {{(pid=87192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 16:09:35.033613 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-b497f945-0496-4113-afee-5d3d920f6dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:09:35.126947 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497f945-0496-4113-afee-5d3d920f6dd3 admin admin] Validating token access rules against request {{(pid=87192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 16:09:35.187146 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d0aa4-a780-4b59-84df-a292c0b0678e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f06d35d7cc48658262bf79d9c72280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8addb03b903842609168ee2fafc8ec6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 16:09:35.187824 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d0aa4-a780-4b59-84df-a292c0b0678e service placement] REQUEST_METHOD: `GET` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 16:09:35.188124 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d0aa4-a780-4b59-84df-a292c0b0678e service placement] SCRIPT_NAME: `/identity` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 16:09:35.188400 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d0aa4-a780-4b59-84df-a292c0b0678e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 16:09:35.190179 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.fernet_utils [None req-119d0aa4-a780-4b59-84df-a292c0b0678e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 16:09:35.201983 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d0aa4-a780-4b59-84df-a292c0b0678e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 16:09:35.203615 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d0aa4-a780-4b59-84df-a292c0b0678e service placement] RBAC: Authorization granted {{(pid=87192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 16:09:35.214603 dv-cinder-842119-2-smb devstack@keystone.service[87192]: [pid: 87192|app: 0|req: 1447/2916] 10.222.0.39 () {60 vars in 1365 bytes} [Mon May 23 16:09:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 16:09:45.209887 dv-cinder-842119-2-smb devstack@keystone.service[87192]: DEBUG dbcounter [-] [87192] Writing DB stats keystone:SELECT=67 {{(pid=87192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}